Abstract
<p>Hands can produce a variety of poses in which each pose can have a meaning or purpose that can be used as a form of communication determined according to a general agreement or who communicate. Hand pose can be used as human interaction with the computer is faster, intuitive, and in line with the natural function of the human body called Handsign. One of them is Kodàly Handsign, made by a Hungarian composer named Zoltán Kodály, which is a concept in music education in Hungary. This hand sign is used in interactive angklung performances in determining the tone that will be played by the K-Nearest Neighbor (KNN) algorithm classification process based on hand poses. This classification process is performed on the extracted data from Leap Motion Controller, which takes Pitch, Roll, and Yaw values based on basic aircraft principle. The results of the research were conducted five times with the value of k periodically 1,3,5,7,9 with test data consisting pose of 874 Do', 702 Si, 913 La, 612 Sol, 661 Fa, 526 Mi, 891 Re, and 1004 Do punctuation on 21099 training data. The test results can recognize hand poses with the optimal k value k=1 with an accuracy level of 94.87%.</p>
Highlights
Angklung is one of the traditional musical instruments from the West Java region that is in great demand from various ages
This Angklung can be played individually or in a crowd directly without training first or can be called the Interactive Angklung performance. Because it is played in tandem, it is necessary to use the method used by the conductor. The method makes it easier to lead the Interactive Angklung performance in telling the tone that will be played to the angklung player, namely with a score or with a hand sign
Extraction of data to be classified from Leap Motion Controller [8], which is the visualization of detecting the right hand [9] and get data for tone determination consisting of Pitch, Roll, Yaw [10] obtained from the hand orientation tracking based on the normal palm
Summary
Angklung is one of the traditional musical instruments from the West Java region that is in great demand from various ages. Because it is played in tandem, it is necessary to use the method used by the conductor The method makes it easier to lead the Interactive Angklung performance in telling the tone that will be played to the angklung player, namely with a score or with a hand sign (hand pose). This technology provides opportunities for users to interact with computers using hand or body movements and even hand poses. It is played in several people, and if there are obstacles, it can be replaced by a machine where the machine can be controlled by one person To make it easier to play the angklung, it is necessary to determine the hand sign tone from the visualization of the tone with the Leap Motion Controller. The use of KNN has been used in various studies in the area of object recognition, one of which is the use of KNN in the development of the introduction of Arabic Sign Language [5]
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callMore From: International Journal on Information and Communication Technology (IJoICT)
Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
