Sentence Formation Using NLP on the Basis of American Sign Language

Abstract

Abstract: Natural language processing at its core is a method to understand, process and utilize human language that helps in the development of different tools. One such field where this tool can be used for is sign language which is the primary method of communication for the impaired which usually requires a translator to interpret the meaning for those who do not have the knowledge. This paper aims to propose a method that can translate recognized signed words from ASL into proper grammatically correct English sentences with the use of different NLP techniques and parsing it into a Lexicalized Tree Adjoining Grammar (LTAG) using LALR parser. This approach uses a LTAG which is a lexicon that is organized on grammar and vocabulary of the English language and connects in a group of trees. The output matrix of words from the sign recognition is used as an input for the Parts of Speech (POS) tagger that will be parsed into the grammar tree giving a proper English sentence which will be verified by using Language Tool to check the grammar of the final sentence. Keywords: Sentence Formation, American Sign Language, Natural Language Processing, Sign Language recognition, Grammar mapping