МУЛЬТИМЕДИЙНЫЙ ПРОГРАММНЫЙ КОМПЛЕКС ДЛЯ СОЗДАНИЯ СЛОВАРЯ РУССКОГО ЖЕСТОВОГО ЯЗЫКА

Abstract

The possibility of computer Russian Sign Language interpretation, which is based on dictionary, was studied. The analysis of modern multimedia sign language dictionaries is made here in view of their further use in automatic sign language interpretation. The prospects of animated character (avatar) use for the demonstration of gestures and sign language notations for their control were substantiated. The analysis of modern notations of sign language was made. The substantiation of the use of Dimskis notation was given as promising for the development of Russian Sign Language Dictionary. The use of the modern cross-platform graphical Unity3D for the creation of animated sign language interpreter model allows to create the economical and effective system. The functionality of Unity3D is available and meets all the requirements for the work with avatar. The main characteristics of Dimskis notation and the peculiarities of the use of notation elements in the computer implementation are considered. The multi-level structure of software complex for the creation of sign language guide was described. The hierarchical structure of animation tree building allows constructing the sequence of available basic records, limiting the possibility of irreversible changes of main elaborated motions and at the same time providing the availability of all the necessary basic animations for the user. The use of Dimskis notation allows the users who know Russian sign language to enrich their term dictionary, the use of the guide is suggested for the demonstration of the dactyl and words and also compound phrases. The proposed approach gives the opportunity to create "lessons" on specific topics for training.