Using motion capture to produce learning software to aid teachers of sign language

Abstract

There is a scarcity of games in the market place that can teach British sign language. Furthermore, there have been minimal efforts to develop such games. This paper addresses the creation of a prototype using the latest motion capture camera, the Microsoft Kinect TM , to aid British sign language teachers in educating young pupils learning sign language for the first time. By using this technology, the prototype can be used to teach the basics of British sign language (using a combination of JavaScript and HTML5) to deliver a rich learning experience within a web browser. Interviews and play tests were conducted with 10 sign language experts. None of them were familiar with using games technology to teach sign language, although many of them used the internet, DVD and other audiovisual technology to teach deaf students. They provided positive feedback on the prototype, and believed that such technology could be used alongside traditional sign language teaching methods.