Abstract

This paper presents an intelligent system allowing handicapped aphasiacs to perform basic communication tasks. It has the following three key features: (1) A 6-sensor data glove measures the finger gestures of a patient in terms of the bending degrees of his fingers. (2) A finger language recognition subsystem recognizes language components from the finger gestures. It employs multiple regression analysis to automatically extract proper finger features so that the recognition model can be fast and correctly constructed by a radial basis function neural network. (3) A coordinate-indexed virtual keyboard allows the users to directly access the letters on the keyboard at a practical speed. The system serves as a viable tool for natural and affordable communication for handicapped aphasiacs through continuous finger language input.

Highlights

  • Disabled people suffering from severe impairments usually face an acute problem: most common interaction modalities are unavailable and their communication capabilities are limited

  • The fact that the finger language designed for disabled aphasiacs involves only very tiny finger movements imposes very stringent requirements on both the software and hardware of any prospective systems

  • Important techniques involved in the recognition of finger language components are shown in Figure 2, including feature values calculation, feature selection and radial basis function neural network-based classification

Read more

Summary

Introduction

Disabled people suffering from severe impairments usually face an acute problem: most common interaction modalities are unavailable and their communication capabilities are limited. It can be very frustrating for them to interact with the computer. They require and expect AAC (Augmentative and Alternative Communication) systems to partly alleviate physical limitations. AAC systems are usually equipped with special access mechanisms, since the users lack the fine motor-control required to operate such systems with standard peripheral devices. (c) The target users lack necessary motor control to operate associated peripherals. The objective of this work is to develop an intelligent and easy-to-use communication system (including proper hardware and software) that makes it possible for handicapped aphasiacs to perform basic communication tasks naturally and affordably

Finger Language
Virtual Keyboard
Data Gloves
The Approach
Data Glove as the Input Device
Finger Language Recognition Subsystem
Feature Values Calculation
Feature Selection
Radial Basis Function Neural Network-Based Classification
Virtual Keyboard-Supported Text Output
System Development and Application
Findings
Summary and Discussions
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call