Keyboard Emulator Research Articles

Advanced UI test automation (AUTA) for BIOS validation using OpenCV and OCR

<p>Basic input output system (BIOS) validation is performed on both graphical user interface (GUI) and command-line interface (CLI) by a test engineer. Keyboard and mouse are used to insert test cases commands into system under test (SUT). Test engineer monitors test cases progress on a monitor for validation. This method is time-consuming and relatively more expensive than automation. In this project we designed an independent automation system that able to mimic human interaction in BIOS validation. The approach can be divided into two main parts. The first part is the input device to enter commands into SUT and the second part is the advanced image recognizer. The keyboard and mouse emulator is used as an input device to reproduce test commands and send them to an SUT. The image analyzer algorithm is developed using OpenCV and optical character recognizer (OCR) tools to help automate some test challenges. Our result shows that advanced user interface (UI) test automation (AUTA) can perform a 125 test cases within 5 hours compared to 48 hours for a human to complete the job.</p>

Virtual keyboard with the prediction of words for children with cerebral palsy

One in every 200 people worldwide cannot express orally because of cognitive, motor, neurological, or emotional problems. Assistive technologies can help people with impairments to use computers to perform their daily life activities independently and to communicate with others. This paper presents a Hidden Markov Model-based word prediction method that allows keyboard emulation software to predict words so that children with disabilities can type texts more quickly. The proposed system involved the development of a keyboard emulator, the construction and processing of a corpus, as well as a word prediction algorithm. Children with different cognitive profiles had to produce a text and type it twice: first with free typing, second using the virtual keyboard's word prediction. Results indicated the word prediction of the keyboard emulator software reduced typing efforts. However, the software initially increased the typing time when the corpus was not well adapted to users. The total amount of clicks with word prediction decreased by around 26.2%. Regarding execution time using prediction, 61% typed the text in less time. The tests performed with literate volunteers indicated a reduction in the number of clicks by up to 51.3%. This result surpasses the 15% achieved in the previous study by Free Virtual Keyboard with word prediction based on pure statistics. Moreover, all volunteers required fewer clicks to perform the task. People with impairments, especially children, could use the system and demonstrate their knowledge and abilities. The entire system is available on the Internet and users have unrestricted and free access to it.

Assistive technology-based programs to promote communication and leisure activities by three children emerged from a minimal conscious state.

This study proposed the use of assistive technology (AT) to promote communication and leisure opportunities by three children with traumatic brain injury (TBI). Furthermore, it assessed the effects of such technology on the indices of positive participation and provided a social validation procedure. Three children emerged from a minimal conscious state and presenting extensive motor disabilities were involved. The intervention program allowed the participants to request and to choice preferred items independently and to perform literacy through a keyboard emulator. A multiple probe design across behaviors with post-intervention check was employed. Outcome measures were correct requests, understandable words, intervals with positive participation, and scores of social validation assessment. Request and choice behaviors and literacy improved significantly during intervention phases. During post-intervention check, all participants consolidated their performance. Moreover, indices of positive participation increased during intervention phases. Scores of social validation assessment showed that the combination of both behaviors was preferable to the same considered separately. AT program showed to be suitable for promoting constructive engagement and literacy behaviors by children with TBI. Future research is needed to generalize this data to a larger sample and to develop new technology for people with different levels of disabilities due to TBI.

Microswitch and keyboard-emulator technology to facilitate the writing performance of persons with extensive motor disabilities

This study assessed the effectiveness of microswitches for simple responses (i.e., partial hand closure, vocalization, and hand stroking) and a keyboard emulator to facilitate the writing performance of three participants with extensive motor disabilities. The study was carried out according to an ABAB design. During the A phases, the participants (one child and two adults) were to write using the responses and technology available to them prior to this study. During the B phases, they used the new responses and technology. Data showed that two of the three participants had a faster writing performance during the B phases while the third participant had a slower writing performance. All three participants indicated a clear preference for the use of the new responses and technology, which were considered relatively easy and comfortable to manage and did not seem to cause any specific signs of tiredness. Implications of the findings are discussed.

Use of microswitch technology and a keyboard emulator to support literacy performance of persons with extensive neuro-motor disabilities

Objective: To assess the effectiveness and acceptability of microswitch technology and a keyboard emulator to enable three participants with extensive neuro-motor disabilities to write words.Method: In Study I, two participants triggered an automatic scanning keyboard and selected/wrote letters via a small sliding movement of their hand(s) activating a touch/pressure panel (microswitch). In Study II, a third participant used the sliding movement and panel and a vocalization response with a voice-detecting microswitch. The sliding movement allowed her to light up the keyboard and select the letters and the vocalization to perform the scanning.Results: Participants showed a better performance (shorter writing time) or an equally effective but less tiring performance with the new microswitch technology and response(s). They also preferred using this technology, and social validation ratings favoured such technology over previous solutions.Conclusion: The aforementioned technology may be useful to enable persons with extensive neuro-motor disabilities to write successfully.

A voice-detecting sensor and a scanning keyboard emulator to support word writing by two boys with extensive motor disabilities

The present study assessed the use of a voice-detecting sensor interfaced with a scanning keyboard emulator to allow two boys with extensive motor disabilities to write. Specifically, the study (a) compared the effects of the voice-detecting sensor with those of a familiar pressure sensor on the boys’ writing time, (b) checked which of the sensors the boys preferred, and (c) conducted a social validation assessment of the boys’ performance with the two sensors, employing psychology students as raters. The difference in the boys’ overall mean writing time per letter across sensors was, by the end of the study, about 1.5 s. This difference favored the pressure sensor for one of the boys and the voice-detecting sensor for the other boy. Both boys showed preference for the voice-detecting sensor. Moreover, the psychology students involved in the social validation assessment indicated that such sensor was more satisfactory, suitable, and educationally relevant than the pressure sensor, and represented the solution that they as raters supported more.

Using an Optic Sensor and a Scanning Keyboard Emulator to Facilitate Writing by Persons with Pervasive Motor Disabilities

The present two studies assessed the use of an optic sensor together with a scanning keyboard emulator to enable two young adults with pervasive motor disabilities to click keyboard keys and, as a result, write. The optic sensor used for the participant of Study 1 was a light-dependent resistor that the participant activated with his tongue. The optic sensor used for the participant of Study II was a photoelectric device mounted on an eyeglasses’ frame that the participant activated by turning her eyes. The results showed that the optic sensor together with a scanning keyboard emulator allowed the participants to write fairly satisfactorily. Writing time per letter as well as numbers of words and letters written significantly improved during intervention sessions as opposed to baseline sessions. Preference checks showed that both participants favored the optic sensor and related tongue or eye response over the technology and responses available in baseline. Moreover, teacher trainees and psychology students involved in social validation checks of the intervention program provided fairly positive ratings.

8C14 障害者用片手操作キーボードエミュレータの開発

8C14 障害者用片手操作キーボードエミュレータの開発

Adaptive and predictive techniques in a communication prosthesis

This paper describes a communication aid and keyboard emulator which has been developed at Dundee University. The device, Predictive Adaptive Lexicon (PAL), exploits the redundancy in natural language to reduce the key pushes or character selections necessary during the composition of text. Word predictions are offered to the user from a dictionary, and if one of these is selected the word is completed by PAL. PAL adapts to the user's vocabulary by automatically capturing words which are not already in the dictionary. These will thereafter be offered in prediction lists. A reduction in the number of character inputs necessary to enter any given text of over 50% is possible when using PAL, giving the user a considerable saving in time and effort.

The MOD Keyboard

A special plug-in cartridge for the VIC-20 converts it into a dynamic keyboard emulator that enables a handicapped user to control a second, unmodified computer.