Braille Input Research Articles

Research on efficient braille recognition based on the pair-U-shaped micro-nano optical fiber fingerprint-like tactile sensors

Tactile sensors are essential for capturing touch information, yet existing sensors struggle to accurately mimic human pressure and motion perception. This study introduces a novel design resembling a fingerprint, featuring a pair-U-shaped flexible optical fiber tactile sensor, and assesses its efficacy in braille input interactions. Constructed from 3D-printed elastomeric resin, the sensor incorporates a bilayer structure that mirrors a fingerprint pattern, with interlocking microstructures and encapsulated pair-U-shaped micro-nano-optical fibers (MNF) within a polydimethylsiloxane (PDMS) layer. These design elements allow these two MNF sensing channels to achieve synchronization, enhancing durability and sensitivity (66.08 % N−1 and 65.59 %N−1), quickening response (84.17/17.49 ms) and recovery time (58.31/10.02 ms) for detecting braille surfaces. Utilizing the Long Short-Term Memory (LSTM) algorithm significantly boosts the accuracy of braille character recognition. Post-training, the sensor achieved a 97.10 % recognition rate for 26 English letters under varying speeds and pressures. Moreover, the recognition rate for letters with similar features (B/K, F/M, G/X, H/U) improved to 98.58 %, underscoring the sensor’s effectiveness in braille recognition. This innovative approach holds potential for applications in braille reading, surface sensing, and related areas.

A Portable One-Hand Braille Input System Enabled by Dual-Interlocked Tactile Sensors for Communication

This article presents a novel portable one-hand Braille input system (BIS) to assist visually impaired users in entering text on electronic devices. The proposed BIS is designed based on a flexible Braille keyboard (FBK), it mainly consists of five dual-interlocked tactile sensors, a processing circuit, and a software modulus. The fully elastomeric graphene/carbon nanotube/ silicone rubber nanocomposites are synthesized and used as tactile sensing material and polydimethylsiloxane (PDMS) as the structural and encapsulation for the fabrication of sensors. Characterization tests showed the tactile sensor has relatively high force sensing sensitivity of 0.649 N <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$^{-\text{1}}$</tex-math> </inline-formula> at sensing range of 0–5 N and a frequency sensing ability of 0.5–2.0 Hz, which can meet human finger pressing requirements. A specific Braille input method is proposed, and personalized parameters are set for users to fit different pressing habits. The average input speed of 3.37 words per minute (WPM) with an average accuracy of 92.2% for Braille characters input is demonstrated by evaluating text entry performance. The results indicated that our developed tactile sensor enabled portable one-hand BIS can assist visual impaired users with enhanced text entry on electronic devices effectively and privately.

Multisensory Flexible Braille Interactive Device Based on Liquid Crystal Elastomers

Traditional electronic braille devices’ rigid and complex structure limits their portability while satisfying braille output. Main-chain monodomain liquid crystal elastomers (m-LCEs) can achieve high contraction deformation under external stimulation conditions; it has broad application prospects in the human–machine interaction with the biological tissue safety and flexibility of LCEs. A multisensory flexible braille interactive device based on LCEs is proposed in this article. It utilizes the good reversible shape-memory performance of m-LCEs to solve the problems of complex structure design, poor portability, high cost, and low control stability in traditional rigid mechanical braille readers. The fixed-point stretchable convex lattice and the nonactuation performance-based film are accurately distinguished and fabricated by compression molding. Combined with the ultrathin flexible electric heating layer, the reversible contraction of the braille point is realized, and the braille point is given the dual perception of height difference and temperature difference. Moreover, matching circuit design can realize braille input by press and braille output by convex–concave conversion. Furthermore, we try to introduce thermochromic powders, referring to the principle of light-emitting diode (LED) imaging, to transform the pattern concept of visually impaired people in minds into color information that ordinary people can observe.

MAGIC-I as an Assistance for the Visually Impaired People

Background: According to the WHO report, around 4.07% of the world's population is visually impaired. About 90% of the visually impaired users live in the lower economic strata. In the fast moving technology, most of the invention misses the need of these people. Mainly the technologies were designed for mainstream people; visually impaired people always find an inability to access it. This inability arises primarily for reasons such as cost, for example, Perkins Brailler costs 80-248 dollars for the simple purpose of Braille input. Another major reason is the hassle of carrying the big equipment. Objective: Keeping all this in mind and making technology as their best friends, MAGIC-1 has been designed. The goal is to provide a solution in terms of an application, which helps the visually impaired user in their daily life activities. Method: The proposed solution assists visually impaired users through smart phone technology. If visually impaired users ever wished to have a touched guide into a smart phone, MAGIC-1 has the solution that consolidates all the important features in their daily activities. Results: The performance of the solution as a whole and its individual features in terms of usability, utility and other metrics, etc. has been tested with sample visually impaired users. Moreover, their performances in term of Errors per Word and Words per Minute have been observed. Conclusion: MAGIC-I, the proposed solution works as an assistant of visually impaired users to overcome their daily struggles and stay more connected to the world. A visually impaired user can communicate via their mobile devices with features like eyes free texting using braille, voice calling etc. They can easily take help in an emergency situation with the options of SOS emergency calling and video assistance.

Temporal Dynamics of Brain White Matter Plasticity in Sighted Subjects during Tactile Braille Learning: A Longitudinal Diffusion Tensor Imaging Study.

The white matter (WM) architecture of the human brain changes in response to training, though fine-grained temporal characteristics of training-induced white matter plasticity remain unexplored. We investigated white matter microstructural changes using diffusion tensor imaging at five different time points in 26 sighted female adults during 8 months of training on tactile braille reading. Our results show that training-induced white matter plasticity occurs both within and beyond the trained sensory modality, as reflected by fractional anisotropy (FA) increases in somatosensory and visual cortex, respectively. The observed changes followed distinct time courses, with gradual linear FA increase along the training in the somatosensory cortex and sudden visual cortex cross-modal plasticity occurring after braille input became linguistically meaningful. WM changes observed in these areas returned to baseline after the cessation of learning in line with the supply-demand model of plasticity. These results also indicate that the temporal dynamics of microstructural plasticity in different cortical regions might be modulated by the nature of computational demands. We provide additional evidence that observed FA training-induced changes are behaviorally relevant to tactile reading. Together, these results demonstrate that WM plasticity is a highly dynamic process modulated by the introduction of novel experiences.SIGNIFICANCE STATEMENT Throughout the lifetime the human brain is shaped by various experiences. Training-induced reorganization in white matter (WM) microstructure has been reported, but we know little about its temporal dynamics. To fill this gap, we scanned sighted subjects five times during tactile braille reading training. We observed different dynamics of WM plasticity in the somatosensory and visual cortices implicated in braille reading. The former showed a continuous increase in WM tissue anisotropy along with tactile training, while microstructural changes in the latter were observed only after the participants learned to read braille words. Our results confirm the supply-demand model of brain plasticity and provide evidence that WM reorganization depends on distinct computational demands and functional roles of regions involved in the trained skill.

Multi-touch gesture recognition of Braille input based on Petri Net and RBF Net

Multi-touch gesture recognition of Braille input based on Petri Net and RBF Net

Passive Haptic Learning of Taiwanese Braille Writing for Visually Impaired Individuals

Abstract In this article, a passive haptic learning method for Taiwanese Braille writing was developed for visually impaired individuals through the employment of an effective user-friendly learning strategy. This system was designed with portability and low cost by applying the learning concept of passive haptic learning. This system designed a pair of gloves for visually impaired people to study Braille writing. Furthermore, we also designed a Braille writing teaching system for visually impaired people to learn and practice the Braille writing. Depending on the learning content, the corresponding vibration motors on the glove fingertips vibrate to produce the Taiwan Braille input gestures. The visually impaired people then feel tactile vibration feedback from the glove fingertips. In addition, the corresponding auditory feedback is provided from the Braille writing teaching system. After receiving a series of tactile vibration feedback, user’s finger muscles could memorize the corresponding Braille input gestures by the passive haptic learning. In the practice mode, the teaching system randomly selects practice content and announces the selected content in an auditory manner. Visually impaired users must then input the corresponding Braille codes by using the Braille writing input module. This mode can further reinforce users’ memorization of correct Braille codes for Mandarin characters.

Deep learning scheme for character prediction with position-free touch screen-based Braille input method

Smart devices are effective in helping people with impairments, overcome their disabilities, and improve their living standards. Braille is a popular method used for communication by visually impaired people. Touch screen smart devices can be used to take Braille input and instantaneously convert it into a natural language. Most of these schemes require location-specific input that is difficult for visually impaired users. In this study, a position-free accessible touchscreen-based Braille input algorithm is designed and implemented for visually impaired people. It aims to place the least burden on the user, who is only required to tap those dots that are needed for a specific character. The user has input English Braille Grade 1 data (a–z) using a newly designed application. A total dataset comprised of 1258 images was collected. The classification was performed using deep learning techniques, out of which 70%–30% was used for training and validation purposes. The proposed method was thoroughly evaluated on a dataset collected from visually impaired people using Deep Learning (DL) techniques. The results obtained from deep learning techniques are compared with classical machine learning techniques like Naïve Bayes (NB), Decision Trees (DT), SVM, and KNN. We divided the multi-class into two categories, i.e., Category-A (a–m) and Category-B (n–z). The performance was evaluated using Sensitivity, Specificity, Positive Predicted Value (PPV), Negative Predicted Value (NPV), False Positive Rate (FPV), Total Accuracy (TA), and Area under the Curve (AUC). GoogLeNet Model, followed by the Sequential model, SVM, DT, KNN, and NB achieved the highest performance. The results prove that the proposed Braille input method for touch screen devices is more effective and that the deep learning method can predict the user's input with high accuracy.

Design and implementation of huvigation for the visually impaired

Background/Objectives: Visual impairments should take the risk alone, we need to design a Huvigation because it is necessary to study the route and surrounding dangerous obstacles with a convenient device.Methods/Statistical analysis: Set the destination using voice recognition and braille input device to help the users find the way, guided by voice when user want, obstacles are read using an ultrasonic sensor. In the obstacle detection method, prioritize in the direction of things by three ultrasonic sensors. And the user recognize the direction of things reduces the probability of strike the object than other functions.Findings: The proposed system can set the destination using speech recognition or a braille input device. The information is transmitted to a navigation web page linked with the input destination, and navigation is guided using the navigation function. This device transmits the information received using a speaker. This device receives information from the ultrasonic sensor. When objects come into range, a voice is transmitted to the user to prevent collision. When the user arrives at the destination, It announces the arrival using the speaker, and wait for the next command.Improvements/Applications: The safety of the user is ensured through three ultrasonic sensors. Every time the user moves and checks the location information and provides movement information.

Electronic Voice for Set of the Syllables from Braille Code Input based on Microcontroller

Objectives: This paper presents the design and implementation of an electronic device that can convert the input code be the voice corresponding braille code input. Methods/Statistical Analysis: This electronic device has some push button that used to enter the braille code. The microcontroller will read and convert them into character. This character will be displayed on the LCD monitor to ensure the correct or not. Microcontroller also function to set MP3 Player Module to run MP3 document that correspond the characters entered. All MP3 sound documents are stored on the SD card. Findings: This electronic device has the ability to recognize each character is entered in braille code via push button. Also, these electronic devices can recognize the arrangement of the characters that form syllables. Each character or syllable that has been entered can be voiced by this device. Arrangement of syllables that make up the word can also be voiced by device per syllable. Voicing any character and syllables using Indonesian. Application/Improvements: These electronic devices can be a media for learning to children with visual impairment or blind people to recognize braille code and how to pronounce it independently.

Human Computer Interface for Victims using FPGA

Visually impaired people face many challenges in the society; particularly students with visual impairments face unique challenges in the education environment. They struggle a lot to access the information, so to resolve this obstacle in reading and to allow the visually impaired students to fully access and participate in the curriculum with the greatest possible level of independence, a Braille transliteration system using VLSI is designed. Here Braille input is given to FPGA Virtex-4 kit via Braille keyboard. The Braille language is converted into English language by decoding logic in VHDL/Verilog and then the corresponding alphabet letter is converted into speech signal with the help of the algorithm. Speaker is used for the voice output. This project allows the visually impaired people to get literate also the person can get a conformation about what is being typed, every time that character is being pressed, this prevents the occurrence of mistakes.

Development of Braille Input Learning System for the Students of the School for the Blind

Development of Braille Input Learning System for the Students of the School for the Blind

A user interface for the visual-impairment

This paper presents a user interface for the visual-impaired person to operate a computer by using the Braille input method. This system focuses on embedding the visual-impaired enabling functions into the desktop operating environment for the visual impairment. When the user inputs text by the presented Braille input method, our system can simultaneously display the context on the tactile Braille reading device, the computer screen with printed text, and the audio device with voice. Moreover, the system can also detect printed text, which was updated by another application program, on the screen and exports this new context to the tactile reading device and audio device to remind the visual-impaired operator of this event. The major contribution of this paper is to enable the visual-impaired person to use their proficient Braille input method to operate the computer without learning a new input method. The performance of the presented system has been evaluated by blind users with encouraging results.

Designing a universal keyboard using chording gloves

A universal input device for both text and Braille input was developed in a Glove-typed interface using all the joints of the four fingers and thumbs of both hands. The glove-typed device works as of now for input of Korean characters, numbers, and Braille characters using mode conversion. Considering the finger force and the fatigue from repeated finger motions, the input switch was made of conductible silicon ink, which is easy to apply to any type of surface, light, and enduring. The usability testing with (1) blind subjects showed the performance matching with a commercial Braille keypad, and (2) non-blind subjects for Korean characters showed comparable performance with cellular phone input keypads, but inferior to conventional keyboard. Subjects' performance showed that the chording gloves can input approximately 122 Braille characters per minute and 108 words per minute in Korean character. The chording gloves developed in our study is expected to be used with common computing devices such as PCs and PDAs, and can contribute to replacing the Braille-based note-takers with less expensive computing devices for blind users.