Character Recognition System Research Articles

Deep transformer-based architecture for the recognition of mathematical equations from real-world math problems

Identifying mathematical equations from real-world math problems presents a unique and challenging task within the field of Natural Language Processing (NLP). It has a wide range of applications in various areas, such as academics, digital content design, and the development of automatic or interactive learning systems. However, the accurate understanding of these equations still needs to be enhanced due to the intrinsic complexity of mathematical symbols and various structural formats. Additionally, the unique syntax, diverse symbols, and complex structure of mathematical equations present significant obstacles that traditional NLP methods and Optical Character Recognition (OCR) systems need help to overcome. In this research, we utilize deep transformer architecture to recognize mathematical equations, and we have utilized our novel dataset with 3433 distinct observations. This dataset, which we have collected to include a diverse range of mathematical equations, is used to predict six (z=x+y, z=x−y, z=xy, z=x/y, y=x! and y=x) basic mathematical equations. We applied different transformer-based architectures, such as BERT, ELECTRA, XLNet, RoBERTa, and DistilBERT, and BERT performs best with 99.80% accuracy. To the best of our knowledge, this is the first NLP work in any language where we recognize the equation from the mathematical text.

Transliterating Javanese Script Images to Roman Script using Convolutional Neural Network with Transfer Learning

The Javanese script holds immense cultural significance within Indonesia despite its diminishing usage in contemporary contexts. Its presence remains notable in specific regions of Java and remains integral to many historical documents and texts. Consequently, there is an urgent need for a transliteration system adept at converting Javanese script into contemporary scripts like Roman or Indonesian, thereby contributing to preserving Java's linguistic and cultural legacy. However, reading or transliterating Javanese script can be time-consuming, especially for longer texts, presenting considerable challenges for non-native readers. This study aims to develop an effective transliteration system for converting Javanese script into Roman script. This system addresses the pressing need to preserve Java's linguistic and cultural heritage by facilitating the readability and accessibility of Javanese script, especially for non-native readers. This study introduces an Optical Character Recognition (OCR) system tailored to identify Javanese script characters and transcribe them into Roman characters, explicitly focusing on fundamental nglegena and sandhangan swara characters. Individual characters are isolated by leveraging horizontal and vertical projection techniques, facilitating subsequent classification using a Convolutional Neural Network (CNN) employing transfer learning methodologies. The system's achievement of an impressive average similarity score of 90.78% is noteworthy, with the Xception architecture demonstrating superior efficiency in transliteration tasks. Implementing such a system harbors significant promise in safeguarding the Javanese script and enhancing its accessibility to a broader audience. This research contributes substantially to preserving and propagating Indonesia's rich cultural and linguistic heritage amidst the digital age.

Handwritten Character Recognition using Enhanced Artificial Neural Network

This study addresses the concerns regarding the performance of Handwritten Character Recognition (HCR) systems, focusing on the classification stage. It is widely acknowledged that the development of the classification model significantly impacts the overall performance of HCR. The problems identified specifically pertain to the classification model, particularly in the context of the Artificial Neural Network (ANN) learning problem, leading to low accuracy in recognizing handwritten characters. The objective of this study is to improve and refine the ANN classification model to achieve better HCR. To achieve this goal, this study proposed a hybrid Flower Pollination Algorithm with Artificial Neural Network (FPA-ANN) classification model for HCR. The FPA is one of the metaheuristic approaches is utilized as an optimization technique to enhance the performance of ANN, particularly by optimizing the network training process of ANN. The experimentation phase involves using the National Institute of Standards and Technology (NIST) handwritten character database. Finally, the proposed FPA-ANN classification model is analyzed based on generated confusion matrix and evaluated performance of the classification model in terms of precision, sensitivity, specificity, F-score and accuracy.

Bangla Optical Character Recognition for Mobile Platforms: A Comprehensive Cross-Platform Approach

The development of Optical Character Recognition (OCR) systems for Bangla script has been an area of active research since the 1980s. This study presents a comprehensive analysis and development of a cross-platform mobile application for Bangla OCR, leveraging the Tesseract OCR engine. The primary objective is to enhance the recognition accuracy of Bangla characters, achieving rates between 90% and 99%. The application is designed to facilitate the automatic extraction of text from images selected from the device's photo library, promoting the preservation and accessibility of Bangla language materials. This paper discusses the methodology, including the preparation of training datasets, preprocessing steps, and the integration of the Tesseract OCR engine within a Dart programming environment for cross-platform functionality. This integration provides that the application could be introduced on mobile platforms without substantial alterations. The results demonstrate significant improvements in recognition accuracy, making this application a valuable tool for various practical applications such as data entry for printed Bengali documents, automatic recognition of Bangla number plates, and the digital archiving of vintage Bangla books. These improvements are crucial to further enhance the usability and reliability of Bangla OCR on mobile devices. Our cross-platform method for Bangla OCR on mobile devices provides a strong solution with exceptional identification accuracy, which helps in preserving and making Bangla language information accessible in digital format. This study has significant implications for future research and advancement in the field of optical character recognition (OCR) for intricate writing systems, especially in mobile settings.

Optical character recognition system using artificial intelligence

Abstract A technique termed optical character recognition, or OCR, is used to extract text from images. An OCR the system's primary goal is to transform already present paper-based paperwork or picture data into usable papers. Character as well as word detection are the two main phases of an OCR, which is designed using many algorithms. An OCR also maintains a document's structure by focusing on sentence identification, which is a more sophisticated approach. Research has demonstrated that despite the efforts of numerous scholars, no error-free Bengali OCR has been produced. This issue is addressed by developing an OCR for the Bengali language using the latest 3.03 version of the Tesseract OCR engine for Windows.

Character recognition system for pegon typed manuscript

The Pegon script is an Arabic-based writing system used for Javanese, Sundanese, Madurese, and Indonesian languages. Due to various reasons, this script is now mainly found among collectors and private Islamic boarding schools (pesantren), creating a need for its preservation. One preservation method is digitization through transcription into machine-encoded text, known as OCR (Optical Character Recognition). No published literature exists on OCR systems for this specific script. This research explores the OCR of Pegon typed manuscripts, introducing novel synthesized and real annotated datasets for this task. These datasets evaluate proposed OCR methods, especially those adapted from existing Arabic OCR systems. Results show that deep learning techniques outperform conventional ones, which fail to detect Pegon text. The proposed system uses YOLOv5 for line segmentation and a CTC-CRNN architecture for line text recognition, achieving an F1-score of 0.94 for segmentation and a CER of 0.03 for recognition.

A Recognition System for Devanagari Handwritten Digits Using CNN

A Recognition System for Devanagari Handwritten Digits using CNN, a novel approach to recognizing transcribed digits in the Devanagari script using Convolutional Neural Networks (CNN). This framework represents a significant contribution to the field of pattern recognition and language processing objective of the research project is to perform a literature review, identify an algorithm for a digits recognition system implement the Devanagari digits recognition system for educational activities. In the first phase, a dataset of 150 transcribed digit images is curated, allocating 75% for training (113 images) and 25% for validation (37 images). A Convolutional Neural Network (CNN) is designed with five convolutional layers, each utilizing 3 × 3 filters with 16, 32, 64, 128, and 128 feature maps, respectively. The experiments conducted involve varying the number of epochs, with results captured at 5, 10, 20, and 100 epochs. This comprehensive evaluation aims to understand the model's convergence and performance over different training durations. The outcomes of this phase contribute to the fine-tuning and optimization of the model for subsequent phases. In the second phase, the dataset is expanded to 100*10 (1000) images, each resized to 28 × 28 pixels through cropping. The CNN architecture remains consistent, with the previously determined layer configuration. Similar experiments are conducted, assessing the model's performance over 5, 10, 20, and 100 epochs. This model with a data size of 1000 demonstrates superior accuracy (100% on mini-batches) compared to the 150 model, with consistently high validation accuracy, while both models exhibit decreasing trends in mini-batch and validation losses, favoring the larger dataset, and maintaining a constant learning rate at 0.0100, albeit with a slightly longer time elapsed for each epoch due to the increased data size. 98.37398 accuracy in the phase 2 experiment in 100 epochs. Similar research and contributions and Devanagari’s character and word recognition system.

A Survey on Text-Line Segmentation in Arab Historical Manuscripts

The segmentation process entails dividing or decomposing the entire document image into segments. This operation serves as a fundamental step in developing any writing or optical character recognition system. However, numerous existing segmentation schemes encounter challenges when dealing with specific script styles, like ancient or historical Arabic writing found in ancient manuscripts, which possesses unique characteristics. These characteristics include inclined text lines, overlapping letters, diacritic marks, decorative elements, variable letter forms, and ligatures (combinations of two or more letters merged to form a single connected shape). Thus, in this paper, we present a thorough survey of the field. The survey is composed of two parts. The first section provides a concise overview of historical Arabic documents. The second, which serves as the primary section, focuses on the crucial step of handwritten document recognition, specifically segmentation. A detailed and systematic overview of various segmentation approaches at different levels for extracting handwritten Arabic text-lines is outlined, followed by a literature study analyzing proposed works in this area.

Recognition and analysis system of steel stamping character based on machine vision

During the packaging process, it is essential to detect the steel stamping characters inside the box to identify any missing or repeated characters. Currently, manual detection suffers from low efficiency and a high false detection rate. To address these challenges, a steel stamping character recognition and analysis system based on machine vision has been developed. The enhanced YOLOv7 detection method was employed for character identification, complemented by a statistical analysis approach to achieve automated judgment and detection. To address the issue of size disparity between large and small characters, a small size anchor box and a larger detection head were integrated. Furthermore, modifications were made to the output structure of the YOLOv7 prediction network to enhance multi-scale detection capabilities. The inclusion of the location attention convolution module bolstered global feature extraction, thereby enhancing the detection accuracy of similar characters. Moreover, the utilization of a hash table was used to improve the efficiency of mapping steel stamping character recognition sequences. The experimental results demonstrate that the enhanced model achieves an accuracy of 99.83%, with a processing efficiency of 10.5 ms per single frame. These findings align with the performance criteria for automatic recognition and analysis of steel stamping characters.

Handwritten Text Recognition

Handwritten text detection refers to the capacity of a computer system to interpret and understand handwritten input from various sources such as paper documents, touch displays, and photographs. Within the realm of pattern recognition, one specific area is handwritten text recognition, which involves categorizing and interpreting handwritten text. In this study, we propose a novel approach to offline handwritten text recognition utilizing deep neural networks. The availability of vast amounts of data and continuous algorithmic enhancements have made training neural networks more accessible than ever before. This handwritten character recognition system relies on image segmentation to accurately identify and interpret handwritten characters. Through this approach, we aim to improve the accuracy and efficiency of recognizing handwritten text across various applications and contexts.

OHSCR: Benchmarks Dataset for Offline Handwritten Sindhi Character Recognition

This research work presents a unique dataset for offline handwritten Sindhi character recognition. It has 7800 character images in total, divided into multiple categories by 150 writers of various ages, genders, and professional backgrounds. Each writer writes the 52 Sindhi characters in the designed form. With a high-quality scanner, all of the written samples were scanned. After that, all the handwritten Sindhi characters were cropped from the collected designed form, and the cropped images were saved in ‘.png’ format. For the benefit of the Sindhi research community, this work suggests an image dataset for character recognition in handwritten Sindhi. The dataset will be made publically available. For the Sindhi language, this dataset can be used to create and test handwritten character recognition systems and provide helpful insights through writer identification. The dataset has been divided into the training set and the test set, with 80% for training and 20% for testing. The different preprocessing techniques used to remove noise from scanned images to create a clean dataset. The dataset created as a result of this research is the world's first openly accessible dataset for handwritten research, and it can be useful for writer identification systems and handwriting recognition systems.

Assessing readability of the text in ancient paper fragments by a photometric statistical analysis

Ancient documents are important historical sources that are often found in a fragmented condition due to their conservation status. In this study, we examined fragments of paper found in 1996 during excavation of theSanti Quattro Coronaticomplex, in Rome. The archaeological site where the fragments were found is situated on the first floor of the tower within the complex. This location was used as a disposal pit approximately between the 15th and 16th centuries. The fragments exhibit text discoloration, hindering automatic recognition and human readability. To reveal the faded text, the fragments have been digitalized, converted into a perceptually uniform color space and the contrast has been enhanced. The photometric characteristics of the input and enhanced images have been statistically characterized, and the contrast enhancement assessed by a state-of-the-art metric. The statistical analysis of the text colour coordinates was carried out to develop supervised and unsupervised image segmentation, isolating the text.The results of the method show that it effectively identifies text regions within images, improving readability, even for faded text. It can be integrated into deep learning-based character recognition systems, facilitating the automatic analysis of historical handwritten documents.

Improved Artificial Neural Network Classification Model based Metaheuristic Optimization for Handwritten Character Recognition

This study addresses the concerns regarding the performance of Handwritten Character Recognition (HCR) systems, focusing on the classification stage. It is widely acknowledged that the development of the classification model significantly impacts the overall performance of HCR. The problems identified specifically pertain to the classification model, particularly in the context of the Artificial Neural Network (ANN) learning problem, leading to low accuracy in recognizing handwritten characters. The objective of this study is to improve and refine the ANN classification model to achieve better HCR. To achieve this goal, this study proposed a hybrid Flower Pollination Algorithm with Artificial Neural Network (FPA-ANN) classification model for HCR. The FPA is one of the metaheuristic approaches is utilized as an optimization technique to enhance the performance of ANN, particularly by optimizing the network training process of ANN. The experimentation phase involves using the National Institute of Standards and Technology (NIST) handwritten character database. Finally, the proposed FPA-ANN classification model is analysed based on generated confusion matrix and evaluated performance of the classification model in terms of precision, sensitivity, specificity, F-score and accuracy.

Interpreting Doctor Notes using Handwriting Recognition

Abstract: Handwriting recognition of medical prescriptions has been a challenging problem over the recent years with constant research in providing possible accurate solutions. Indecipherable handwritten prescription and inefficiency of Pharmacist to understand the medical prescription can lead to serious and harmful effect to the patients. Even in the recognition of handwriting, mainly doctors notes, they are very difficult for everyone to understand and it takes time for a person to analyse it. So, this idea mainly focused on interpreting doctor’s notes using handwritten recognition and deep learning techniques. The handwritten or printed document pictures are transformed into their electronic counterparts using an optical character recognition (OCR) system. Due to individuals' inconsistent writing styles, dealing with handwritten texts is significantly more difficult than dealing with printed ones. Handwritten text recognition could be done by Image processing, Machine Learning or Deep Learning Techniques. Out of these Deep Learning remains to be the most popular and prominent. Some of the Deep Learning techniques includes Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs). This gives a review of the various recognition methodologies used for interpreting handwritten texts. It includes the most important algorithms that could be used for detecting the handwritten word/text/character by using various approaches for the recognition process. In the end we are thus comparing the accuracies provided by these systems.

Adapting multilingual vision language transformers for low-resource Urdu optical character recognition (OCR).

In the realm of digitizing written content, the challenges posed by low-resource languages are noteworthy. These languages, often lacking in comprehensive linguistic resources, require specialized attention to develop robust systems for accurate optical character recognition (OCR). This article addresses the significance of focusing on such languages and introduces ViLanOCR, an innovative bilingual OCR system tailored for Urdu and English. Unlike existing systems, which struggle with the intricacies of low-resource languages, ViLanOCR leverages advanced multilingual transformer-based language models to achieve superior performances. The proposed approach is evaluated using the character error rate (CER) metric and achieves state-of-the-art results on the Urdu UHWR dataset, with a CER of 1.1%. The experimental results demonstrate the effectiveness of the proposed approach, surpassing state of the-art baselines in Urdu handwriting digitization.

Optical Character Recognition System in Healthcare and Hospital Management

The paper proposes a new Optical Character Recognition (OCR) model for medical documents. This model uses advanced machine learning and deep learning to improve the accuracy of extracting text from scanned medical images and various other documents. The goal is to make medical records more accessible and easier to manage electronically. The model can handle both English and multiple other languages, making it suitable for global healthcare use. It also explores adding Text-to-Speech functionality to convert the extracted text to audio, improving accessibility for users with visual impairments. By combining these features with insights from previous OCR and Text-to-Speech research, the model aims to streamline healthcare workflows and improve accessibility for everyone.

BNVGLENET: Hypercomplex Bangla handwriting character recognition with hierarchical class expansion using Convolutional Neural Networks

Object recognition technology has made significant strides where recognizing handwritten Bangla characters including symbols, compounds form, etc. remains a challenging problem due to the prevalence of cursive writing and many ambiguous characters. The complexity and variability of the Bangla script, and individual’s unique handwriting styles make it difficult to achieve satisfactory performance for practical applications, and the best existing recognizers are far less effective than those developed for English alpha-numeric characters. In comparison to other major languages, there are limited options for recognizing handwritten Bangla characters. This study has the potential to improve the accuracy and effectiveness of handwriting recognition systems for the Bengali language, which is spoken by over 200 million people worldwide. This paper aims to investigate the application of Convolutional Neural Networks (CNNs) for recognizing Bangla handwritten characters, with a particular focus on enlarging the recognized character classes. To achieve this, a novel challenging dataset for handwriting recognition is introduced, which is collected from numerous students’ handwriting from two institutions. A novel convolutional neural network-based approach called BNVGLENET is proposed in this paper to recognize Bangla handwritten characters by modifying the LeNet-5 and combining it with the VGG architecture, which has the advantage of significantly identifying the characters from Bengali handwriting. This study systematically evaluated the performance of models not only on custom novel dataset but also on the publicly available Bangla handwritten character dataset called the Grapheme dataset. This research achieved a state-of-the-art recognition accuracy of 98.2% on our custom testing vowel-consonant class and 97.5% on the custom individual class. The improvements achieved in this study bridge a notable disparity between the practical needs and the actual performance of Bangla handwritten character recognition systems.

Empowering Mathematics Education in Greek Primary Schools: Bridging the Divide through ICT Integration and Interactive Boards for Enhanced Teacher ICT Literacy

This article advocates for a tech-enriched teaching approach using Information and Communication Technologies (ICT) and interactive boards to enhance students’ understanding and problem-solving skills. Overcoming challenges requires systematic planning, progressive policies, dedicated funds, and regular teacher training. The essay also discusses the benefits and limitations of ICT, the key principles of interactive whiteboard application in pedagogy, and the dynamic challenges faced by Greek elementary schools in redesigning mathematics pedagogy with ICT. It proposes blending modern technologies with traditional instructions, emphasizing the need for continuous teacher development and a positive attitude toward technology. The way forward involves leveraging Optical Character Recognition (OCR) systems and interactive boards, necessitating strategic planning, training programs, and infrastructure investment for a tech-enriched teaching future in Greek primary schools.

HANDWRITTEN CHARACTER RECOGNITION IN ASSYRIAN LANGUAGE USING CONVOLUTIONAL NEURAL NETWORK

Academics and researchers worldwide have paid close attention to biometric handwriting recognition using deep learning as much research has been proposed to enhance biometric recognition in the past and in recent years. Several solutions for character recognition systems in various languages, including Chinese, English, Japanese, Arabic, and Kurdish have been developed. Unfortunately, there has been minimal growth in the Assyrian language. There is still little research on Assyrian handwriting. In this paper, a new Assyrian language dataset was created as part of the procedure by distributing 500 forms consisting of 36 Assyrian characters to people between the ages of 13 and 60 of both genders. The preprocessing operation includes cleaning the noisy data and segmenting each image to 224x224 pixels. This effort resulted in the collection of 18,000 images of these characters to be trained 70% and tested 30% in four CNN models, VGG16, VGG19, MobileNet-V2, and ResNet-50, over 30 epochs to give an accuracy rate of 90.97%, 92.06%, 95.70%, and 94.97%., respectively.

Reading between the Lines: Image-Based Order Detection in OCR for Chinese Historical Documents

Chinese historical documents, with their unique layouts and reading patterns, pose significant challenges for traditional Optical Character Recognition (OCR) systems. This paper introduces a tailored OCR system designed to address these complexities, particularly emphasizing the crucial aspect of Reading Order Detection(ROD). Our system operates through a threefold process: text detection using the Differential Binarization++ model, text recognition with the SVTR Net, and a novel ROD approach harnessing raw image features. This innovative method for ROD, inspired by human perception, utilizes visual cues present in raw images to deduce the inherent sequence of ancient texts. Preliminary results show promising reductions in page error rates. By preserving both content and context, our system contributes meaningfully to the accurate and contextual digitization of Chinese historical manuscripts.