Character Recognition Research Articles

Hierarchical Attention and Contextual Embedding for Robust Sarcasm Detection

Objective: The study aims to develop a technique for sarcasm detection in social media text to enrich the sentiment analysis. Methods: The methodology used in the present research is as follows: emotion-embedded vectors for capturing the emotional content of the text, dynamic contextual modulation for the adaption of the model to the given context, and Hierarchical attention mechanism for segmentation of the text at the different level of abstraction. Findings: Evaluation with the test set proved that the proposed model achieved accuracy rates 89% higher than the benchmark models. Including these several complicated methods helped achieve greater accuracy and F1 measures, contributing to sarcasm detection efficiency. Novelty: This approach ensures that vital sarcastic alerts are detected, providing a better text analysis and increasing sentiment analysis's accuracy and robustness. Keywords: Sarcasm detection, Sentiment analysis, Natural language processing, Deep learning, Opinion mining

An advanced spatial coregistration of cloud properties for the atmospheric Sentinel missions: application to TROPOMI

Abstract. The retrieval of cloud parameters from the atmospheric Sentinel missions requires Earth reflectance measurements from a set of spectral bands. The ground pixels of the involved spectral bands should be fully aligned, but when they are not, special treatment is required within the operational algorithms. This so-called inter-band spatial misregistration of passive spectrometers is present when the Earth reflectance measurements in different spectral bands are captured by different spectrometers. The cloud retrieval algorithm requires reflectance measurements in the UV(ultraviolet)–VIS (visible) band, where the first cloud parameter (i.e., radiometric cloud fraction) is retrieved from OCRA (Optical Cloud Recognition Algorithm). In addition, Earth reflectances in the NIR (near-infrared) band are needed for the retrieval of two additional cloud parameters (i.e., cloud height and cloud albedo or cloud-top height and optical thickness) from the ROCINN (Retrieval of Cloud Information using Neural Networks) algorithm. In the former TROPOMI (TROPOspheric Monitoring Instrument)/S5P (Sentinel-5 Precursor) retrieval, a coregistration scheme of the derived cloud parameters from the source band to the target band based on pre-calculated mapping weights from UV–VIS to NIR and vice versa is applied. In this paper we present a new scheme for the coregistration of the TROPOMI cloud parameters using collocated VIIRS (Visible Infrared Imaging Radiometer Suite)/SNPP (Suomi National Polar-orbiting Partnership) information. The new coregistration scheme based on the VIIRS data improves the TROPOMI cloud product quality and allows the addition of cloud information for the first (westernmost) TROPOMI UVIS ground pixel. In practice, the latter means that a significant number of valid data points are included in the TROPOMI cloud, total ozone, SO2 and HCHO product since 26 November 2023 (orbit 31705), when the new coregistration scheme became operational. From a comparison analysis between the two techniques, we found that the largest differences mainly appear for inhomogeneous scenes. From a validation exercise of TROPOMI against VIIRS in the across-track direction, we found that the old coregistration scheme tends to smooth out cloud structures along the scan line, whereas such structures can be maintained with the new scheme. The need to implement a similar inter-band spatial coregistration scheme is foreseen for the Sentinel-4/MTG-S (Meteosat Third Generation – Sounder) and Sentinel-5/MetOp-SG (Meteorological Operational Satellite – Second Generation) missions. In the case of the Sentinel-4 instrument, the external cloud information will originate from collocated data captured by the FCI (Flexible Combined Imager) on board the MTG-I (Meteosat Third Generation – Imager) satellite.

Ancient Yi Script Handwriting Sample Repository

The ancient Yi script has been used for over 8000 years, which can be ranked with Oracle,Sumerian,Egyptian,Mayan and Harappan,and is one of the six ancient scripts in the world. In this article, we collected 2922 handwritten single word samples of commonly used ancient Yi characters. Each character was written by 310 people respectively, with a total of 427,939 valid characters. We completed continuous handwritten text sampling, written by 250 people, with 5 texts per person, covering topics such as Yi astronomy, geography, rituals, and agriculture. In the process of data collection, we proposed an automatic sampling method for ancient Yi script, and completed the automatic cutting and labeling of handwritten samples. Furthermore, we tested the recognition performance of the sorted data set under different deep learning network models. The results show that ancient Yi script has diverse shape structures and rich writing styles, which can be used as a benchmark data set in related fields such as handwritten text recognition and handwritten text generation.

Exploring Twitter discourse with BERTopic: topic modeling of tweets related to the major German parties during the 2021 German federal election

AbstractWe present a study in the context of computational social science that explores the topics debated in the context of the 2021 German Federal Election by using the topic modeling technique BERTopic. The corpus consists of German language tweets posted by political party accounts of the major German parties, as well as tweets by the general public mentioning the party accounts. We examined the textual content of the tweets but also included the text in images that were posted into the analysis by extracting the text using optical character recognition (OCR). Our results show that the most frequently discussed topics are party-oriented policies (including call-to-action content), climate policy and financial policy, with these topics being discussed in tweets by both, the political party accounts and tweets by accounts mentioning them. In addition, we observed that some topics were discussed consistently throughout the year, such as the COVID-19 pandemic, climate policy or digitization, while other topics, such as the return to power of the Taliban in Afghanistan or Israel were debated to a greater extent at limited time frames during the election year.

Application of Deep Learning and Optical Character Recognition Technology to Automate Classification and Database of Borehole Log for Ground Stability Investigation of Abandoned Mines

Application of Deep Learning and Optical Character Recognition Technology to Automate Classification and Database of Borehole Log for Ground Stability Investigation of Abandoned Mines

Improving Offline Gurmukhi Character Recognition: A Comparative Study of Feature Selection Techniques

Improving Offline Gurmukhi Character Recognition: A Comparative Study of Feature Selection Techniques

Integrating path signature and pen-tip trajectory features for online handwriting Yi text recognition

Recognizing online handwriting Yi text is crucial for recording and preserving Yi literature. However, the scarcity of online handwriting Yi text datasets has limited relevant research, impeding the process of Yi informatization. In this work, we use synthetic data to train models, and an Online Handwriting Yi Text Recognition Network (YTRN) is proposed, which extracts robust character features to address the gap between synthetic and real data. YTRN adeptly learns the spatial structure features from path signature feature maps and captures trajectory features from the pen-tip trajectories. Subsequently, an innovative adaptive feature fusion module integrates these two sets of features to yield more comprehensive and robust character representations. Experiments on our newly collected Yi-OLHWDB2.0 dataset demonstrate that our method outperforms previous approaches, achieving an impressive 95.67% accuracy. This highlights the model’s effectiveness in extracting comprehensive and robust features from path signature maps and pen-tip trajectories, significantly enhancing recognition accuracy and generalization.

Artificial Intelligence Approach to Business Process Re-Engineering the Information Flow of Warehouse Shipping Orders: An Italian Case Study

Artificial intelligence is revolutionizing and significantly shaping the work environment. It not only presents an innovative and unique challenge, but it also creates numerous opportunities in various sectors. This study aims to examine a case of artificial intelligence use in the logistics sector, specifically the implementation of text recognition algorithms that use advanced artificial intelligence technology to perform tasks and activities typically carried out by human operators. The implementation under analysis was carried out at an Italian company in Tolentino, in the province of Macerata. The implementation of this tool focuses on the ability to autonomously read shipping notes, with the aim of simplifying the flow of information in the goods receipt phase and reducing the workload of warehouse staff. As illustrated in the following chapters, when artificial intelligence follows several trainings, technical improvements and structural changes in shipping notes, the flow is greatly simplified, significantly facilitating this logistics phase.

Impact of Machine Learning Integration in Qur’anic Studies

The advancement in the field of computer science, especially in machine learning (ML), represents a flourishing innovation that carries great importance in the domain of education. The beneficial impact of ML can also be observed in the realm of Qur’anic studies, particularly in Arabic text recognition and recitation analysis. This paper presents a comprehensive analysis of 34+ published scholarly articles devoted to Qur’anic studies. This work explores the convergence of machine learning methodologies and Qur’anic studies, examining the innovative applications and methodologies for Arabic text and voice classification. The fusion of ML algorithms makes the work easy and accurate to analyze, interpret, and extract valuable insights from the sacred text. Subsequently, we delve deeper into the emergent field of ML algorithms like k-NN, ANN, BLSTM, MFCC, SVM, NB and DL approaches have been adapted for Qur’anic texts classification, recitation and recitation analysis on accuracy, speed, class recognition, response rate and biasness benchmark. This work covers a diverse range of applications, including automated Qur’anic exegesis and analysis of usage of Ahkam Al-Tajweed. The main contribution of the work is to provide insight into how ML facilitates in Arabic and Kufic textual analysis, linguistic subtleties, and thematic structures of the Qur’anic text. Using the deep learning approaches, the reciters, recitation style and of the Quranic text has also explained in the work.

A robust solution for recognizing accurate handwritten text extraction using quantum convolutional neural network and transformer models

Handwritten text extraction from images is challenging due to the variability of styles in handwriting, quality of images, and noise backgrounds. Existing methods often struggle to achieve high accuracy, hindering document analysis, optical character recognition, and data entry applications. We propose a novel approach to improve extraction accuracy, combining Quantum convolutional neural networks (QCNN) and transformer-based neural networks (TextExtractNet) named QTEN. Our method leverages the strengths of both models to recognize and extract handwritten text from images. Experimental results show that our approach achieves a 96 % accuracy rate, outperforming existing methods. This breakthrough has significant implications for automating document processing, data entry, and related applications. Our method's robustness and accuracy make it a valuable tool for industries relying on handwritten document processing, such as healthcare, finance, and government.

Research on automatic segmentation and recognition of single characters in original rubbings based on intelligent recognition of oracle bone inscriptions

This paper proposes an effective segmentation and recognition method using YOLOv8 to solve the problem of segmentation and recognition of Oracle rubbings images. Draw sub-pixel edge contours through spot detection, corner detection, and edge detection (such as Canny and Sobel), and combine grayscale, opening operations, binarization, and Gaussian filtering to remove noise and repair contours, extract image features, and establish preprocessing Model. Use this model to preprocess the original oracle rubbing image and train it based on YOLOv8. The results show that this method can effectively segment and identify oracle bones characters.

Faster extraction of matrimonial advertisements from digital archives using a signal processing pipeline: a case study on a 20th-Century Spanish newspaper

ABSTRACT With the exponential growth of digitized historical materials, historians and social scientists face the daunting task of navigating vast online collections. While online archives do provide search tools to query their materials, these usually do not meet the scholars’ need to trace and store all relevant materials from the online archive. This case study shows how computer vision methods, and more specifically a signal processing approach, can be used to identify, classify and extract relevant information items from a vast historical data collection. More specifically, this study reports the results of the construction of a data pipeline that extracts matrimonial advertisements from the digitized Catalan newspaper La Vanguardia. Matrimonial advertisements can provide genuine insights into the evolution of partner preferences over time, but they are hard to collect as they are scattered over millions of digitized historical newspapers and magazines. Moreover, to study variation in partner preferences by, for example, sex, social class, matrimonial status and time period, it is necessary to store the data into a database. The pipeline that we have constructed extracts matrimonial advertisements in a stepwise fashion, encompassing identification, through binarisation and segmentation, and classification based on Optical Character Recognition. By ways of a comprehensive evaluation, both qualitatively and quantitatively, the efficacy of the pipeline for the extraction of matrimonial advertisements is demonstrated. The findings not only underscore the viability of the signal processing approach but also underscore its potential for advancing research in historical demography, family history, as well as economic history, as similar pipelines can be set up to extract other relevant newspaper items, such as, marriage, birth, death and moving announcements, job vacancies or business announcements from digitized source collections.

Metode Pengumpulan Data Debit Air Pada Saluran Distribusi Air PDAM Makassar Berbasis IoT

Water is an important resource for human survival as well as various economic sectors. PDAM is responsible for providing water supply to the community. One of the major challenges faced in managing water supply is the problem of water loss or leakage. This research aims to overcome this problem by designing an innovative method to collect water discharge data on the distribution channel of PDAM Makassar using Internet of Things (IoT) technology. This method uses the ESP32-CAM to take images of the water meter on the main pipe and save it to a database. Optical Character Recognition (OCR) technology is used to convert the image into text that can be processed. The test results show that the average error in meter readings is 0.215% with an average accuracy rate of 98%. Overall the system works well in reading digital meters and is reliable in monitoring water consumption visually and in real-time. Thus, this method can be an effective solution in detecting water leaks and improving the efficiency of water supply management by PDAMs, as well as saving resources and operational costs.

Research on the detection and recognition system of target vehicles based on fusion algorithm

<p>In modern society, the monitoring of vehicles is paramount for upholding traffic safety and order. This paper delves into a Graphical User Interface (GUI)-driven system for vehicle target detection and integration. This system seamlessly integrates three pivotal functionalities: vehicle type recognition, license plate recognition, and driver face recognition. It automates the vehicle inspection assessment process through an intuitive user interface. Specifically, for license plate recognition, the system leverages traditional computer vision techniques, including color and grayscale processing, radon transform, morphological operations, edge detection, character segmentation, and character recognition. The driver face recognition module incorporates methods such as image gray scaling, Gaussian filtering for denoising, face detection, and feature extraction. Meanwhile, vehicle type recognition is achieved by extracting Histogram of Oriented Gradients (HOG) features and utilizing a Support Vector Machine (SVM) classifier. Experimental findings highlight the system’s remarkable recognition accuracy, offering a highly efficient and dependable solution for the automated inspections of vehicles.</p>

Tropospheric NO2 retrieval algorithm for geostationary satellite instruments: applications to GEMS

Abstract. In this study, we develop an advanced retrieval algorithm for tropospheric nitrogen dioxide (NO2) from the geostationary satellite instruments and apply it to Geostationary Environment Monitoring Spectrometer (GEMS) observations. Overall, the algorithm follows previous heritage for the polar-orbiting satellites Global Ozone Monitoring Experiment-2 (GOME-2) and Tropospheric Monitoring Instrument (TROPOMI), but several improvements are implemented to account for specific features of geostationary satellites. The DLR GEMS NO2 retrieval employs an extended fitting window compared to the current fitting window used in GEMS operational v2.0 NO2 retrieval, which results in improved spectral fit quality and lower uncertainties. For the stratosphere–troposphere separation in GEMS measurements, two methods are developed and evaluated: (1) STRatospheric Estimation Algorithm from Mainz (STREAM) as used in the DLR TROPOMI NO2 retrieval and adapted to GEMS and (2) estimation of stratospheric NO2 columns from the Copernicus Atmosphere Monitoring Service (CAMS) Integrated Forecast System (IFS) cycle 48R1 model data, which introduce full stratospheric chemistry as it will be used in the operational Sentinel-4 NO2 retrieval. While STREAM provides hourly estimates of stratospheric NO2, it has limitations in describing small-scale variations and exhibits systematic biases near the boundary of the field of view. In this respect, the use of estimated stratospheric NO2 columns from the CAMS forecast model profile demonstrates better applicability by describing not only diurnal variation but also small-scale variations. For the improved air mass factor (AMF) calculation, sensitivity tests are performed using different input data. In our algorithm, cloud fractions retrieved from the Optical Cloud Recognition Algorithm (OCRA) adapted to GEMS level 1 data are applied instead of the GEMS v2.0 cloud fraction. OCRA is used operationally in TROPOMI and Sentinel-4. Compared to the GEMS level 2 cloud fraction which is typically set to around 0.1 for clear-sky scenes, OCRA sets cloud fractions close to or at 0. The OCRA-based cloud corrections result in increased tropospheric AMFs and decreased tropospheric NO2 vertical columns, leading to better agreement with results from existing TROPOMI observations. The effects of surface albedo on GEMS tropospheric NO2 retrievals are assessed by comparing the GEMS v2.0 background surface reflectance (BSR) and TROPOMI Lambertian-equivalent reflectivity (LER) climatology v2.0 product. The differences between the two surface albedo products and their impact on tropospheric AMF are particularly pronounced over snow/ice scenes during winter. A priori NO2 profiles from the CAMS forecast model, applied in the DLR GEMS algorithm, effectively capture variations in NO2 concentrations throughout the day with high spatial resolution and the advanced chemical mechanism, which demonstrates its suitability for geostationary satellite measurements. The retrieved DLR GEMS tropospheric NO2 columns show good capability for capturing hotspot signals at the scale of city clusters and describe spatial gradients from city centres to surrounding areas. Diurnal variations of tropospheric NO2 columns over Asia are well described through hourly sampling of GEMS. Evaluation of DLR GEMS tropospheric NO2 columns against TROPOMI v2.4 and GEMS v2.0 operational products shows overall good agreement. The uncertainty of DLR GEMS tropospheric NO2 vertical columns varies based on observation scenarios. In regions with low pollution levels such as open-ocean and remote rural areas, retrieval uncertainties typically range from 10 % to 50 %, primarily due to uncertainties in slant columns. For heavily polluted regions, uncertainties in tropospheric NO2 columns are mainly driven by errors in tropospheric AMF calculations. Notably, the total uncertainty in GEMS tropospheric NO2 columns is most significant in winter, particularly over heavily polluted regions with low-level clouds below or near the NO2 peak.

Full Page Handwriting Recognition on CUDA enabled Docker

-Handwritten text recognition is essential for document digitization but often struggles with multiline content. This paper presents an integrated approach using TrOCR, a pre-trained Transformer model, combined with PaddleOCR for enhanced text detection. The integration, optimized with GPU acceleration and multi-threading within a CUDA-enabled Docker environment, addresses the challenges of full-page handwriting recognition. A user-friendly Flask API with a Gradio demo was developed for deployment. Experimental results demonstrate that the system significantly improves the accuracy of multiline text recognition, outperforming existing models. This approach offers a scalable, efficient solution for accurate handwriting recognition in complex document layouts, advancing the field of document digitization.

The Importance of Digital Records for Scientific Research Work in Archives (with Special Reference to the Archives of the Tuzla Canton)

Digital material holds particular significance for scientific research in archives. Digitization of archival material enables researchers worldwide to access archival material without the need to physically visit the archives. Digital material allows for faster searching and identification of relevant information in archival holdings and collections through keywords, metadata, or even text recognition technologies. This facilitates researchersʾ efficient access to the information they need for their work. Digital material enables the sharing of archival material with other researchers or institutions, fostering collaboration and knowledge exchange. Through digital platforms, researchers can easily access, review, and utilize archival material in their research. In short, digital material transforms the way archival material is accessed and used in scientific research, enabling broader availability, better searchability, more efficient analysis, and greater collaboration among researchers. This contributes to the advancement of scientific research and the preservation of cultural heritage. The author will try to point out the importance of digital records for scientific and research work in archives, with special reference to the Archives of the Tuzla Canton. Data on the number of researchers who used the archives’ services for scientific research purposes for the period 2020-2023 will be presented and with all the difficulties the researchers encountered. Also, based on the survey, we will present data on researchers from other archives in Bosnia and Herzegovina, who used digital records in their research, in order to be able to compare the scientific-research component in the archives of Bosnia and Herzegovina.

An Approach to Checking Map Tiles by Annotation Recognition

Abstract. As the capabilities of geographic information services increase, web geographic information services represented by internet mapping have become increasingly popular, widely used in various location-based services. It is precisely because of the surge in demand that higher requirements have been put forward for the updating and quality control of internet map data. The quality inspection of geographic vector data is relatively well-developed, with many inspection rules and automated processes, but there is a clear deficiency in the quality inspection of map tiles, which mainly relies on manual visual inspection, restricting the rapid updating and release of map tiles. To solve this problem, this paper proposes an automated map tile inspection method. First, web crawling technology is used to capture map tiles, and to avoid the problem of incomplete display of annotations across tiles, adjacent tiles are all captured and merged into one image; second, OCR technology is used for image text detection and text recognition, and finally, the newly added recognition results are stored in the database and compared and confirmed with the results in the database. The experiment proves that the method proposed in this paper is feasible and may greatly improve work efficiency, especially as the updating speed of online maps accelerates, an automated tile quality inspection method can greatly improve the updating speed.

DPNet: Scene text detection based on dual perspective CNN-transformer.

With the continuous advancement of deep learning, research in scene text detection has evolved significantly. However, complex backgrounds and various text forms complicate the task of detecting text from images. CNN is a deep learning algorithm that automatically extracts features through convolution operation. In the task of scene text detection, it can capture local text features in images, but it lacks global attributes. In recent years, inspired by the application of transformers in the field of computer vision, it can capture the global information of images and describe them intuitively. Therefore, this paper proposes scene text detection based on dual perspective CNN-transformer. The channel enhanced self-attention module (CESAM) and spatial enhanced self-attention module (SESAM) proposed in this paper are integrated into the traditional ResNet backbone network. This integration effectively facilitates the learning of global contextual information and positional relationships of text, thereby alleviating the challenge of detecting small target text. Furthermore, this paper introduces a feature decoder designed to refine the effective text information within the feature map and enhance the perception of detailed information. Experiments show that the method proposed in this paper significantly improves the robustness of the model for different types of text detection. Compared to the baseline, it achieves performance improvements of 2.51% (83.81 vs. 81.3) on the Total-Text dataset, 1.87% (86.07 vs. 84.2) on the ICDAR 2015 dataset, and 3.63% (86.72 vs. 83.09) on the MSRA-TD500 dataset, while also demonstrating better visual effects.

Urban-Rural Disparities in Community Participation after Spinal Cord Injury in Ontario.

Personal, social, and environmental factors may influence self-efficacy and social reintegration among people living with spinal cord injury or disease (SCI/D) in urban and rural areas. Novel data collection methods have the potential to characterize community participation (CP) in diverse settings. The objectives were (1) to describe and compare self-reported community participation (Reintegration to Normal Living Index (RNLI) and Moorong Self-Efficacy Scale (MSES)) levels of individuals with SCI/D living in urban or rural Ontario, Canada; and (2) to determine the accuracy of an artificial intelligence (AI) optical mark recognition tool for extracting data from CP surveys conducted among participants after transitioning from inpatient rehabilitation to home and residing in the community. We partnered with SCI Ontario staff to collect MSES and RNLI survey data from adults with motor complete (e.g., AIS A-B) and incomplete (AIS C-D) SCI/D living in urban or rural Ontario, Canada, between January and October 2022. The Rurality Index of Ontario (RIO) from the postal code determined urban or rural residency. Optical mark recognition (OMR) software was used for survey data extraction. A Research Associate validated the extracted survey responses. Descriptive statistics, correlation analysis, and non-parametric statistics were used to describe the participants, their impairments, and their reported CP levels across urban and rural settings. Eighty-five individuals with SCI/D (mean age 53.7 years, 36.5% female) completed the survey. Most of the participants resided in major urban areas (69.4%) and had traumatic injuries (64.7%). The mean total MSES score for Ontarians with SCI/D was 87.96 (95% confidence interval [CI]: 84.45, 91.47), while the mean total RNLI score for the same individuals was 75.61 (95% CI: 71.85, 79.37). Among the MSES domains, the lowest score was observed in response to sexual satisfaction (mean: 4.012, 95% CI: 3.527, 4.497), while the lowest RNLI domain item score was associated with the ability to travel out of town (mean: 5.965, 95% CI: 5.252, 6.678). Individuals with incomplete injuries in rural areas reported lower MSES and RNLI scores than those with complete motor injuries, whereas no significant differences were found in MSES and RNLI scores among urban residents based on impairment. These findings suggest that, depending on the environmental context (e.g., rural vs. urban areas), AIS categories may influence the perception of CP among people living with SCI/D. The OMR tool had 97.4% accuracy in extracting data from the surveys. The CP (MSES and RNLI) scores reported by individuals with SCI/D differ based on their living setting. In rural Ontario, individuals with greater functional ability reported lower CP than their counterparts living in urban settings. Although CP remains a challenge, the needs of individuals with motor incomplete SCI/D and heterogeneous levels of mobility residing in rural areas require exploration and targeted interventions. The OMR tool facilitates accurate data extraction from surveys across settings.