Sign Recognition Research Articles

Securing AI Models Against Backdoor Attacks: A Novel Approach Using Image Steganography

<p>Artificial Intelligence (AI) has become ubiquitous, transforming numerous domains including traffic sign recognition, defect detection, and healthcare. However, this widespread adoption has brought about significant cybersecurity challenges, particularly in the form of backdoor attacks, which manipulate training datasets to compromise model integrity. While the integration of AI has proven beneficial, there is a lack of comprehensive strategies to protect AI models from these covert attacks, necessitating innovative approaches for securing AI systems. In this study, we demonstrate a novel methodology that integrates image steganography with deep learning techniques, aiming to obscure backdoor triggers and enhance the resilience of AI models against these attacks. We employ a diverse set of AI models and conduct extensive evaluations in a traffic sign recognition scenario, specifically targeting the STOP sign. The results reveal that shallow models are challenged in learning trigger information and are sensitive to trigger settings, while deeper models achieve an impressive 98.03% attack success rate. The image steganography technique used requires minimal data adjustments, making the triggers more challenging to detect than with traditional methods. Our findings underscore the stealth and severity of backdoor attacks, emphasizing the need for advanced security measures in AI and contributing to the broader understanding and development of robust protections against such attacks.</p> <p> </p>

Enhancing Arabic Sign Language Recognition using Deep Learning

The present time, Sign language is very important for people who suffer from hearing loss or who cannot speak. Normal humans tend to disregard the significance of signal language, which is a mere supply of communique to mute and deaf societies. So, this study proposes a developed model for sign Language Recognition for Arabic using the Deep learning Convolutional Neural Network (CNN) algorithm. Then set the algorithm by developing programming on Open-CV, using Python language. The dataset contains 54049 snapshots of Arabic signal language alphabets. The 32 folders were created, and each one of them included 1500 images incorporating hand gestures in at-variance environments. The data set was divided into a training section with a percentage of 70 %, a section for testing with a percentage of 20 %, and a section for validation with a percentage of 10 %. The results show that the suggested model achieved an accuracy rate of 94.8%, and it has proven its effectiveness and success, especially after being tried and tested by several users and obtaining their comments and feedback.

Sign Language Recognition using CNN

Abstract: The sign language Recognition System is a technology that bridges the gap between the deaf people and the hearing world. Sign language is a vital mode of expression for deaf people, yet effective communication remains a challenge. This project aims to develop a robust Sign Language Recognition System capable of accurately translating sign language gestures into text. The system utilizes a deep learning approach, specifically convolutional neural networks (CNNs) to analyze video input of sign language and then generate the corresponding output. The project involves data collection, pre-processing, segmentation, feature extraction, model training, and evaluation. The proposed SLR system has the potential to enhance. Communication and accessibility for deaf individuals, promoting inclusivity and improving their quality of life. The project represents a comprehensive exploration of both technical and ethical aspects in the realm of computer vision and deep learning applications.

A unified approach for continuous sign language recognition and translation

A unified approach for continuous sign language recognition and translation

All Country Sign Language Recognition System to Help Deaf and Mute People

With the use of contemporary technology, the "All Country Sign Language Recognition System to Help Deaf and Mute People" project seeks to provide a strong solution that will close communication barriers between the deaf and mute population and the general public. The project aims to use machine learning techniques and computer vision techniques to properly understand and convert sign language motions into generally used languages, with a concentration on Indian sign language. Deaf and mute people will benefit from increased accessibility and inclusion in a variety of spheres of everyday life, including social interactions, work, and education, by virtue of the implementation of this system. The initiative helps to create a more inclusive society in addition to addressing the urgent demand for efficient communication tools for the deaf and mute communities.In this people can interact using different country sign languages like ISL, ASL, BSL, etc.

Research on Road Sign Recognition Method for Autonomous Vehicles Based on Convolutional Neural Networks

With the rapid development of autonomous driving technology, road sign recognition has become an important link to ensure the safety of autonomous vehicles. This paper proposes a road sign recognition method for autonomous vehicles based on Convolutional Neural Networks (CNN), aiming to improve the accuracy and efficiency of road sign recognition by using CNN. Firstly, the background and significance of this issue were introduced, including the development of autonomous vehicles and their demand for road sign recognition technology. The focus was on the application of convolutional neural networks in road sign recognition. This article provides a detailed introduction to the dataset used, the designed convolutional neural network model, and data preprocessing methods. In order to further improve accuracy, methods such as data augmentation and image enhancement were adopted. The research results of this paper indicate that the road sign recognition method for autonomous vehicles based on convolutional neural networks has high accuracy and efficiency, providing important support for the practical application of autonomous driving technology.

Распознавание дорожных знаков российского образца с использованием нейронных сетей

The problem of creating a model for recognizing objects in images and possible ways to solve it is considered using the example of working with Russian road signs according to ISS R 52290-2004. The analysis of methods for constructing predictive models of image recognition and existing solutions in the public domain is carried out. A convolutional neural network is used as the basic model. A road sign recognition model based on the YOLOv7 transfer network has been developed as a result of training on a dataset from the Russian RTSD road sign image database. The metrics for evaluating the quality of the created model are analyzed and described. The created model meets the quality requirements for objective metrics, allows you to make forecasts taking into account specific situations in different weather conditions and at different times of the day for 146 different predefined classes. The characteristic of the class is the number of the sign according to ISS R 52290-2004. The model has a prediction accuracy of 0.847 with a prediction completeness of 0.811. The average average prediction accuracy of the model is 0.884 when tested on 493 images from the test sample. The test sample does not overlap with the training sample, which consists of 1,842 images. The developed model is published in the public domain both for use for scientific purposes and for further further education. This provides an opportunity for researchers in this field to familiarize themselves with a practical example of the implementation of the model, to supplement or improve it if necessary. The method described in this paper will allow researchers in various subject areas to find a solution that allows them to overcome resource constraints when creating a high-performance and high-quality predictive recognition model.

Sign Language Detection using ML Technologies

Sign language recognition is a leap forward for helping deaf-mute people. In sign language, every sign has a meaning assigned to it, so that it becomes easy to understand and interpret by the people. The main primary objective of our project is to bridge the gap between the deaf and dumb people and ordinary people without the need of an intermediary translator. Gesture recognition is a computer based visual technique used to detect and identify the object in an image or video. An application of this gesture recognition technique involves translating the sign language into the American language which can be further understood and interpreted by normal people. Many researchers have proposed their systems for the implementation of the ASL system. This report is a review of some studies related to the same topic. We addressed different approaches that used Convolutional Neural Networks (CNNs), K- Nearest Neighbours algorithm (KNN), Edge detection algorithm, Deep Neural Network (DNN), fuzzy clustering machine learning algorithm, Kernelized correlation filters (KCF) algorithm along with their results and drawbacks. Furthermore, we report on research gaps while summarizing these studies. From the above research papers, we got an average accuracy of 90.24%. To overcome the drawbacks, we propose a system which collects images for deep learning using webcam and OpenCV, with the help of TensorFlow Object Detection and Python that allows you to translate sign language in real time

Multiscale temporal network for continuous sign language recognition

Multiscale temporal network for continuous sign language recognition

Progressive Pulmonary Fibrosis and Interstitial Lung Abnormalities: AJR Expert Panel Narrative Review.

Progressive pulmonary fibrosis (PPF) and interstitial lung abnormalities (ILA) are relatively new concepts in interstitial lung disease (ILD) imaging and clinical management. Recognition of signs of PPF, as well as identification and classification of ILA, are important tasks during chest high-resolution CT interpretation, to optimize management of patients with ILD and those at risk of developing ILD. However, following professional society guidance, the role of imaging surveillance remains unclear in stable patients with ILD, asymptomatic patients with ILA who are at risk of progression, and asymptomatic patients at risk of developing ILD without imaging abnormalities. In this AJR Expert Panel Narrative Review, we summarize the current knowledge regarding PPF and ILA and describe the range of clinical practice with respect to imaging patients with ILD, those with ILA, and those at risk of developing ILD. In addition, we offer suggestions to help guide surveillance imaging in areas with an absence of published guidelines, where such decisions are currently driven primarily by local pulmonologists' preference.

Cognitive Classifier of Hand Gesture Images for Automated Sign Language Recognition: Soft Robot Assistance Based on Neutrosophic Markov Chain Paradigm

In recent years, Sign Language Recognition (SLR) has become an additional topic of discussion in the human–computer interface (HCI) field. The most significant difficulty confronting SLR recognition is finding algorithms that will scale effectively with a growing vocabulary size and a limited supply of training data for signer-independent applications. Due to its sensitivity to shape information, automated SLR based on hidden Markov models (HMMs) cannot characterize the confusing distributions of the observations in gesture features with sufficiently precise parameters. In order to simulate uncertainty in hypothesis spaces, many scholars provide an extension of the HMMs, utilizing higher-order fuzzy sets to generate interval-type-2 fuzzy HMMs. This expansion is helpful because it brings the uncertainty and fuzziness of conventional HMM mapping under control. The neutrosophic sets are used in this work to deal with indeterminacy in a practical SLR setting. Existing interval-type-2 fuzzy HMMs cannot consider uncertain information that includes indeterminacy. However, the neutrosophic hidden Markov model successfully identifies the best route between states when there is vagueness. This expansion is helpful because it brings the uncertainty and fuzziness of conventional HMM mapping under control. The neutrosophic three membership functions (truth, indeterminate, and falsity grades) provide more layers of autonomy for assessing HMM’s uncertainty. This approach could be helpful for an extensive vocabulary and hence seeks to solve the scalability issue. In addition, it may function independently of the signer, without needing data gloves or any other input devices. The experimental results demonstrate that the neutrosophic HMM is nearly as computationally difficult as the fuzzy HMM but has a similar performance and is more robust to gesture variations.

Multi-Stream Isolated Sign Language Recognition Based on Finger Features Derived from Pose Data

This study introduces an innovative multichannel approach that focuses on the features and configurations of fingers in isolated sign language recognition. The foundation of this approach is based on three different types of data, derived from finger pose data obtained using MediaPipe and processed in separate channels. Using these multichannel data, we trained the proposed MultiChannel-MobileNetV2 model to provide a detailed analysis of finger movements. In our study, we first subject the features extracted from all trained models to dimensionality reduction using Principal Component Analysis. Subsequently, we combine these processed features for classification using a Support Vector Machine. Furthermore, our proposed method includes processing body and facial information using MobileNetV2. Our final proposed sign language recognition method has achieved remarkable accuracy rates of 97.15%, 95.13%, 99.78%, and 95.37% on the BosphorusSign22k-general, BosphorusSign22k, LSA64, and GSL datasets, respectively. These results underscore the generalizability and adaptability of the proposed method, proving its competitive edge over existing studies in the literature.

Pediatric Ischemic Stroke: Clinical and Paraclinical Manifestations—Algorithms for Diagnosis and Treatment

Childhood stroke can lead to lifelong disability. Developing algorithms for timely recognition of clinical and paraclinical signs is crucial to ensure prompt stroke diagnosis and minimize decision-making time. This study aimed to characterize clinical and paraclinical symptoms of childhood and neonatal stroke as relevant diagnostic criteria encountered in clinical practice, in order to develop algorithms for prompt stroke diagnosis. The analysis included data from 402 pediatric case histories from 2010 to 2016 and 108 prospective stroke cases from 2017 to 2020. Stroke cases were predominantly diagnosed in newborns, with 362 (71%, 95% CI 68.99–73.01) cases occurring within the first 28 days of birth, and 148 (29%, 95% CI 26.99–31.01) cases occurring after 28 days. The findings of the study enable the development of algorithms for timely stroke recognition, facilitating the selection of optimal treatment options for newborns and children of various age groups. Logistic regression serves as the basis for deriving these algorithms, aiming to initiate early treatment and reduce lifelong morbidity and mortality in children. The study outcomes include the formulation of algorithms for timely recognition of newborn stroke, with plans to adopt these algorithms and train a fuzzy classifier-based diagnostic model using machine learning techniques for efficient stroke recognition.

Deep learning-based path tracking control using lane detection and traffic sign detection for autonomous driving

Automated vehicles are a significant advancement in transportation technique, which provides safe, sustainable, and reliable transport. Lane detection, maneuver forecasting, and traffic sign recognition are the fundamentals of automated vehicles. Hence, this research focuses on developing a dynamic real-time decision-making system to obtain an effective driving experience in autonomous vehicles with the advancement of deep learning techniques. The deep learning classifier such as deep convolutional neural network (Deep CNN), SegNet and are utilized in this research for traffic signal detection, road segmentation, and lane detection. The main highlight of the research relies on the proposed Finch Hunt optimization, which involves the hyperparameter tuning of a deep learning classifier. The proposed real-time decision-making system achieves 97.44% accuracy, 97.56% of sensitivity, and 97.83% of specificity. Further, the proposed segmentation model achieves the highest clustering accuracy with 90.37% and the proposed lane detection model attains the lowest mean absolute error, mean square error, and root mean error of 17.76%, 11.32%, and 5.66% respectively. The proposed road segmentation model exceeds all the competent models in terms of clustering accuracy. Finally, the proposed model provides a better output for lane detection with minimum error, when compared with the existing model.

INDIAN SIGN LANGUAGE RECOGNITION USING CNN WITH SPATIAL PYRAMID AND GLOBAL AVERAGE POOLING

Sign language recognition plays a pivotal role in bridging communication gaps for the speech and hearing-impaired community. In this research, we present an innovative approach to enhance the accuracy and effectiveness of Indian sign language recognition through the integration of convolutional neural networks with spatial pyramid and global average pooling layers. The objective of this study is to address the intricate challenges by exploiting multi-scale feature representations and global context information. This architecture incorporates spatial pyramid layer to capture fine-grained spatial information across multiple scales. Additionally, global average pooling layer is introduced to consolidate context-aware features, further improving the model's discriminative power. Experiments are conducted using a standard dataset, encompassing a diverse range of gestures. The results demonstrate a significant improvement in recognition accuracy compared to conventional models. Incorporating spatial pyramid and global average pooling layers enables our model to effectively recognize the gestures, even in challenging scenarios with variations in lighting, complex background, and signer-dependent factors by achieving high accuracy. This research not only contributes to the advancement of ISL recognition technology but also holds promise for practical applications in real-world communication and assistive technologies.

Enhancing Communication through Automated Sign Language Recognition using Machine Learning

Enhancing Communication through Automated Sign Language Recognition using Machine Learning

Real-Time Traffic Sign Detection and Recognition System using Computer Vision and Machine Learning

The use of computer vision technology for our system has taken a huge leap and has revolutionized the way in which road safety is managed and maintained. This part of the paper represents the key components and functionalities of such a system which helps in enhancing the road safety and also in traffic management. The proposed system is meant to contain computer vision algorithms and some machine learning techniques. These will help in detecting and recognizing the traffic signs in real time video streams. With the help of deep learning models like convolutional neural networks, the proposed system can precisely identify various traffic signs present on roads. The major components of the proposed system include a camera interface which will capture real time video frames from the road, image processing modules for color space conversions, binary thresholding, contour detection and a classification module for the purpose of sign recognition. Deep learning frameworks like TensorFlow and OpenCV libraries are used for image processing and model training In the proposed system. The real time nature of this system allows the spontaneous detection and recognition of traffic signs enabling us to change the road conditions. Hence, the system contributes to prevent accidents and provide timely warnings to drivers. In addition, this system offers potential applications in traffic management and for autonomous driving system. With the help of accurate information, the system can contribute towards more efficient traffic flow and reduce congestion on roads. Overall, the system has very good impacts in road safety and efficiency. It shows advancement in road safety and traffic management.

Long Short-Term Memory (LSTM) model for Indian sign language recognition

The human-computer interaction process is a vital task in attaining artificial intelligence, especially for a person suffering from hearing or speaking disabilities. Recognizing actions more traditionally known as sign language is a common way for them to interact. Computer vision and Deep learning models are capable of understanding these actions and can simulate them to build up a sustainable learning process. This sign language mechanism will be helpful for both the persons with disabilities and the machines to unbound the gap to achieve intelligence. Therefore, in the proposed work, a real-time sign language system is introduced that is capable of identifying numbers ranging from 0 to 9. The database is acquired from the 8 different subjects respectively and processed to achieve approximately 200k amount of data. Further, a deep learning model named LSTM is used for sign recognition. The results were compared with different approaches and on distinct databases proving the supremacy of the proposed work with 91.50% accuracy. Collection of daily life useful signs and further improving the efficiency of the LSTM model is the research direction for future work. The code and data will be available at https://github.com/rahuln2002/Sign-Language-Recognition-using-LSTM-model.

Comparative Study of Machine Learning Algorithms for Traffic Sign Recognition

The increasing integration of intelligent transportation systems has brought forth a critical need for accurate and efficient traffic sign detection algorithms. In this research, we conduct a comprehensive comparative analysis of four prominent convolutional neural network (CNN) architectures—LeNet, ResNet, VGG, and a standard CNN model—for their performance in traffic sign detection. The evaluation is conducted on a diverse dataset, utilizing the German Traffic Signs Recognition Benchmark (GTSRB). Our study encompasses an in-depth examination of accuracy metrics and performance under varying conditions, such as challenging lighting, occlusion, and environmental complexities. The results demonstrate nuanced differences in accuracy and computational efficiency among the algorithms. LeNet exhibits notable improvements in real-time processing, while ResNet showcases enhanced accuracy, and VGG demonstrates robustness in challenging conditions. The findings provide valuable insights into the strengths and weaknesses of each algorithm, aiding researchers and practitioners in selecting the most suitable model for specific traffic sign detection applications. This research contributes to advancing the field of computer vision in intelligent transportation systems, with implications for enhancing road safety and efficiency. Key Words: traffic sign recognition, deep learning, Res-Net, VGG19, CNN, LeNet.

Applying Swin Architecture to Diverse Sign Language Datasets

In an era where artificial intelligence (AI) bridges crucial communication gaps, this study extends AI’s utility to American and Taiwan Sign Language (ASL and TSL) communities through advanced models like the hierarchical vision transformer with shifted windows (Swin). This research evaluates Swin’s adaptability across sign languages, aiming for a universal platform for the unvoiced. Utilizing deep learning and transformer technologies, it has developed prototypes for ASL-to-English translation, supported by an educational framework to facilitate learning and comprehension, with the intention to include more languages in the future. This study highlights the efficacy of the Swin model, along with other models such as the vision transformer with deformable attention (DAT), ResNet-50, and VGG-16, in ASL recognition. The Swin model’s accuracy across various datasets underscore its potential. Additionally, this research explores the challenges of balancing accuracy with the need for real-time, portable language recognition capabilities and introduces the use of cutting-edge transformer models like Swin, DAT, and video Swin transformers for diverse datasets in sign language recognition. This study explores the integration of multimodality and large language models (LLMs) to promote global inclusivity. Future efforts will focus on enhancing these models and expanding their linguistic reach, with an emphasis on real-time translation applications and educational frameworks. These achievements not only advance the technology of sign language recognition but also provide more effective communication tools for the deaf and hard-of-hearing community.