Real-time Identification System Research Articles

Real-Time Posture Identification System for Wheelchair Users Preventing the Generation of Pressure Ulcers

Real-Time Posture Identification System for Wheelchair Users Preventing the Generation of Pressure Ulcers

AI-enhanced real-time cattle identification system through tracking across various environments

Video-based monitoring is essential nowadays in cattle farm management systems for automated evaluation of cow health, encompassing body condition scores, lameness detection, calving events, and other factors. In order to efficiently monitor the well-being of each individual animal, it is vital to automatically identify them in real time. Although there are various techniques available for cattle identification, a significant number of them depend on radio frequency or visible ear tags, which are prone to being lost or damaged. This can result in financial difficulties for farmers. Therefore, this paper presents a novel method for tracking and identifying the cattle with an RGB image-based camera. As a first step, to detect the cattle in the video, we employ the YOLOv8 (You Only Look Once) model. The sample data contains the raw video that was recorded with the cameras that were installed at above from the designated lane used by cattle after the milk production process and above from the rotating milking parlor. As a second step, the detected cattle are continuously tracked and assigned unique local IDs. The tracked images of each individual cattle are then stored in individual folders according to their respective IDs, facilitating the identification process. The images of each folder will be the features which are extracted using a feature extractor called VGG (Visual Geometry Group). After feature extraction task, as a final step, the SVM (Support Vector Machine) identifier for cattle identification will be used to get the identified ID of the cattle. The final ID of a cattle is determined based on the maximum identified output ID from the tracked images of that particular animal. The outcomes of this paper will act as proof of the concept for the use of combining VGG features with SVM is an effective and promising approach for an automatic cattle identification system

Ultralow-Power Single-Sensor-Based E-Nose System Powered by Duty Cycling and Deep Learning for Real-Time Gas Identification.

This study presents a novel, ultralow-power single-sensor-based electronic nose (e-nose) system for real-time gas identification, distinguishing itself from conventional sensor-array-based e-nose systems, whose power consumption and cost increase with the number of sensors. Our system employs a single metal oxide semiconductor (MOS) sensor built on a suspended 1D nanoheater, driven by duty cycling─characterized by repeated pulsed power inputs. The sensor's ultrafast thermal response, enabled by its small size, effectively decouples the effects of temperature and surface charge exchange on the MOS nanomaterial's conductivity. This provides distinct sensing signals that alternate between responses coupled with and decoupled from the thermally enhanced conductivity, all within a single time domain during duty cycling. The magnitude and ratio of these dual responses vary depending on the gas type and concentration, facilitating the early stage gas identification of five gas types within 30 s via a convolutional neural network (classification accuracy = 93.9%, concentration regression error = 19.8%). Additionally, the duty-cycling mode significantly reduces power consumption by up to 90%, lowering it to 160 μW to heat the sensor to 250 °C. Manufactured using only wafer-level batch microfabrication processes, this innovative e-nose system promises the facile implementation of battery-driven, long-term, and cost-effective IoT monitoring systems.

Real-Time Surface Identification System for Variable Walking Speeds of Biped Robots

Real-Time Surface Identification System for Variable Walking Speeds of Biped Robots

Real-Time Monitoring of Toxic Gases using Artificial Neural Networks with SnO2-based Thick Film Gas Sensors

The present study aims to develop an advanced system for real-time identification and measurement of harmful gases using Pd-doped SnO2-based thick film gas sensors integrated with Artificial Neural Networks. These sensors, renowned for their exceptional sensitivity and selectivity, undergo testing in a meticulously controlled gas chamber environment. Here, gas concentrations, temperature, and humidity are meticulously controlled. The gas chamber setup allows for mixing gases like carbon monoxide, nitrogen dioxide, and sulfur dioxide with nitrogen gas to achieve desired concentrations ranging from to . Temperature is kept at and relative humidity is maintained between to . The sensitivity analysis of the sensor demonstrates its adeptness in detecting low concentrations of target gases, with sensitivity increasing as gas concentrations rise, also the selectivity assessments highlight their ability to accurately differentiate between target gases and common interferents, ensuring precise detection even in complex gas mixtures. Response time testing indicates rapid detection capabilities, crucial and useful for emergencies. The Artificial Neural Network model, trained via the backpropagation algorithm, demonstrates remarkable accuracy, precision, recall, and F1 scores in predicting gas concentrations. The findings indicate that this integrated system offers a reliable and efficient solution for toxic gas detection, with potential applications in industrial safety and environmental monitoring.

Tracking Modal Parameters of Structures Online Using Recursive Stochastic Subspace Identification under Ambient Excitations

Continuous and autonomous system identification is an alternative to regular inspection during operations, which is essential for structural integrity management (SIM) as well as structural health monitoring (SHM). In this regard, online (or real-time) system identification techniques that have recently received considerable attention can be used to assess the current condition and performance during operations and, in the meantime, can be utilized to detect any damage or deterioration. For example, stochastic subspace identification (SSI), based on recursive formulation, has proven its capability in tracking modal parameters as well as time-variant dynamic behaviors. This study proposes the implementation of recursive SSI (RSSI) using the matrix inversion lemma to track slow time-varying parameter changes under ambient excitations. Subsequently, some investigations for practical implementation are examined and discussed. For verifying the reliability of SHM applications based on the proposed methods, two datasets measured from different experiments are exploited to identify the modal parameters reclusively. The results from both numerical simulations and experimental investigations demonstrated the effectiveness of tracking the modal parameters exhibiting time-varying dynamic characteristics under white noise excitations (or ambient excitations).

Real-time facial emotion recognition model based on kernel autoencoder and convolutional neural network for autism children

Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder that is characterized by abnormalities in the brain, leading to difficulties in social interaction and communication, as well as learning and attention. Early diagnosis of ASD is challenging as it mainly relies on detecting abnormalities in brain function, which may not be evident in the early stages of the disorder. Facial expression analysis has shown promise as an alternative and efficient solution for early diagnosis of ASD, as children with ASD often exhibit distinctive patterns that differentiate them from typically developing children. Assistive technology has emerged as a crucial tool in improving the quality of life for individuals with ASD. In this study, we developed a real-time emotion identification system to detect the emotions of autistic children in case of pain or anger. The emotion recognition system consists of three stages: face identification, facial feature extraction, and feature categorization. The proposed system can detect six facial emotions: anger, fear, joy, natural, sadness, and surprise. To achieve high-performance accuracy in classifying the input image efficiently, we proposed a deep convolutional neural network (DCNN) architecture for facial expression recognition. An autoencoder was used for feature extraction and feature selection, and a pre-trained model (ResNet, MobileNet, and Xception) was applied due to the size of the dataset. The Xception model achieved the highest performance, with an accuracy of 0.9523%, sensitivity of 0.932, specificity of 0.9421, and AUC of 0.9134%. The proposed emotion detection framework leverages fog and IoT technologies to reduce latency for real-time detection with fast response and location awareness. Using fog computing is particularly useful when dealing with big data. Our study demonstrates the potential of using facial expression analysis and deep learning algorithms for real-time emotion recognition in autistic children, providing medical experts and families with a valuable tool for improving the quality of life for individuals with ASD.

Enhancing Yoga Learning with a Low-Complexity, Mobilebased Deep Learning System for Real-Time Posture Identification and Correction

Enhancing Yoga Learning with a Low-Complexity, Mobilebased Deep Learning System for Real-Time Posture Identification and Correction

ThumbUp: Secure Smartwatch Controller for Smart Homes Using Simple Hand Gestures

The development of creative applications and intelligent gadgets requires a secure and straightforward interface with human users. We propose, design, and implement ThumbUp, a smartwatch-based two-factor real-time identification and authentication system in which smartwatch users can identify and authenticate themselves using some simple hand and finger movements, such as thumb-up. ThumbUp leverages the signal from the Inertial Measurement Unit (IMU) in in Commercial-Off-The-Shelf (COTS) smart devices to discover the unique pattern generated by each user's simple gestures using a carefully constructed deep learning model. Smart homes provide a comfortable, safe, and efficient living environment, epecially help the sick and aged. We propose strategies for convenient and reliable control in smart homes with gesture command recognition. We build an Auto-Encoder-based filter that reconstructs the raw data to improve the representation of gesture features. Moreover, we adopt the random forest method to analyse the contextual command correlation. And we employ the authentication system based on smartwatch for personalized command feedback and ensure that illegals cannot use the device. We implement our system and undertake rigorous studies to determine its usefulness and efficiency over a three-month period with 65 users. It achieves a 97% accuracy for user classification and an EER of 0.014 for authentication task with a single simple gesture. And our method achieves 91% accuracy for command recognition and 96% command accuracy with contextual informations. Additionally, we conduct a study of user acceptability of our system and explain how gesture proficiency influences authentication accuracy.

DETECTION OF CREDIT CARD FRAUD IN REAL TIME USING SPARK ML

Assume you have access to a credit card. Your prior spending habits will be investigated. For example, how much money you spend, where it is spent, how frequently it is spent, and what you buy. If your current credit card transaction differs from your historical spending patterns, it is suspected of fraud; otherwise, it is considered as a genuine transaction, and fraud transactions are warned in the dashboard. The predictions are expected to be based on millions of transactions. As result, distributed frameworks that can expand as the number of transactions grows are used. Spark this system for real-time identification of credit card theft is built with Kafka and Cassandra. Preprocessing is accomplished through the use of Spark Machine Learning Pipeline Stages such as String Indexer and Vector.

A computer vision-based system for real-time component identification from waste printed circuit boards

With an exponential increase in consumers' need for electronic products, the world is facing an ever-increasing economic and environmental threat of electronic waste (e-waste). To minimize their adverse effects, e-waste recycling is one of the pivotal factors that can help in minimizing the environmental pollution andto increase recovery of valuable materials. For instance, Printed Circuit Boards (PCBs), while they have several valuable elements, they are hazardous too; and therefore, they form a large chunk of e-waste being generated today. Thus, in recycling PCBs, Electronic Components (ECs) are segregated at first, and separately processed for recovering key elements that could be re-used. However, in the current recycling process, especially in developing nations, humans manually screen ECs, which goes on to affect their health. It also causes losses of valuable materials. Therefore, automated solutions need to be adopted for both to classify and to segregate ECs from waste PCBs. The study proposes a robust EC identification system based on computer vision and deep learning algorithms (YOLOv3) to automate sorting process which would help in further processing. The study uses a publicly available dataset, and a PCB dataset which reflect challenging recycling environments like lighting conditions, cast shadows, orientations, viewpoints, and different cameras/resolutions. The outcome of YOLOv3 detection model based on training of both datasets presents satisfactory classification accuracy and capability of real-time competent identification, which in turn, could help in automatically segregating ECs, while leading towards effective e-waste recycling.

An unscented Kalman filter under unknown input without direct feedthrough for joint input and system identification of structural systems

Given the difficulty of accurately measuring external inputs acting on structures, the research on joint input-system identification has gained significant attention in recent years. Among them, several unscented Kalman filters under unknown input (UKF-UI) based methods have been proposed for joint input and system identification. However, the existing UKF-UI methods require unknown inputs to be presented in the observation equations, which is not always available in practical engineering. To solve this problem, an unscented Kalman filter under unknown input without direct feedthrough (UKF-UI-WDF) is proposed in this paper for real-time joint input and system identification of structural systems without direct feedthrough using limited response measurements. The proposed UKF-UI-WDF is derived for recursive identification of the structural states, parameters, and unknown inputs by integrating unknown input estimation into the conventional UKF framework. In each identification step, the unknown inputs are first identified by minimizing posterior residuals of measurements, and then the structural states and parameters are identified by a traditional unscented Kalman filtering using the identified unknown inputs. According to whether the uncertainty of the identified unknown inputs can be quantitatively described or not, two implementation algorithms are provided in this paper. In algorithm 1, only the mean values of unknown inputs can be identified. In algorithm 2, the unknown inputs are identified as a set of sigma points, so not only the mean values but also the variance of the unknown inputs can be estimated. The effectiveness of the proposed method is examined by the joint input and system identification of various case studies of linear and nonlinear hysteretic shear structures subjected to unknown external or base excitations, respectively. The results show that the proposed UKF-UI-WDF method can effectively perform real-time joint input-system identification of structural systems without direct feedthrough using limited response measurements.

Real-time multi-physical system identification and virtual sensing for a lab-scale chemical stirred tank using parallel estimators

In the initial stages of developing a new chemical process, chemists usually use a lab-scale stirred tank to analyze the yield amount and study the mass balance. However, understanding the energy balance is challenging. Monitoring the energy balance requires separating device and process-related effects, which is time-consuming and requires insight into the dynamics of the device and process. As a result, most lab-scale studies often overlook it. A real-time multi-physical virtual sensing and system identification approach is proposed in this study to address this issue by estimating desired unknown electro-thermo-mechanical parameters, states, and disturbances. The estimated unknowns include heat transfer coefficients, motor temperature, stirring torque, and heat generation rate. For this aim, a multi-physical lumped model is developed, which covers the electro-thermal and electro-mechanical responses of the device, as well as the process-related thermo-mechanical effects. The model is decoupled, and three parallel extended Kalman filters are employed. The developed model, estimation procedure, and measurement system are implemented in two experimental examples, including a hydrogenation reaction and the reductive catalytic fractionation of biomass. Both cases use a low-cost data acquisition system designed and manufactured to perform the measurements in this research. Comparing the logged measurements with the estimated values indicates considerable agreement in both cases. Based on the results, decoupling the model and using parallel estimators make the tuning easier, improve observability, and reduce the estimation time.

Simulations of real-time system identification for superconducting cavities with a recursive least-squares algorithm

Simulations of real-time system identification for superconducting cavities with a recursive least-squares algorithm

Active learning guided automated cable force monitoring based on modified S-transform

This study introduces an active learning-guided online cable force monitoring system based on a modified S-transform approach, addressing key challenges in real-time system identification: complex non-stationary excitations, computational efficiency, and robustness. The framework identifies cable tension during non-stationary wind loads, significantly improving accuracy and efficiency via an extended active learning Kriging method. It effectively detects potential outliers, identifies the cable's fundamental frequency using a data fusion technique, and calculates real-time cable force and tensile stress with empirical formulae. A comprehensive analysis, including numerical and sensitivity studies, shows an error rate of less than 4 % in all cases, proving the proposed framework's superior accuracy, efficiency, and robustness compared to traditional methods. Laboratory validations using cable test data and Jiu Zhou Bridge data demonstrate the system's stability, even under extreme conditions, such as during Super Typhoon Mangkhut, providing a reliable solution for real-world cable force online monitoring.

An Unmanned Vehicle-Based Remote Raman System for Real-Time Trace Detection and Identification

Raman spectroscopy is a type of inelastic scattering that provides rich information about a substance based on the coupling of the energy levels of their vibrational and rotational modes with an incident light. It has been applied extensively in many fields. As there is an increasing need for the remote detection of chemicals in planetary exploration and anti-terrorism, it is urgent to develop a compact, easily transportable, and fully automated remote Raman detection system for trace detection and identification of information, with high-level confidence about the target’s composition and conformation in real-time and for real field scenarios. Here, we present an unmanned vehicle-based remote Raman system, which includes a 266 nm air-cooling passive Q-switched nanosecond pulsed laser of high-repetition frequency, a gated ICMOS, and an unmanned vehicle. This system provides good spectral signals from remote distances ranging from 3 m to 10 m for simulating realistic scenarios, such as aluminum plate, woodblock, paperboard, black cloth, and leaves, and even for detected amounts as low as 0.1 mg. Furthermore, a convolutional neural network (CNN)-based algorithm is implemented and packaged into the recognition software to achieve faster and more accurate detection and identification. This prototype offers a proof-of-concept for an unmanned vehicle with accurate remote substance detection in real-time, which can be helpful for remote detection and identification of hazardous gas, explosives, their precursors, and so forth.

A Novel Fault Diagnosis Scheme for PV Plants Based on Real-Time System State Identification

A large-scale photovoltaic (PV) power plant is composed of hundreds or thousands of solar panels, which makes fault diagnosis a challenging problem due to its complexity. It is known that the PV power output characteristics dramatically change with environmental conditions. Thus, it is difficult to distinguish a short-circuit line fault from mismatching conditions induced by partial shading or unbalanced generation. The article proposes a novel fault diagnosis scheme that is based on real-time system identification to determine normal or abnormal operations. It does not require any additional hardware or measurement support. The identification and analysis include both short- and long-term characteristics of the generation system to mitigate disturbances and improve the robustness. The effectiveness of the proposed scheme is validated by simulations and experiments under a wide range of test conditions.

A Hardware-Software System for Accurate Segmentation of Phonocardiogram Signal.

Phonocardiogram (PCG) signal provides valuable information for diagnosing heart diseases. However, its applications in quantitative analyses of heart function are limited because the interpretation of this signal is difficult. A key step in quantitative PCG is the identification of the first and second sounds (S1 and S2) in this signal. This study aims to develop a hardware-software system for synchronized acquisition of two signals electrocardiogram (ECG) and PCG and to segment the recorded PCG signal via the information provided in the acquired ECG signal. In this analytical study, we developed a hardware-software system for real-time identification of the first and second heart sounds in the PCG signal. A portable device to capture synchronized ECG and PCG signals was developed. Wavelet de-noising technique was used to remove noise from the signal. Finally, by fusing the information provided by the ECG signal (R-peaks and T-end) into a hidden Markov model (HMM), the first and second heart sounds were identified in the PCG signal. ECG and PCG signals from 15 healthy adults were acquired and analyzed using the developed system. The average accuracy of the system in correctly detecting the heart sounds was 95.6% for S1 and 93.4% for S2. The presented system is cost-effective, user-friendly, and accurate in identifying S1 and S2 in PCG signals. Therefore, it might be effective in quantitative PCG and diagnosing heart diseases.

Real-time facial emotion recognition system among children with autism based on deep learning and IoT

Diagnosis of autism considers a challenging task for medical experts since the medical diagnosis mainly depends on the abnormalities in the brain functions that may not appear in the early stages of early onset of autism disorder. Facial expression can be an alternative and efficient solution for the early diagnosis of Autism. This is due to Autistic children usually having distinctive patterns which facilitate distinguishing them from normal children. Assistive technology has proven to be one of the most important innovations in helping people with autism improve their quality of life. A real-time emotion identification system for autistic youngsters was developed in this study. Face identification, facial feature extraction, and feature categorization are the three stages of emotion recognition. A total of six facial emotions are detected by the propound system: anger, fear, joy, natural, sadness, and surprise. This section proposes an enhanced deep learning (EDL) technique to classify the emotions using convolutional neural network. The proposed emotion detection framework takes the benefit from using fog and IoT to reduce the latency for real-time detection with fast response and to be a location awareness. From the results, EDL outperforms other techniques as it achieved 99.99% accuracy. EDL used GA to select the optimal hyperparameters for the CNN.

A Multi-Stage Deep-Learning-Based Vehicle and License Plate Recognition System with Real-Time Edge Inference.

Video streaming-based real-time vehicle identification and license plate recognition systems are challenging to design and deploy in terms of real-time processing on edge, dealing with low image resolution, high noise, and identification. This paper addresses these issues by introducing a novel multi-stage, real-time, deep learning-based vehicle identification and license plate recognition system. The system is based on a set of algorithms that efficiently integrate two object detectors, an image classifier, and a multi-object tracker to recognize car models and license plates. The information redundancy of Saudi license plates' Arabic and English characters is leveraged to boost the license plate recognition accuracy while satisfying real-time inference performance. The system optimally achieves real-time performance on edge GPU devices and maximizes models' accuracy by taking advantage of the temporally redundant information of the video stream's frames. The edge device sends a notification of the detected vehicle and its license plate only once to the cloud after completing the processing. The system was experimentally evaluated on vehicles and license plates in real-world unconstrained environments at several parking entrance gates. It achieves 17.1 FPS on a Jetson Xavier AGX edge device with no delay. The comparison between the accuracy on the videos and on static images extracted from them shows that the processing of video streams using this proposed system enhances the relative accuracy of the car model and license plate recognition by 13% and 40%, respectively. This research work has won two awards in 2021 and 2022.