Multimodal Biometric System Research Articles

Multimodal Biometric Authentication System for Military Weapon Access: Face and ECG Authentication

Unimodal or Single factor biometric systems refer to biometric systems that employ only one form of biometric data to authenticate an individual’s identity. These kinds of biometrics are susceptible to higher error rates and security vulnerabilities because it relays on a single trait for authentication. To overcome this, multimodal biometrics method is proposed. Multi-modal biometric system can authenticate more than once and some advantages include; highaccuracy, low error rate, and large population coverage. These biometrics systems increase integrity and privacy since it will contain several biometric features of every customer. So, here designed a multimodal biometrics project utilizing deep learning to enhance authentication security by combining face and Electrocardiogram(ECG) signals. VGG-16 model, a deep learning architecture used to capture complex patterns in accurate individual identification with both ECG and Facial data. The high-resolution convolutional filters capture the intricate details of the face and ECG waveform, ensuring high accuracy in distinguishing different individuals.

Feature-level fusion of face and speech based multimodal biometric attendance system with liveness detection

The rapid growth of deep learning and the Internet of Things has spurred the need for touchless biometric systems in areas where cleanliness and non-intrusive user interaction are critical. In order to authenticate seamlessly, traditional biometric methods such as fingerprint, hand, etc. recognition require physical contact and, therefore, risk hygiene issues, hence making face and speaker verification more viable alternatives. A robust Multimodal Biometric Attendance System (MBAS) is needed due to the vulnerabilities and limitations of single modality systems. In this research, we introduce MBAS using feature-level fusion of speech data with face data, combining the best of both worlds. The textural features based on a person’s facial appearance are integrated with dynamic speech information for liveness detection, followed by dimensionality reduction using linear discriminant analysis, and then incorporated into a Bi-LSTM classifier. Therefore, for better security, accuracy, and anti-spoofing attacks, this approach is proposed in addition to increasing accuracy as well as enhancing security against spoofing attacks. Two publicly available datasets, DeepfakeTIMIT and AVSpeech, are extensively explored to evaluate different fusion strategies, classifier types, and standard performance metrics. The proposed system outperformed other cutting-edge biometric based systems by exhibiting a 97.51% high accuracy rate with a precision of 99.10% and an equal error rate of 2.48%. These findings affirm the effectiveness and possible real-world applications of the MBAS concept, along with its enhancement ensuring safety. Furthermore, this study underscores the importance of incorporating advanced liveness detection into secure contactless biometrics solutions for modern attendance management in various industries that encompass both face and voice modalities.

Retraction Note: Quality-based pattern C2 code score-level fusion in multimodal biometric authentication system using pattern net

Retraction Note: Quality-based pattern C2 code score-level fusion in multimodal biometric authentication system using pattern net

Image sensor fusion for multimodal biometric recognition in mobile devices

AimMultimodal biometric recognition authenticates or identifies someone using various biometric features or modalities. Multimodal biometric systems use different biometric qualities to improve the recognition process's accuracy, security, and reliability rather than depending solely on one biometric property, such as fingerprint or facial recognition. Sensor fusion techniques can merge data from several biometric sensors, including fingerprint scanners and facial recognition cameras, to boost the accuracy and dependability of biometric authentication in the context of multimodal biometric recognition in mobile devices. The process of combining data from numerous image sensors to enhance a system's overall performance is known as image sensor fusion. ChallengesChallenges includeintegration difficulties in achieving accurate and secure multimodal biometric recognition on mobile devices. The study goal was Image sensor fusion for multimodal biometric recognition in mobile devices. MethodologyThe study uses a specially made database of 450 face photos roughly 450 fingerprints.Weiner filter (WF) is used for preparing data. Battle Royale optimized with deep convolutional neural network (BRO-DCNN) is proposed to improve the overall performance of fingerprint and facial information. FindingsAccuracy, sensitivity, specificity, and precision are used to measure the effectiveness of the proposed BRO-DCNN system. Study results show that BRO-MLANN solves the many characteristics of smart cities and is an efficient approach compared to other current methods in recognition rate, 98 % accuracy, 99 % precision, 96 % specificity, and 94 % sensitivity.

Multimodal biometric integration: Trends and insights from the past quinquennial

Recent years have seen a notable breakthrough in multimodal biometric systems, which combine numerous biometric modalities for increased security and accuracy. This paper offers a thorough analysis of recent advances in the field, addressing the many multimodal biometric strategies that have been put out by different researchers. Numerous modalities are covered by the evaluation, such as palm print, speech, iris, facial features, palm print, fingerprint, body form, gait, and more. To obtain amazing results in terms of accuracy and security, researchers have used cutting-edge methods like convolutional neural networks (CNNs), support vector machines (SVM), recurrent neural networks (RNNs), deep learning, and optimization algorithms. Many fusion strategies have been investigated to efficiently merge data from many modalities, such as feature-level fusion, decision-level fusion, and score-level fusion. Developments in template protection systems have also addressed security issues related to transmission and storage of biometric data. Even though a lot of the suggested systems have shown great accuracy rates, there are still issues with hardware restrictions, dataset biases, privacy problems, and computational costs. Prospective study avenues encompass investigating more extensive and heterogeneous datasets, crafting resilient fusion algorithms, and amalgamating cutting-edge technologies like deep learning-based biometric cryptosystems and federated learning. All things considered, the literature study demonstrates the enormous potential of multimodal biometric systems in offering safe and dependable authentication solutions for a wide range of applications, from on-line student authentication and proctoring systems to customized healthcare networks.

Enhanced multimodal biometric access control system using chicken swarm optimization and self-organizing feature maps: a study on ear and iris recognition

Access control systems are crucial for securing sensitive data and system components by allowing authorized access while blocking unauthorized entities. Traditional unimodal biometric systems, make use of a single physiological or behavioral trait, have limitations such as susceptibility to spoofing and environmental constraints, leading to reduced reliability. This study explores an enhanced multimodal biometric access control system that combines ear and iris traits using an enhanced Self-Organizing Feature Map (SOFM) algorithm improved with Chicken Swarm Optimization (CSO). The system's performance is evaluated against traditional SOFM, with a focus on recognition accuracy and processing time. The data used to train the classifier for this study were collected from 190 individuals, encompassing a total of 2,280 images of iris, and ear traits. Preprocessing involved cropping, resizing, and grayscale conversion using histogram equalization. Feature extraction utilized Local Binary Patterns (LBP), followed by feature fusion at the feature level to create an integrated feature set. The enhanced SOFM algorithm was then applied for classification, with the CSO technique optimizing the learning rate and weight parameters for improved performance. At different thresholds, the CSO-SOFM classifier outperformed the standard SOFM classifier using metrics such as Sensitivity, Specificity, Precision, Accuracy and Recognition time.

Multimodal biometric authentication: A review

Critical applications ranging from sensitive military data to restricted area access demand selective user authentication. The prevalent methods of tokens, passwords, and other commonly used techniques proved deficient as they can be easily stolen, lost, or broken to gain illegitimate access, leading to data spillage. Since data safety against tricksters is a significant issue nowadays, biometrics is one of the unique human characteristic-based techniques that may give better solutions in this regard. The technique entails biometric authentication of users based on an individual’s inimitable physiological or behavioral characteristics to provide access to a specific application or data. This paper provides a detailed description of authentication and its approaches, focusing on biometric-based authentication methods, the primary challenges they encounter, and how they have been addressed. The tabular view shows the benefits and downsides of various multimodal biometric systems, and open research challenges. To put it another way, this article lays out a roadmap for the emergence of multimodal biometric-based authentication, covering both the challenges and the solutions that have been proposed. Further, the urge to develop various multi-trait-based methods for secure authentication and data privacy is focused. Lastly, some multimodal biometric systems comprising fingerprint and iris modalities have been compared based on False Accept Rate (FAR), False Reject Rate (FRR), and accuracy to find the best secure model with easy accessibility.

Multimodal Biometric System Fusion Using Fingerprint and Iris with Convolutional Neural Network

Biometric sensing technology became everyday life frequent component as a result of world requirement for info security and safety legislation. A strong and efficient individual authentication has appeared because of new developments in multimodal biometrics. Multimodal biometrics integrates different biological traits in trying for creating considerable effect on identification performance. Latent fingerprint biometrics refer to effective human identification system for criminals given the accessible crime evidence shreds. Although, biometric trait restrictions like intra-class variation, sensed data noise, lack of individuality caused low matching score that possesses a negative effect on recognition and investigation process. This paper uses two unimodal biometrics—the fingerprint and the iris—applied as multi-biometrics to show that using these biometrics can produce excellent results with high accuracy. Every biometric result is weighted for involvement in the final decision, and the decision level is utilized for fusion. For every biometric result integration effect, a neural network is used. The datasets' experimental findings have demonstrated a notable biometric system identification capability. The accuracy performance of the suggested approach is 100, the FAR is 0.1, and the EER is 0.1. To demonstrate the efficacy of the suggested system, the suggested method is contrasted with a few other approaches currently in use.

A Study of New Indexing Techniques for Multimodal Identification Using Iris, Fingerprint, and Face Biometrics

This paper explores innovative indexing techniques for multimodal biometric identification systems, focusing on iris, fingerprint, and facial recognition technologies. With the proliferation of digital identity verification needs, traditional single-modal biometric systems often fall short in terms of accuracy, speed, and security. Multimodal biometric systems, which integrate multiple biological characteristics, are becoming crucial for enhancing identification performance. This study aims to present a comprehensive analysis of new indexing methods that can significantly improve the efficiency, accuracy, and security of multimodal biometric identification systems.

In-Depth Analysis of GAF-Net: Comparative Fusion Approaches in Video-Based Person Re-Identification

This study provides an in-depth analysis of GAF-Net, a novel model for video-based person re-identification (Re-ID) that matches individuals across different video sequences. GAF-Net combines appearance-based features with gait-based features derived from skeletal data, offering a new approach that diverges from traditional silhouette-based methods. We thoroughly examine each module of GAF-Net and explore various fusion methods at the both score and feature levels, extending beyond initial simple concatenation. Comprehensive evaluations on the iLIDS-VID and MARS datasets demonstrate GAF-Net’s effectiveness across scenarios. GAF-Net achieves state-of-the-art 93.2% rank-1 accuracy on iLIDS-VID’s long sequences, while MARS results (86.09% mAP, 89.78% rank-1) reveal challenges with shorter, variable sequences in complex real-world settings. We demonstrate that integrating skeleton-based gait features consistently improves Re-ID performance, particularly with long, more informative sequences. This research provides crucial insights into multi-modal feature integration in Re-ID tasks, laying a foundation for the advancement of multi-modal biometric systems for diverse computer vision applications.

Security Scheme by Using Steganography in Multi-ModelBiometric System

The process of automatically identifying a person based on their physiological and behavioural traits is known as biometric recognition. A unimodal or multimodal biometric system might be based on physiological or behavioural traits. Some shortcomings in the unimodal biometric system include spoofing, non- universality, intra-class differences, and noisy data. Using the face and palm images as templates, we are implementing a multimodal biometric system. A person's palm image can provide a wealth of detailed information about them. Palm image have three major lines, name as principle line, secondary line and wrinkles which are unique in nature. Face image have more feature than any other biometric traits. Face image is recognized easily in less time. Combining these two biometric template gives higher security. Message image kept secretly in the cover image called stego image. In this steganography technique we are using palm image as a Message and face image as a cover image. After getting stego image Identification process works. The important featureof identification process id De-Stego. This feature of identification will separate the message image (palm image) from cover image (face image). After separation of images the decision will take care, weather the image identified or notidentified.

Integrating a cosmetic detection scheme into face–iris multimodal biometric systems

Integrating a cosmetic detection scheme into face–iris multimodal biometric systems

Multimodal Biometric Authentication System Using of Autoencoders and Siamese Networks for Enhanced Security

Ensuring secure and reliable identity verification is crucial, and biometric authentication plays a significant role in achieving this. However, relying on a single biometric trait, unimodal authentication, may have accuracy and attack vulnerability limitations. On the other hand, multimodal authentication, which combines multiple biometric traits, can enhance accuracy and security by leveraging their complementary strengths. In the literature, different biometric modalities, such as face, voice, fingerprint, and iris, have been studied and used extensively for user authentication. Our research introduces a highly effective multimodal biometric authentication system with a deep learning approach. Our study focuses on two of the most user-friendly safety mechanisms: face and voice recognition. We employ a convolutional autoencoder for face images and an LSTM autoencoder for voice data to extract features. These features are then combined through concatenation to form a joint feature representation. A Siamese network carries out the final step of user identification. We evaluated our model’s efficiency using the OMG-Emotion and RAVDESS datasets. We achieved an accuracy of 89.79% and 95% on RAVDESS and OMG-Emotion datasets, respectively. These results are obtained using a combination of face and voice modality.

Reliable human authentication using AI-based multibiometric image sensor fusion: Assessment of performance in information security

Reliable human authentication is essential for assuring the availability, confidentiality, and integrity of sensitive data and resources in the field of information security. Due to the vulnerabilities of conventional authentication techniques like passwords and PINs, interest in biometric-based authentication systems has developed. To get over this, we suggest an efficient voice and iris recognition-based multimodal biometric verification strategy for human authenticating tools. We first collect the voice and iris datasets from 150 people. Then, we used a median filter and high pass filter to preprocess the voice and iris data. The features of voice identification are extracted using the shifted delta cepstral coefficient (SDCC) and the Mel frequency discrete wavelet coefficient (MFCC), and these two coefficients are evaluated. The outcomes of the extraction of iris identification features using Local binary pattern (LBP) and Speeded robust features (SURF) are evaluated. The classifier Fine Tuned Cuckoo Search Optimized Convolutional Neural Network (FCSO-CNN) performs voice and iris recognition modalities. Voice and iris biometric systems may be combined into a single multimodal biometric system by fusing their respective feature sets and scoring algorithms. The results of the computer simulation demonstrate that for speech recognition, using the SDC and MFC coefficients produces better results, while for iris recognition, using the LBP and FCSO-CNN experiment produces superior outcomes. Additionally, the scores fusion works superior to other scenarios in the proposed multimodal biometrics system. The suggested system provides a dependable and strong solution for human identification, assisting in the improvement of security measures across a variety of industries, including financial institutions, governmental agencies, and the defense of key infrastructure.

Enhancing Recognition in Multimodal Biometric Systems: Score Normalization and Fusion of Online Signatures and Fingerprints

Multimodal biometrics employs multiple modalities within a single system to address the limitations of unimodal systems, such as incomplete data acquisition or deliberate fraud, while enhancing recognition accuracy. This study explores score normalization and its impact on system performance. To fuse scores effectively, prior normalization is necessary, followed by a weighted sum fusion technique that aligns impostor and genuine scores within a common range. Experiments conducted on three biometric databases demonstrate the promising efficacy of the proposed approach, particularly when combined with Empirical Modal Decomposition (EMD). The fusion system exhibits strong performance, with the best outcome achieved by merging the online signature and fingerprint modalities, resulting in a normalized Min-Max score-based Equal Error Rate (EER) of 1.69%.

Deep learning based biometric authentication using electrocardiogram and iris

Authentication systems play an important role in wide range of applications. The traditional token certificate and password-based authentication systems are now replaced by biometric authentication systems. Generally, these authentication systems are based on the data obtained from face, iris, electrocardiogram (ECG), fingerprint and palm print. But these types of models are unimodal authentication, which suffer from accuracy and reliability issues. In this regard, multimodal biometric authentication systems have gained huge attention to develop the robust authentication systems. Moreover, the current development in deep learning schemes have proliferated to develop more robust architecture to overcome the issues of tradition machine learning based authentication systems. In this work, we have adopted ECG and iris data and trained the obtained features with the help of hybrid convolutional neural network- long short-term memory (CNN-LSTM) model. In ECG, R peak detection is considered as an important aspect for feature extraction and morphological features are extracted. Similarly, gabor-wavelet, gray level co-occurrence matrix (GLCM), gray level difference matrix (GLDM) and principal component analysis (PCA) based feature extraction methods are applied on iris data. The final feature vector is obtained from MIT-BIH and IIT Delhi Iris dataset which is trained and tested by using CNN-LSTM. The experimental analysis shows that the proposed approach achieves average accuracy, precision, and F1-core as 0.985, 0.962 and 0.975, respectively.

SecureSense: Enhancing Person Verification through Multimodal Biometrics for Robust Authentication

Biometrics provide enhanced security and convenience compared to conventional methods of individual authentication. A more robust and effective method of individual authentication has emerged due to recent advancements in multimodal biometrics. Unimodal systems offer lower security and lack the robustness found in multimodal biometric systems. The research paper introduces a novel approach, employing multiple biometric modalities, including face, fingerprint, and iris, to authenticate users in a multimodal biometric system. The paper proposes the ”Secure Sense” framework, which combines multiple biometric modalities to improve person verification accuracy. The proposed system utilizes both web-based and real-time datasets. For the web-based dataset, we employed the Chicago Face dataset for facial data, the MMU1 dataset for iris data, and the SOCOfing dataset for fingerprint data. In real-time data collection, facial data is captured using a Zebronics Zeb-Gem webcam, fingerprint data is obtained using the Mantra MFS scanner, and iris data is collected using the Mantra MIS scanner. In the envisioned system, we introduce an innovative approach that employs a decision-level fusion technique across three unique biometric modalities, resulting in an impressive accuracy rate of approximately 93% across all modalities.

Enhanced multimodal biometric recognition systems based on deep learning and traditional methods in smart environments.

In the field of data security, biometric security is a significant emerging concern. The multimodal biometrics system with enhanced accuracy and detection rate for smart environments is still a significant challenge. The fusion of an electrocardiogram (ECG) signal with a fingerprint is an effective multimodal recognition system. In this work, unimodal and multimodal biometric systems using Convolutional Neural Network (CNN) are conducted and compared with traditional methods using different levels of fusion of fingerprint and ECG signal. This study is concerned with the evaluation of the effectiveness of proposed parallel and sequential multimodal biometric systems with various feature extraction and classification methods. Additionally, the performance of unimodal biometrics of ECG and fingerprint utilizing deep learning and traditional classification technique is examined. The suggested biometric systems were evaluated utilizing ECG (MIT-BIH) and fingerprint (FVC2004) databases. Additional tests are conducted to examine the suggested models with:1) virtual dataset without augmentation (ODB) and 2) virtual dataset with augmentation (VDB). The findings show that the optimum performance of the parallel multimodal achieved 0.96 Area Under the ROC Curve (AUC) and sequential multimodal achieved 0.99 AUC, in comparison to unimodal biometrics which achieved 0.87 and 0.99 AUCs, for the fingerprint and ECG biometrics, respectively. The overall performance of the proposed multimodal biometrics outperformed unimodal biometrics using CNN. Moreover, the performance of the suggested CNN model for ECG signal and sequential multimodal system based on neural network outperformed other systems. Lastly, the performance of the proposed systems is compared with previously existing works.

Multimodal Biometric Login System Using Face and Signature

Biometrics has developed to be one of the most relevant technologies used in Information Technology (IT) security. Uni-modal biometric systems have a variety of problems which decreases the performance and accuracy of these systems. One way to overcome the limitations of the Unimodal biometric systems is through fusion to form a multimodal biometric system. Hence this process is developed based on Multimodal Biometric system based on Face, Finger print, Signature etc. Multimodal biometric system employing Convolutional Neural Networks (CNNs) for effective feature extraction and classification. The system combines facial and signature biometrics, harnessing the unique advantages of each modality to create a more resilient and accurate authentication framework. Multimodal biometric system with CNN integration holds promise for applications in secure access control, financial transactions, and other domains where reliable authentication is crucial. Its adaptability and scalability make it a viable solution for addressing the evolving challenges in biometric security systems. Key Word: Unimodal biometric system , Multimodal Biometric system , Convolutional Neural Networks (CNNs),deep learning.

A multimodal biometric database and case study for face recognition based deep learning

Recently, multimodal biometric systems have garnered a lot of interest for the identification of human identity. The accessibility of the database is one of the contributing elements that impact biometric recognition systems. In their studies, the majority of researchers concentrate on unimodal databases. There was a need to compile a fresh, realistic multimodal biometric database, nonetheless, because there were so few comparable multimodal biometric databases that were publically accessible. This study introduces the MULBv1 multimodal biometric database, which contains homologous biometric traits. The MULBv1 database includes 20 images of each person's face in various poses, facial emotions, and accessories, 20 images of their right hand from various angles, and 20 images of their right iris from various lighting positions. The database contains real multimodal data from 174 people, and all biometrics were accurately collected using the micro camera of the iPhone 14 Pro Max. A face recognition technique is also suggested as a case study using the gathered facial features. In the case study, the deep convolutional neural network (CNN) was used, and the findings were positive. Through several trials, the accuracy was (97.41%).