Multimodal Biometric Identification System Research Articles

A Review on fusion in Multimodal Biometric Spoofing Attack by Different Materials

Biometric gadgets utilize their physiological or behavioural properties for the confirmation and acknowledgment of people. Spoofing attack can be done by using any spoofing materials. Such features can be arranged into unimodal and multimodal frameworks. Some state-of-the-methods have some drawbacks, which reduce the efficiency of the system. Multimodal biometric detecting frameworks utilize at least two behavioural or physiological attributes. The multimodal system has showed to increase the success rate of identification and authentication meaningfully. Data from different modalities are acquired, pre-handled, removed noise, and contrasted and finally converted into features. At last, selection of features acknowledges the identification of a person. In multimodal biometric identification system, biometric features can club at any of the stages. i.e. sensor level, feature level, score level, rank level, and decision level. This paper presents an effective survey on fusion of features at different level in a multimodal biometric system. It also focuses in the field with a better thoughtful of multimodal biometric sensing and handling systems and research inclinations in this field.

A Modified Chaotic Binary Particle Swarm Optimization Scheme and Its Application in Face-Iris Multimodal Biometric Identification

In order to improve the recognition rate of the biometric identification system, the features of each unimodal biometric are often combined in a certain way. However, there are some mutually exclusive redundant features in those combined features, which will degrade the identification performance. To solve this problem, this paper proposes a novel multimodal biometric identification system for face-iris recognition.It is based on binary particle swarm optimization. The face features are extracted by 2D Log-Gabor and Curvelet transform, while iris features are extracted by Curvelet transform. In order to reduce the complexity of the feature-level fusion, we propose a modified chaotic binary particle swarm optimization (MCBPSO) algorithm to select features. It uses kernel extreme learning machine (KELM) as a fitness function and chaotic binary sequences to initialize particle swarms. After the global optimal position (Gbest) is generated in each iteration, the position of Gbest is varied by using chaotic binary sequences, which is useful to realize chaotic local search and avoid falling into the local optimal position. The experiments are conducted on CASIA multimodal iris and face dataset from Chinese Academy of Sciences.The experimental results demonstrate that the proposed system can not only reduce the number of features to one tenth of its original size, but also improve the recognition rate up to 99.78%. Compared with the unimodal iris and face system, the recognition rate of the proposed system are improved by 11.56% and 2% respectively. The experimental results reveal its performance in the verification mode compared with the existing state-of-the-art systems. The proposed system is satisfactory in addressing face-iris multimodal biometric identification.

Continuous Multimodal Biometric Authentication Schemes: A Systematic Review

Building safeguards against illegitimate access and authentication is a cornerstone for securing systems. Existing user authentication schemes suffer from challenges in detecting impersonation attacks which leave systems vulnerable and susceptible to misuse. A range of research proposals have suggested continuous multimodal biometric authentication (CMBA) systems as a reliable solution. Though contemporary authentication systems have the potential to change their current authentication scheme, there is a lack of critical analysis of current progress in the field to foster and influence practical solutions. This paper provides a systematic survey of existing literature on CMBA systems, followed by analysis to identify and discuss current research and future trends. The study has found that many diverse biometric characteristics are used for multimodal biometric authentication systems. The majority of the studies in the literature reviewed apply supervised learning approaches as a classification technique, and score level fusion is predominantly used as a fusion model. The review has determined however that there is a lack of comparative analysis on CMBA design in terms of combinations of biometric types (behavioural only, physiological only, or both), machine learning algorithms (unsupervised learning and semi-supervised learning), and fusion models. Most of the studies evaluated a CMBA system’s accuracy functionality, such as False Acceptance Rate (FAR), False Rejection Rate (FRR) and Equal Error Rate (EER). However, security, scalability and usability (user acceptance and satisfaction) are generally not addressed thoroughly even though these are key factors for system success in a real deployment. Furthermore, a CMBA system should be implemented and evaluated extensively on real data without restriction to prove that such systems are feasible.

Feature-level fusion of major and minor dorsal finger knuckle patterns for person authentication

The identification of individuals by their finger dorsal patterns has become a very active area of research in recent years. In this paper, we present a multimodal biometric personal identification system that combines the information extracted from the finger dorsal surface image with the major and minor knuckle pattern regions. In particular, first the features are extracted from each single region by BSIF (binarized statistical image features) technique. Then, extracted information is fused at feature level. Fusion is followed by dimensionality reduction step using PCA (principal component analysis) + LDA (linear discriminant analysis) scheme in order to improve its discriminatory power. Finally, in the matching stage, the cosine Mahalanobis distance has been employed. Experiments were conducted on publicly available database for minor and major finger knuckle images, which was collected from 503 different subjects. Reported experimental results show that feature-level fusion leads to improved performance over single modality approaches, as well as over previously proposed methods in the literature.

Deep Learning Approach for Multimodal Biometric Recognition System Based on Fusion of Iris, Face, and Finger Vein Traits.

With the increasing demand for information security and security regulations all over the world, biometric recognition technology has been widely used in our everyday life. In this regard, multimodal biometrics technology has gained interest and became popular due to its ability to overcome a number of significant limitations of unimodal biometric systems. In this paper, a new multimodal biometric human identification system is proposed, which is based on a deep learning algorithm for recognizing humans using biometric modalities of iris, face, and finger vein. The structure of the system is based on convolutional neural networks (CNNs) which extract features and classify images by softmax classifier. To develop the system, three CNN models were combined; one for iris, one for face, and one for finger vein. In order to build the CNN model, the famous pertained model VGG-16 was used, the Adam optimization method was applied and categorical cross-entropy was used as a loss function. Some techniques to avoid overfitting were applied, such as image augmentation and dropout techniques. For fusing the CNN models, different fusion approaches were employed to explore the influence of fusion approaches on recognition performance, therefore, feature and score level fusion approaches were applied. The performance of the proposed system was empirically evaluated by conducting several experiments on the SDUMLA-HMT dataset, which is a multimodal biometrics dataset. The obtained results demonstrated that using three biometric traits in biometric identification systems obtained better results than using two or one biometric traits. The results also showed that our approach comfortably outperformed other state-of-the-art methods by achieving an accuracy of 99.39%, with a feature level fusion approach and an accuracy of 100% with different methods of score level fusion.

DeepKey

Biometric authentication involves various technologies to identify individuals by exploiting their unique, measurable physiological and behavioral characteristics. However, traditional biometric authentication systems (e.g., face recognition, iris, retina, voice, and fingerprint) are at increasing risks of being tricked by biometric tools such as anti-surveillance masks, contact lenses, vocoder, or fingerprint films. In this article, we design a multimodal biometric authentication system named DeepKey, which uses both Electroencephalography (EEG) and gait signals to better protect against such risk. DeepKey consists of two key components: an Invalid ID Filter Model to block unauthorized subjects, and an identification model based on attention-based Recurrent Neural Network (RNN) to identify a subject’s EEG IDs and gait IDs in parallel. The subject can only be granted access while all the components produce consistent affirmations to match the user’s proclaimed identity. We implement DeepKey with a live deployment in our university and conduct extensive empirical experiments to study its technical feasibility in practice. DeepKey achieves the False Acceptance Rate (FAR) and the False Rejection Rate (FRR) of 0 and 1.0%, respectively. The preliminary results demonstrate that DeepKey is feasible, shows consistent superior performance compared to a set of methods, and has the potential to be applied to the authentication deployment in real-world settings.

Hybridization for Classification and Identification of Individuals using Multimodal Biometric Systems

Biometric recognition systems use certain human characteristics such as voice, facial features, fingerprint, iris or hand geometry to identify an individual or verify their identity. These systems have been developed individually for each of these biometric modalities until they achieve remarkable levels of performance. Biometrics is a measure of biological characteristics for the identification or authentication of an individual based on some of its characteristics. Although biometric recognition techniques promise to be very effective, At present, we can not guarantee an excellent identification rate based on a single biometric signature with unimodal biometric systems. Thus the error rates of unimodal biometric systems are relatively high due to all these practical problems, which makes them impractical for the use of critical safety applications. To resolve these problems, a solution is used in the same system in several biometric modalities, called a multimodal biometric system (MBS). MBSs combine different modalities in a unique recognition system. The multimodal fusion allows improving the results obtained by a single biometric characteristic and making the system more robust to noise and interference and more resistant to possible attacks. Fusion may be carried out at the level of signals acquired by the different sensors, of the parameters obtained for each modality, of the scores provided by unimodal experts or of the decision taken by said experts. In the case of fusion, the features obtained from the various biometric methods must be homogenized before the process of fusion is accomplished. This article describes the evolution of a multi-modal biometric identification system depends on 3 biometrics-face, iris & fingerprint. Feature extraction is done using the Gabor Wavelet method and classification is accomplished using the Random Forest classifier. This proposed method is applicable in real-life applications to identify biometric for offices, hospitals, and colleges/universities and so on.

A multimodal biometric identification system based on cascade advanced of fingerprint, fingervein and face images

<p>In this paper, we present a multimodal biometric recognition system that combines fingerprint, fingervein and face images based on cascade advanced and decision level fusion. First, in fingerprint recognition system, the images are enhanced using gabor filter, binarized and passed to thinning method. Then, the minutiae points are extracted to identify that an individual is genuine or impostor. In fingervein recognition system, image processing is required using Linear Regression Line, Canny and local histogram equalization technique to improve better the quality of images. Next, the features are obtained using Histogram of Oriented Gradient (HOG). Moreover, the Convolutional Neural Networks (CNN) and the Local Binary Pattern (LBP) are applied to detect and extract the features of the face images, respectively. In addition, we proposed three different modes in our work. At the first, the person is identified when the recognition system of one single biometric modality is matched. At the second, the fusion is achieved at cascade decision level method based on AND rule when the recognition system of both biometric traits is validated. At the last mode, the fusion is accomplished at decision level method based on AND rule using three types of biometric. The simulation results have demonstrated that the proposed fusion algorithm increases the accuracy to 99,43% than the other system based on unimodal or bimodal characteristics.</p>

A multimodal biometric identification system based on cascade advanced of fingerprint, fingervein and face images

A multimodal biometric identification system based on cascade advanced of fingerprint, fingervein and face images

Multimodal Biometric Authentication System Using Modified ReliefF Feature Selection and Multi Support Vector Machine

Multimodal Biometric Authentication System Using Modified ReliefF Feature Selection and Multi Support Vector Machine

Image Analysis using Non Negative Matrix Factorization

Image analysis extracts the meaningful information from the images. This information is very much helpful to recognition and authentication. There are number of techniques available for image analysis. Image analysis can be used in analysis of the scene, image understanding and computer vision. Image analysis can be used in Medical image processing, Geology, optical character recognition and forensics. There are mainly four steps in the image analysis 1.image pre processing 2. Segmentation 3.feature extraction and 4. Classification and interpretation. Feature extraction is the main part for any image analysis. In this paper Multi modal biometric authentication system can be defined for security. In this process Non Negative Matrix Factorization (NMF) technique is used for feature extraction and for fusion Principle component analysis is used. After getting the features these can be encoding using Kronecker product. At the end Euclidean distance measure is used for authentication.

Convolutional neural networks approach for multimodal biometric identification system using the fusion of fingerprint, finger-vein and face images.

In recent years, the need for security of personal data is becoming progressively important. In this regard, the identification system based on fusion of multibiometric is most recommended for significantly improving and achieving the high performance accuracy. The main purpose of this paper is to propose a hybrid system of combining the effect of tree efficient models: Convolutional neural network (CNN), Softmax and Random forest (RF) classifier based on multi-biometric fingerprint, finger-vein and face identification system. In conventional fingerprint system, image pre-processed is applied to separate the foreground and background region based on K-means and DBSCAN algorithm. Furthermore, the features are extracted using CNNs and dropout approach, after that, the Softmax performs as a recognizer. In conventional fingervein system, the region of interest image contrast enhancement using exposure fusion framework is input into the CNNs model. Moreover, the RF classifier is proposed for classification. In conventional face system, the CNNs architecture and Softmax are required to generate face feature vectors and classify personal recognition. The score provided by these systems is combined for improving Human identification. The proposed algorithm is evaluated on publicly available SDUMLA-HMT real multimodal biometric database using a GPU based implementation. Experimental results on the datasets has shown significant capability for identification biometric system. The proposed work can offer an accurate and efficient matching compared with other system based on unimodal, bimodal, multimodal characteristics.

An Efficient Android-Based Multimodal Biometric Authentication System With Face and Voice

Multimodal biometric authentication method can conquer the defects of the unimodal biometric authentication technology. In this paper, we design and develop an efficient Android-based multimodal biometric authentication system with face and voice. Considering the hardware performance restriction of the smart terminal, including the random access memory (RAM), central processing unit (CPU) and graphics processor unit (GPU), etc., which cannot efficiently accomplish the tasks of storing and quickly processing the large amount of data, a face detection method is introduced to efficiently discard the redundant background of the image and reduce the unnecessary information. Furthermore, an improved local binary pattern (LBP) coding method is presented to improve the robustness of the extracted face feature. We also improve the conventional endpoint detection technology, i.e. the voice activity detection (VAD) method, which can efficiently increase the detection accuracy of the voice mute and transition information and boost the voice matching effectiveness. To boost the authentication accuracy and effectiveness, we present an adaptive fusion strategy which organically integrates the merits of the face and voice biometrics simultaneously. The cross-validation experiments with public databases demonstrate encouraging authentication performances compared with some state-of-the-art methods. Extensive testing experiments on Android-based smart terminal show that the developed multimodal biometric authentication system achieves perfect authentication effect and can efficiently content the practical requirements.

Fusion Time Reduction of a Feature Level Based Multimodal Biometric Authentication System

In the present study, a multimodal biometric authentication method is presented to confirm the identity of a person based on his face and iris features. This method depends on multiple biometric techniques that combine face and iris (left and right) features to recognize. The authors have designed and applied a system to identify people. It depends on extracting the features of the face using Rectangle Histogram of Oriented Gradient (R-HOG). The study applies a feature-level fusion using a novel fusion method which employs both the canonical correlation process and the proposed serial concatenation. A deep belief network was used for the recognition process. The performance of the proposed systems was validated and evaluated through a set of experiments on SDUMLA-HMT database. The results were compared with others, and have shown that the fusion time has been reduced by about 34.5%. The proposed system has also succeeded in achieving a lower equal error rate (EER), and a recognition accuracy up to 99%.

A Robust Multimodal Biometric System VIA Multiple Svms

Generally single Support Vector Machine (SVM) is employed in existing multimodal biometric authentication techniques, and it assumes that whole set of the classifiers is available. But sometimes it is not possible due to some circumstances e.g. injury, some medical treatment etc. This paper includes a robust multimodal biometric authentication system that integrates FKP (Finger-Knuckle Print), face and fingerprint at matching score level fusion using multiple parallel Support Vector Machines (SVMs). Multiple SVMs are applied to overcome the problem of missing biometric modality. Every possible combination of three modalities (FKP, face and fingerprint) are taken into consideration and all combinations have a corresponding SVM to fuse the matching scores and produce the final score set for decision making. Proposed system is more flexible and robust as compared to existing multimodal biometric system with single SVM. The average accuracy of proposed system is estimated on a publicly available dataset with the use of MUBI tool(Multimodal Biometrics Integration tool) and MATLAB 2017b.

LVID: A Multimodal Biometrics Authentication System on Smartphones

Voice authentication is becoming increasingly popular, which offers potential benefits over knowledge and possession based authentication methods. Meanwhile, the unique features of lip movements during speaking have been proved to be useful for authentication. However, the unimodal biometric authentication systems based on either voice or lip movements have certain limitations. Voice authentication systems are prone to spoofing attacks and suffer from serious performance degradation in noisy environments. Lip movements authentication systems are unstable and are sensitive to the user’s physical and psychological conditions. In this paper, we propose and implement LVID, a multimodal biometrics authentication system on smartphones, which resolves the defects of the original systems by combining the advantages of lip movements and voice. LVID simultaneously captures these two biometrics with the built-in audio devices on smartphones and fuses them at the data level. The reliable and effective features are then extracted from the fused data for authentication. LVID is practical as it requires neither cumbersome operations nor additional hardwares but only a speaker and a microphone that are commonly available on smartphones. Our experimental results with 104 participants show that LVID can achieve 95% accuracy for user authentication, and 93.47% of the attacks can be detected. It is also verified that LVID works well with different smartphones and is robust to different smartphone positions.

RETRACTED ARTICLE: Multi-modal biometric authentication system based on face and signature using legion feature estimation technique

In biometrics, picking of the right methodology is a testing errand for recognition of a person. Due to the advantage of widely accepted identification, face, and signature-based biometric modality are selected as a significant pattern as compared with other modalities. Different Face and signature successions of a similar subject may contain varieties in determination, light, pose, facial appearances and sign position. These varieties add to the difficulties in planning a viable multimodal-based face and signature recognition algorithm. This paper proposed about the face and signature recognition method from a large dataset with the different pose and multiple features. Face recognition is the first stage of a system then the signature verification will be done. Here, data glove signaling means of signing process are taken into account to do signature verification system. Hence the proposed work have used Face, and the corresponding signature is detected from data glove signal patterns to features-level fusion for the verification system. The proposed Legion feature based verification method will be developed using four important steps like, i) Preprocessing, ii) feature extraction from face and data glove signals, iii) Legion feature based feature matching through Euclidean distance, iv) Legion feature Neural network (LFNN) fusion based on weighted summation formulae where two weights will be optimally found out using Legion optimization algorithm, vi) Recognition based on the final score. Finally, based on the feature library the face image and signature can be recognized. The comparability estimation is finished by utilizing least Euclidean separation fusion based LFNN to decide perceived and non-perceived images. Also, in a similar examination, a proposed strategy is compared with current technique by several performance metrics and the proposed LFNN technique efficiently recognize the face images and corresponding signature from the input databases than the existing technology.

An accurate multi-modal biometric identification system for person identification via fusion of face and finger print

Internet of things (IoT) have entirely revolutionized the industry. However, the cyber-security of IoT enabled cyber-physical systems is still one of the main challenges. The success of cyber-physical system is highly reliant on its capability to withstand cyberattacks. Biometric identification is the key factor responsible for the provision of secure cyber-physical system. The conventional unimodal biometric systems do not have the potential to provide the required level of security for cyber-physical system. The unimodal biometric systems are affected by a variety of issues like noisy sensor data, non-universality, susceptibility to forgery and lack of invariant representation. To overcome these issues and to provide higher-security enabled cyber-physical systems, the combination of different biometric modalities is required. To ensure a secure cyber-physical system, a novel multi-modal biometric system based on face and finger print is proposed in this work. Finger print matching is performed using alignment-based elastic algorithm. For the improved facial feature extraction, extended local binary patterns (ELBP) are used. For the effective dimensionality reduction of extracted ELBP feature space, local non-negative matrix factorization is used. Score level fusion is performed for the fusion. Experimental evaluation is done on FVC 2000 DB1, FVC 2000 DB2, ORL (AT&T) and YALE databases. The proposed method achieved a high recognition accuracy of 99.59%.

Adaptive fuzzy genetic algorithm for multi biometric authentication

Biometric Authentication (BA) has turn out to be presently as key problem in privacy and security. Multimodal biometric system specializes in enhancing verification overall performance of the users for authentication. On this direction, biometrics which is the computer-based validation of an individuals’ identification is turning into increasingly more vital, particularly for high security systems. The spirit of biometrics is the size of character’s behavioral or physiological characteristics; it allows authentication of someone’s identity. Biometric-based totally authentication is likewise turning into increasingly more essential in computer based applications because the quantity of touchy records saved in such structures is growing. The latest needs of biometric systems are robustness, high reputation quotes, capability to handle imprecision, uncertainties of non-statistical kind and magnanimous flexibility. Its miles precisely right here that, the role of soft computing techniques involves vital play. The primary aim of this write-up is to offer a practical view on applications of soft computing strategies in biometrics and to analyze its impact. It is found that soft computing has already made inroads in phrases of man or woman techniques or in combination. This paper additionally proposes as hybrid soft computing based optimization device named “Adaptive Fuzzy Genetic Algorithm (AFGA)” which is adaptable to all of the unimodal and multimodal biometric authentication system. The results acquired by means of this device insure high standard of verification via multi-modal biometrics fusion by means of powerful functionality of fuzzy logic. Experimental investigation under various biometric data conditions exhibits notable effects over current strategies.

RSA Cryptography based Multi-Modal Biometric Identification System for High-Security Application

RSA Cryptography based Multi-Modal Biometric Identification System for High-Security Application