Gender identification from video is an emerging research field that aims to automatically classify the gender of individuals based on video data. Due to the numerous applications for this task, it has received a lot of attention, including surveillance, human-computer interaction, and targeted marketing. In this study, we propose a gender identification system that utilizes the Pelican optimizer algorithm in combination with a Support Vector Machine (SVM) classifier. The Pelican optimizer is a metaheuristic algorithm inspired by the hunting behaviour of pelicans and has shown promising results in solving optimization problems. Pelican optimizer algorithm (POA) is applied to optimize the SVM parameter selection process such as kernel function. The POA algorithm searches for an optimal subset of parameters that maximizes the classification performance of the SVM model after the application of preprocessing and feature extraction techniques such as Local Binary Pattern (LBP). Finally, the selected optimized parameters otherwise known as POA-SVM classifier learns a decision boundary based on the labeled training data. The POA-SVM model is trained to distinguish between male and female samples and generalize the classification to unseen video data. Experimental evaluations are conducted using a benchmark dataset consisting of video samples with labelled gender information. The effectiveness of the suggested system is contrasted with other cutting-edge gender identification techniques. The results demonstrate the effectiveness of the Pelican Optimization Algorithm-SVM system, showing improved accuracy of 95%, and sensitivity of 94.4% at a faster recognition rate in gender classification from video data.