Genre Classification Research Articles

Research on music genre recognition method based on deep learning

In this paper, we explore music genre recognition using deep learning methods, examining the application of feature extraction, model construction, and performance evaluation for different music genres. During the data preparation and preprocessing stages, data augmentation and normalization techniques were employed to enhance the model’s generalization capabilities. By constructing multilayer convolutional neural networks (CNNs) and recurrent neural networks (RNNs), we achieved automatic recognition of music genres. In the experimental results analysis, we compared the accuracy and training time of different models, validating the effectiveness of deep learning in the field of music genre recognition. The limitations of deep learning methods and future research directions are also discussed, providing a reference for further studies in music information processing. This study delves into the issue of music genre recognition and proposes a deep learning-based approach. This method leverages neural networks to extract features and learn from audio data, enabling accurate classification of different music genres. Extensive experiments have demonstrated that our method achieves highly satisfactory results in music genre recognition tasks. Furthermore, we optimized the deep learning models, improving their generalization capabilities and accuracy. Our research offers the music industry an efficient and accurate method for music genre recognition, providing new perspectives and technical support for research and applications in the music field.

Audio feature enhancement based on quaternion filtering and deep hashing

This paper aims to solve the problems of difficult convergence of audio model training, large data demand, and large dimensionality of storage space for audio-generated feature vectors. To this end, this paper proposes the use of quaternion Gabor filtering to suppress the background information of the spectrogram and reduce the interference of the data for the case of insufficient data alignment between audio data and image data after shifting the domain. In addition, different scales of window lengths and frame shifts are used to capture the connections between different vocal objects. To address the problem that the generated feature vectors are large dimensional, we use a deep hash module to map high-dimensional features to low-dimensional features and use a probability function to make the learned samples more consistent with the overall distribution. In the experimental evaluation, the proposed method was evaluated on the environmental sound classification dataset and the music genre classification dataset. The proposed method uses only a common backbone network and improves the accuracy of audio recognition.

A Deep Learning Approach for Automatic Music Genre Classification

A Deep Learning Approach for Automatic Music Genre Classification

Natur – Geschichte – Schreibung - Die Grenzsituation der <i>Naturalis Historia</i> von Plinius dem Älteren

According to the preface, Pliny’s Natural History belongs to the genre of historia, of which subject is the nature. At the same time, the preface offers other genre classifications as well: encyclios paideia, thaesaurus. Pliny himself points out the novelty of his work: Libros naturalis historiae […] novicium opus (praef. 1.). Regarding Pliny’s peculiar concept of nature, in terms of the genre and literary history, Natural History can be interpreted as a borderline case.

Movie trailer genre classification using multimodal pretrained features

We introduce a novel method for movie genre classification, capitalizing on a diverse set of readily accessible pretrained models. These models extract high-level features related to visual scenery, objects, characters, text, speech, music, and audio effects. To intelligently fuse these pretrained features, we train small classifier models with low time and memory requirements. Employing the transformer model, our approach utilizes all video and audio frames of movie trailers without performing any temporal pooling, efficiently exploiting the correspondence between all elements, as opposed to the fixed and low number of frames typically used by traditional methods. Our approach fuses features originating from different tasks and modalities, with different dimensionalities, different temporal lengths, and complex dependencies as opposed to current approaches. Our method outperforms state-of-the-art movie genre classification models in terms of precision, recall, and mean average precision (mAP). To foster future research, we make the pretrained features for the entire MovieNet dataset, along with our genre classification code and the trained models, publicly available.

A Hybrid Parallel Computing Architecture Based on CNN and Transformer for Music Genre Classification

Music genre classification (MGC) is the basis for the efficient organization, retrieval, and recommendation of music resources, so it has important research value. Convolutional neural networks (CNNs) have been widely used in MGC and achieved excellent results. However, CNNs cannot model global features well due to the influence of the local receptive field; these global features are crucial for classifying music signals with temporal properties. Transformers can capture long-range dependencies within an image thanks to adopting the self-attention mechanism. Nevertheless, there are still performance and computational cost gaps between Transformers and existing CNNs. In this paper, we propose a hybrid architecture (CNN-TE) based on CNN and Transformer encoder for MGC. Specifically, we convert the audio signals into mel spectrograms and feed them into a hybrid model for training. Our model employs a CNN to initially capture low-level and localized features from the spectrogram. Subsequently, these features are processed by a Transformer encoder, which models them globally to extract high-level and abstract semantic information. This refined information is then classified using a multi-layer perceptron. Our experiments demonstrate that this approach surpasses many existing CNN architectures when tested on the GTZAN and FMA datasets. Notably, it achieves these results with fewer parameters and a faster inference speed.

Automatic movie genre classification & emotion recognition via a BiProjection Multimodal Transformer

Analyzing, manipulating, and comprehending data from multiple sources (e.g., websites, software applications, files, or databases) and of diverse modalities (e.g., video, images, audio and text) has become increasingly important in many domains. Despite recent advances in multimodal classification (MC), there are still several challenges to be addressed, such as: the combination of modalities of very diverse nature, the optimal feature engineering for each modality, as well as the semantic alignment between text and images. Accordingly, the main motivation of our research relies in devising a neural architecture that effectively processes and combines text, image, video and audio modalities, so it can offer a noteworthy performance in different MC tasks. In this regard, the Multimodal Transformer (MulT) model is a cutting-edge approach often employed in multimodal supervised tasks, which, although effective, has the problem of having a fixed architecture that limits its performance in specific tasks as well as its contextual understanding, meaning it may struggle to capture fine-grained temporal patterns in audio or effectively model spatial relationships in images. To address these issues, our research modifies and extends the MulT model in several aspects. Firstly, we focus on leveraging the Gated Multimodal Unit (GMU) module within the architecture to efficiently and dynamically weigh modalities at the instance level and to visualize the use of modalities. Secondly, to overcome the problem of vanishing and exploding gradients we focus on strategically placing residual connections in the architecture. The proposed architecture is evaluated in two different and complex classification tasks, on the one hand, the movie genre categorization (MGC) and, on the other hand, the multimodal emotion recognition (MER). The results obtained are encouraging as they indicate that the proposed architecture is competitive against state-of-the-art (SOTA) models in MGC, outperforming them by up to 2% on the Moviescope dataset, and by 1% on the MM-IMDB datasets. Furthermore, in the MER task the unaligned version of the datasets was employed, which is considerably more difficult; we improve accuracy SOTA results by up to 1% on the IEMOCAP dataset, and attained a competitive outcome on the CMU-MOSEI11Dai et al., (2021) collection, outperforming SOTA results in several emotions.

Writing the mire – ‘for we are loom’

ABSTRACT In this essay, I am in-conversation with Proust was a Neuroscientist, by Jonah Lehrer [2008, Proust was a Neuroscientist. New York: Houghton Mifflin Company]. I engage with Lehrer’s chapters focusing Marcel Proust, Virginia Woolf and Paul Cézanne. This essay is a contribution to an ongoing conversation with Professors Kate Coles and Jen Webb regarding the distinctions, or lack thereof, between narrative and the lyric, within the context of broader discussions about genre classifications (Great Writing 2023, 2024). In this essay, I respond to Coles and Webb’s provocative question: What is it you mean, they ask, when you use the term realism? I consider this question from a practice-led perspective, as a writer who loves to read, and a writer-researcher who is drawn to neuro-psychoanalytic approaches to writing and creativity. I’m drawn to the quagmire of memory, as a primary source of stimulus for creative practice. My understanding of what I have come to call narrative lyricism is that it is a form of writing in which narrative may exist in ghost. Its incompleteness (if evaluated within traditional expectations of complication and dénouement) reflects the complicated (which is to say entangled) nature of the operations of memory.

Music genre classification: Machine Learning on GTZAN

Music genre classification: Machine Learning on GTZAN

Enhancing text-audio generation by music classification and Retrieval-Augmented Generation

Recent advancements in deep learning have propelled the development of AI systems capable of generating music that resonates with human emotions and preferences. However, current music generation models still struggle to align generated music with detailed textual descriptions and maintain consistency, especially for longer compositions. This paper presents an innovative approach to address these challenges by integrating genre classification and retrieval-augmented generation (RAG) into the music generation pipeline. We train advanced CNN architectures, including ResNet-50, GoogleNet, and VGG16, for accurate genre classification. The classifier is then incorporated into a RAG framework, where the most relevant pre-classified music piece is retrieved based on the input text query. The retrieved audio and the text description are then fed into the MUSICGEN model to generate a new music piece that inherits attributes from both inputs. We evaluate our system through a double-blind human study, comparing the outputs of the original MUSICGEN model with our RAG-enhanced model. The results demonstrate a significant improvement in the ability of the RAG-enhanced model to generate music embodying specific stylistic elements, as evidenced by higher average confidence scores from participants. Our work represents a significant step towards more personalized and context-aware AI-generated musical experiences, laying the foundation for future advancements in this exciting field.

An improved random forest model for music genre classification algorithm based on sparrow search algorithm

In this study, a random forest model optimised based on the sparrow search algorithm is explored for the music genre classification problem. By introducing the sparrow search algorithm, the model is able to search the feature space more comprehensively during the training process, which improves the learning ability of complex data relationships. After 15 iterations of optimisation, the fitness value of the model is improved from 0.2002 to 0.197, showing better convergence. The performance on the training set shows that the model predicts 2,543 music genres with an accuracy of 99.59% and only 10 incorrect predictions, which verifies its excellent performance on the training data. While on the test set, the model's prediction accuracy for 623 music genres is 79.78%, which is slightly lower than the result of the training set, but still reflects good generalisation ability. The results of this paper imply that the improved random forest model based on the sparrow search algorithm has potential application prospects in the music genre classification task. By optimising the parameter settings and feature selection, we not only improve the prediction accuracy and generalisation ability of the model, but also provide new ideas for solving other complex data classification problems. In the future, we can further expand the sample size, try different feature combinations, and conduct in-depth research by combining more domain knowledge in order to further improve the model performance and promote the development of related fields.

Film Genre Classification Based on Poster Using Convolutional Neural Network

Film Genre Classification Based on Poster Using Convolutional Neural Network

The implementation of a proposed deep-learning algorithm to classify music genres

Abstract To improve the classification effect of music genres in the digital music era, the article employs deep-learning algorithms to improve the performance of the classification of music genres. An auxiliary (estimated) model is constructed to estimate the amount of unmeasured data in the dual-rate system to enhance the recognition effect of music features. Moreover, a dual-rate output error model to identify such impacts is proposed to eliminate the impact of corrupt data caused by the estimation, which eventually leads to the further improvement of the proposed model called dual-rate multi-innovation forgetting gradient algorithm based on the auxiliary model. In addition, the article employs linear time-varying forgetting factors to improve the stability of the system, advances the recognition effect of music features through enhancement processing, and combines a deep-learning algorithm to construct a classification system of music genres. The result shows that the classification of the music genre system based on a deep-learning algorithm has a good music genre classification effect.

Rigdelet neural network and improved partial reinforcement effect optimizer for music genre classification from sound spectrum images

In this paper, a new approach has been introduced for classifying the music genres. The proposed approach involves transforming an audio signal into a unified representation known as a sound spectrum, from which texture features have been extracted using an enhanced Rigdelet Neural Network (RNN). Additionally, the RNN has been optimized using an improved version of the partial reinforcement effect optimizer (IPREO) that effectively avoids local optima and enhances the RNN's generalization capability. The GTZAN dataset has been utilized in experiments to assess the effectiveness of the proposed RNN/IPREO model for music genre classification. The results show an impressive accuracy of 92 % by incorporating a combination of spectral centroid, Mel-spectrogram, and Mel-frequency cepstral coefficients (MFCCs) as features. This performance significantly outperformed K-Means (58 %) and Support Vector Machines (up to 68 %). Furthermore, the RNN/IPREO model outshined various deep learning architectures such as Neural Networks (65 %), RNNs (84 %), CNNs (88 %), DNNs (86 %), VGG-16 (91 %), and ResNet-50 (90 %). It is worth noting that the RNN/IPREO model was able to achieve comparable results to well-known deep models like VGG-16, ResNet-50, and RNN-LSTM, sometimes even surpassing their scores. This highlights the strength of its hybrid CNN–Bi-directional RNN design in conjunction with the IPREO parameter optimization algorithm for extracting intricate and sequential auditory data.

The tangled ways to classify games: A systematic review of how games are classified in psychological research.

In the face of the rapid evolution of the gaming market and the puzzling overlap of genres, consistency in classification seems elusive. The purpose of the present review was to explore the classification of video game genres in the context of psychological research. The aim was to address the challenges associated with creating consistent and meaningful classifications of video game genres, considering the rapid evolution of the gaming market and recent tendency to create games that could be classified into multiple genres. We performed a search in four databases according to the PRISMA guidelines and reviewed 96 full-text papers (N = 49 909). Through our findings, we reveal how researchers strive to classify genres and the numerous complications that arise from this pursuit. In the face of these challenges, we propose alternative ways of classifying genres. Our first proposal is a new classification of video game genres based on our literature review. In our second proposal, we advocate a more detailed understanding by focusing on specific gaming mechanics, and thus we introduce the innovative concept of utilizing community-based tags, such as Steam tags, as an alternative to genres in psychological research.

Exploration of Speech and Music Information for Movie Genre Classification

Movie genre prediction from trailers is mostly attempted in a multi-modal manner. However, the characteristics of movie trailer audio indicate that this modality alone might be highly effective in genre prediction. Movie trailer audio predominantly consists of speech and music signals in isolation or overlapping conditions. This work hypothesizes that the genre labels of movie trailers might relate to the composition of their audio component. In this regard, speech-music confidence sequences for the trailer audio are used as a feature. In addition, two other features previously proposed for discriminating speech-music are also adopted in the current task. This work proposes a time and channel Attention Convolutional Neural Network (ACNN) classifier for the genre classification task. The convolutional layers in ACNN learn the spatial relationships in the input features. The time and channel attention layers learn to focus on crucial timesteps and CNN kernel outputs, respectively. The Moviescope dataset is used to perform the experiments, and two audio-based baseline methods are employed to benchmark this work. The proposed feature set with the ACNN classifier improves the genre classification performance over the baselines. Moreover, decent generalization performance is obtained for genre prediction of movies with different cultural influences (EmoGDB).

Genre Classification of Books in Russian with Stylometric Features: A Case Study

Within the literary domain, genres function as fundamental organizing concepts that provide readers, publishers, and academics with a unified framework. Genres are discrete categories that are distinguished by common stylistic, thematic, and structural components. They facilitate the categorization process and improve our understanding of a wide range of literary expressions. In this paper, we introduce a new dataset for genre classification of Russian books, covering 11 literary genres. We also perform dataset evaluation for the tasks of binary and multi-class genre identification. Through extensive experimentation and analysis, we explore the effectiveness of different text representations, including stylometric features, in genre classification. Our findings clarify the challenges present in classifying Russian literature by genre, revealing insights into the performance of different models across various genres. Furthermore, we address several research questions regarding the difficulty of multi-class classification compared to binary classification, and the impact of stylometric features on classification accuracy.

StreamBoostE: A Hybrid Boosting-Collaborative Filter Scheme for Adaptive User-Item Recommender for Streaming Services

With home entertainment, selecting the perfect movie is a pervasive challenge, amplified by many streaming platforms like Netflix and Amazon Prime. This study advances a movie recommender system with collaborative filtering approach as implemented in Python titled StreamBoostE. We used the user-based and item-based similarity schemes on feature embedding to aid faster model construction and training for the tree-based gradient boosting ensemble. Employing both user- and item-based collaborative filtering with cosine similarity to ease feature embedding, the system assesses movies inter-relations via personalized user interest and preferences as submitted user titles with a focus on movie genre classification. Results shows the ensemble yields a recommender prediction accuracy of 0.9984 with F1 of 0.996. The major contribution of StreamBoostE is in its capability to expedite the movie selection process when integrated using flask API and streamlit for cross-channel integration in web-based platforms. It presents users with a list of top-10 recommended movies by genre similarity. The XGBoost ensemble performed best with the user-/item-based collaborative filtering scheme fused with feature embedding approach as a sampling method. Keywords: Random Forest, SMOTE, credit card fraud detection, feature selection, imbalanced dataset Aims Research Journal Reference Format: Atuduhor, R.R., Okpor, M.D., Yoro, R.E., Odiakaose, C.C., Emordi, F.U., Ojugo, A.A., Ako, R.E., Geteloma, V.O., Ejeh, P.O., Abere, R.A., Ifioko, A.M., & Brizimor, S.E. (2024): StreamBoostE: A Hybrid Boosting-Collaborative Filter Scheme for Adaptive User-Item Recommender for Streaming Services. Advances in Multidisciplinary and Scientific Research Journal Vol. 10. No. 2. Pp 89-106. www.isteams.net/aimsjournal. dx.doi.org/10.22624/AIMS/V10N2P8

Performance Analysis of Deep Learning and Machine Learning Methods for Music Genre Classification System

Classification plays a crucial role in numerous applications within the music industry, spanning from content management to personalized playlists and music recommendation systems. While previous research has explored various machine learning frameworks for this purpose, such as support vector machines (SVM), a comprehensive comparison analysis of convolutional neural networks (CNN) and k-nearest neighbor (KNN) remains unknown. This study aims to address this gap by analyzing and contrasting the performance of SVM, KNN, and CNN in music genre classification. Each algorithm was carefully trained using different music genres from a protected dataset, employing feature extraction methods to capture the appropriate qualities of audio signals. The models underwent extensive training with a limited number of samples, and their performance was evaluated using industry standards such as accuracy, precision, recall, and F1 scores. Experimental results included SVM, KNN, and CNN for music genre designation. This study contributes significantly to existing literature by providing a comparative analysis of these algorithms. The findings highlight the strengths and limitations of each approach, offering guidance for researchers and practitioners in choosing the most suitable approach for their specific needs. The insights gained from this research have the potential to enhance music genre classification systems, ultimately improving the user experience across various music-related contexts.

Analysis of Building the Music Feature Extraction Systems: A Review

Music genre classification is a basic method for sound processing in the field of music retrieval. The application of machine learning has become increasingly popular in automatically classifying music genres. Therefore, in recent years, many methods have been studied and developed to solve this problem. In this article, an overview on the process and some music feature extraction methods is presented. Here, the feature extraction method using Mel Frequency Cepstral Coefficients (MFCC) is discussed in detail. Some typical results in using Mel Frequency Cepstral Coefficients for improving accuracy in the classification process are introduced and discussed. Therefore, the feature extraction method using MFCC has shown its suitability due to high accuracy and has much potential for further research and development.