Abstract
As the scale of the film industry grows, the demand for well-established movie databases is also growing. The genre of a movie supplies information on its overall content and has multiple values. Therefore, it should be well classified utilizing the characteristics of movies, without omissions in the database. In this study, we extract the optimal information and characteristics from movie posters to aid the classification of movies into genres and propose the use of a Gram layer in a convolutional neural network (CNN). The Gram layer first extracts style features by applying the Gram matrix to produce a feature map of a poster image. Using this as a style weight, the existing feature map is merged with style information to perform the genre classification task. The proposed Gram layer performed multi-genre classification tasks with higher efficiency than a residual neural network (ResNet), which is the current CNN model used for such tasks. We compared the activation map with the Squeeze-and-Excitation network, which gives weight to the image, and we confirmed that the introduction of the Gram layer actually focuses on the style of the movie poster. To classify the movie genres, we reconstructed the poster dataset into 12 multi-genres that emphasized the characteristics of each poster.
Highlights
The scale of the global film industry is significantly growing every year, and the methods which it distributes content have undergone substantial changes
We propose a Gram layer that captures the correlation between posters and genres: The Gram layer can be used for the performance of multiple movie genre classification models
This study proposes a method of classifying movie posters into multi-label genres by utilizing a Gram layer
Summary
The scale of the global film industry is significantly growing every year, and the methods which it distributes content have undergone substantial changes. Several databases use a combination of genre personality and movie characteristics to achieve genre classification, this method may create ambiguity regarding genres and inconsistency in the total number of genres. A movie poster is not an image but a well-planned delivery and promotion medium, designed to convey the overall content of the movie It has the advantage of containing rich visual features about the movie, using various elements such as background, characters, and typography. For these reasons, many previous studies have attempted genre classification using posters.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
