Item‐to‐item recommender system with simultaneous use of multiple images for image mosaicking creation in dynamic scenes

Abstract

Image mosaicking is a series of successive algorithms that use a sequence of images or a video of a scene to create a single image with a wider field of view of the whole scene. In most cases, when dynamic objects exist in the input data, issues, such as ghosting, parallax effects or object duplication, are visible in the resulting mosaic. These technical errors appear when the objects in motion aren't properly treated. In order to create good result mosaics, a new method is presented in this paper. The proposed approach uses all the images at the same time to divide the images into different areas by using k-means clustering to create categories, then each category is recommended from the original images with a recommender system. In fact, by considering each image as a user, each pixel as an item, and each item belonging to a category, it is possible to use a recommender system by computing scores with the item profiles. The resulting mosaic will then be a new user to the system. Furthermore, by clustering the images, projection errors are avoided and a better quality mosaic can be created as is seen in the obtained results.