Multimedia processing using deep learning technologies, high‐performance computing cloud resources, and Big Data volumes

Abstract

SummaryThe last few years have been marked by the presence of very large sets of images and videos in our everyday lives. These multimedia objects have a very fast frequency of creation and sharing since images and videos can come from different devices such as smartphones, satellites, cameras, or drones. They are generally used to illustrate objects in different situations (public areas, train stations, hospitals, political and sport events and competitions, etc). As consequence, image and video processing algorithms have got increasing importance for several computer vision applications that should be adapted for managing large‐scale volumes and exploiting high performance computing resources (local or cloud). In this work, we propose a cloud‐based toolbox (platform) for computer vision applications. This platform integrates a toolbox of image and video processing algorithms that can (i) exploit high performance computing cloud resources, (ii) execute applications in real time, and (iii) manage large‐scale database using Big Data technologies. The related libraries and hardware drivers are automatically integrated and configured in order to offer to users an access to the different applications without the need to download, install, and configure software or hardware. Experiments were conducted using three kinds of applications: (i) image and video processing applications, (ii) deep learning techniques for images classification and multiobject localization, and (iii) images indexation and retrieval. These experiments demonstrated the interest of our platform for sharing, in an efficient way, our scientific contributions and annotated databases in order to improve the quality and performance of computer vision applications.