Background removal of video in realtime

Abstract

Background removal for video is a computer-vision based system to remove the background from a video with ease. Creating a professional background when at home, i.e., not in a very professional environment, can be a tedious task. Not everyone has time to learn editing and the technicalities involved in having an entire setup for creating a sophisticated background and it is not practical that normal people buy green screens or blue screens just for their everyday formal meets. Our goal is to create a quick and easy solution to that by removing background in real time while also maintaining the quality of the call, having the additional benefit of adding custom backgrounds and enabling users to add effects like adjust lighting, contrast etc., we are combining all 4-5 steps in 1 single step. SelfieSegmentation module of Mediapipe helps us achieve this. The Selfie Segmentation API creates an output mask from an input image. The mask will be the same size as the input image by default. A float integer with a range of [0.0, 1.0] is assigned to each pixel of the mask. The higher the confidence that the pixel depicts a person, and vice versa, the closer the number is to 1.0.