Customized 3D Clothes Modeling for Virtual Try-on System based on Multiple Kinects

Abstract

Most existing 3D virtual try-on systems put clothes designed in one environment on a human captured in another environment, which cause the mismatching brightness problem. And also typical 3D clothes modeling starts with manually designed 2D patterns, deforms them to fit on a human, and applies stitching to sew those patterns together. Such work usually relies on labour work. In this paper, we describe an approach to reconstruct clothes and human that both are from the same space. With multiple Kinects, it models the 3D clothes directly out of a dressed human without the need of the predefined 2D clothes patterns, and fits them to a human user. Our approach has several advantages: (1) a simple hardware setting consisted of multiple Kinects to capture a human model; (2) 3D clothes modeling directly out of captured human model. To the best of our knowledge, our work is the first one which separates clothes out of captured human figures; (3) resizing of clothes adapting to any sized human user; (4) a novel idea of virtual try-on where clothes and human are captured in the same location.