3D Transparent Object Detection and Reconstruction Based on Passive Mode Single-Pixel Imaging.

Anumol Mathai,Xin Wang,Ningqun Guo,Dong Liu

doi:10.3390/s20154211

Anumol Mathai, Xin Wang + Show 2 more

Open Access

https://doi.org/10.3390/s20154211

Copy DOI

Abstract

Transparent object detection and reconstruction are significant, due to their practical applications. The appearance and characteristics of light in these objects make reconstruction methods tailored for Lambertian surfaces fail disgracefully. In this paper, we introduce a fixed multi-viewpoint approach to ascertain the shape of transparent objects, thereby avoiding the rotation or movement of the object during imaging. In addition, a simple and cost-effective experimental setup is presented, which employs two single-pixel detectors and a digital micromirror device, for imaging transparent objects by projecting binary patterns. In the system setup, a dark framework is implemented around the object, to create shades at the boundaries of the object. By triangulating the light path from the object, the surface shape is recovered, neither considering the reflections nor the number of refractions. It can, therefore, handle transparent objects with a relatively complex shape with the unknown refractive index. The implementation of compressive sensing in this technique further simplifies the acquisition process, by reducing the number of measurements. The experimental results show that 2D images obtained from the single-pixel detectors are better in quality with a resolution of . Additionally, the obtained disparity and error map indicate the feasibility and accuracy of the proposed method. This work provides a new insight into 3D transparent object detection and reconstruction, based on single-pixel imaging at an affordable cost, with the implementation of a few numbers of detectors.

Highlights

Many practical activities in industry, such as automatic inspection, oceanology, fluid mechanism, and computer graphics, often require imaging of three-dimensional shapes of invisibles
This work provides a new insight into 3D transparent object detection and reconstruction, based on single-pixel imaging at an affordable cost, with the implementation of a few numbers of detectors
We present a fixed multi-viewpoint 3D transparent object inspection system, based on passive mode single-pixel imaging

Summary

Introduction

Many practical activities in industry, such as automatic inspection, oceanology, fluid mechanism, and computer graphics, often require imaging of three-dimensional shapes of invisibles. SPI has been widely used in myriad applications, such as infrared imaging [13], gas imaging [14], photoacoustic imaging [15], three-dimensional imaging [16,17,18], terahertz imaging [19,20], X-ray diffraction tomography [21], remote sensing [22], encrypted imaging [23], lensless imaging [24], shadowless imaging [25], hyperspectral imaging [26], microscopy [27], and scattering imaging [28] In this imaging modality, a single-pixel detector that has no spatial resolution can detect the object by means of a modulated structured light [29]. Three-dimensional image reconstruction approaches, such as time-of-flight (TOF), binocular vision, photometric stereo, and shape-from-X techniques can estimate the depth information of opaque objects. Salvador-Balaguer et al [44] implemented a basic active single-pixel imaging system to image opaque objects They used reflected light from the object and processed it, based on an adaptive compressive algorithm for image reconstruction.

Experimental Setup

Schematic of

Disparity

Findings

Conclusions