Multi-view Fusion Research Articles

A Reliable People Counting System via Multiple Cameras

Reliable and real-time people counting is crucial in many applications. Most previous works can only count moving people from a single camera, which cannot count still people or can fail badly when there is a crowd (i.e., heavy occlusion occurs). In this article, we build a system for robust and fast people counting under occlusion through multiple cameras. To improve the reliability of human detection from a single camera, we use a dimensionality reduction method on the multilevel edge and texture features to handle the large variations in human appearance and poses. To accelerate the detection speed, we propose a novel two-stage cascade-of-rejectors method. To handle the heavy occlusion in crowded scenes, we present a fusion method with error tolerance to combine human detection from multiple cameras. To improve the speed and accuracy of moving people counting, we combine our multiview fusion detection method with particle tracking to count the number of people moving in/out the camera view (“border control”). Extensive experiments and analyses show that our method outperforms state-of-the-art techniques in single- and multicamera datasets for both speed and reliability. We also design a deployed system for fast and reliable people (still or moving) counting by using multiple cameras.

Compressive sensing photoacoustic imaging based on multi-view error gradient fusion

Compressive sensing photoacoustic imaging (PAI) is an emerging method for photoacoustic signal sampling and image reconstruction. Based on the method, the high-imaging rate and low-system cost can be achieved. Unfortunately, artefacts exist in the reconstructed images and appear heavier if the measurement is fewer. The artefacts appear at different pixels when images are observed from different angles, and can be rejected by the fusion of multi-view images. In this study, a multi-view image fusion method based on error gradient is proposed. The theory of compressive sensing PAI is introduced firstly. Then a feasible measurement scheme based on the digital micromirror device is constructed. Subsequently, error gradient of the reconstructed image is defined and the fusion rule based on error gradient is made. Finally, the proposed method is testified by the simulations, in which images observed from 0 and 90° are used to take the fusion. Simulation results demonstrate that the image artefacts can be reduced effectively by the proposed method.

Wavelet-based image fusion in multi-view three-dimensional microscopy

Multi-view microscopy techniques such as Light-Sheet Fluorescence Microscopy (LSFM) are powerful tools for 3D + time studies of live embryos in developmental biology. The sample is imaged from several points of view, acquiring a set of 3D views that are then combined or fused in order to overcome their individual limitations. Views fusion is still an open problem despite recent contributions in the field. We developed a wavelet-based multi-view fusion method that, due to wavelet decomposition properties, is able to combine the complementary directional information from all available views into a single volume. Our method is demonstrated on LSFM acquisitions from live sea urchin and zebrafish embryos. The fusion results show improved overall contrast and details when compared with any of the acquired volumes. The proposed method does not need knowledge of the system's point spread function (PSF) and performs better than other existing PSF independent fusion methods. The described method was implemented in Matlab (The Mathworks, Inc., USA) and a graphic user interface was developed in Java. The software, together with two sample datasets, is available at http://www.die.upm.es/im/software/SPIMFusionGUI.zip A public release, free of charge for non-commercial use, is planned after the publication of this article.

Fast Automatic Matching Method on Multi-View Point Clouds for Rail Tanker

In this paper, a novel method is proposed for automatically matching the measured data of a rail tanker. The spindle orientation of point cloud is determined by PCA, and then any relative point pair is well matched according to the spatial topology relations as the complexity reduction point of view, finally the data is mapped to a uniform coordinate system with the Quaternion method. The experimental results demonstrated that the proposed method achieves simplicity of implementation with robustness, and especially suitable for positioning the work piece of the rail tanker and the multi-view data fusion.

Multiview Fusion 3-d Echocardiography: Improving the Information and Quality of Real-Time 3-D Echocardiography

The advent of real-time 3-D echocardiography (RT3DE) promised dynamic 3-D image acquisition with the potential of a more objective and complete functional analysis. In spite of that, 2-D echocardiography remains the backbone of echocardiography imaging in current clinical practice, with RT3DE mainly used for clinical research. The uptake of RT3DE has been slow because of missing anatomic information, limited field-of-view (FOV) and tedious analysis procedures. This paper presents multiview fusion 3D echocardiography, where multiple images with complementary information are acquired from different probe positions. These multiple images are subsequently aligned and fused together for preserving salient structures in a single, multiview fused image. A novel and simple wavelet-based fusion algorithm is proposed that exploits the low- and high-frequency separation capability of the wavelet analysis. The results obtained show that the proposed multiview fusion considerably improves the contrast (31.1%), contrast-to-noise ratio (46.7%), signal-to-noise ratio (44.7%) and anatomic features (12%) in 3-D echocardiography, and enlarges the FOV (28.2%). This indicates that multiview fusion substantially enhances the image quality and information.

The evaluation of single-view and multi-view fusion 3D echocardiography using image-driven segmentation and tracking

Real-time 3D echocardiography (RT3DE) promises a more objective and complete cardiac functional analysis by dynamic 3D image acquisition. Despite several efforts towards automation of left ventricle (LV) segmentation and tracking, these remain challenging research problems due to the poor-quality nature of acquired images usually containing missing anatomical information, speckle noise, and limited field-of-view (FOV). Recently, multi-view fusion 3D echocardiography has been introduced as acquiring multiple conventional single-view RT3DE images with small probe movements and fusing them together after alignment. This concept of multi-view fusion helps to improve image quality and anatomical information and extends the FOV. We now take this work further by comparing single-view and multi-view fused images in a systematic study. In order to better illustrate the differences, this work evaluates image quality and information content of single-view and multi-view fused images using image-driven LV endocardial segmentation and tracking. The image-driven methods were utilized to fully exploit image quality and anatomical information present in the image, thus purposely not including any high-level constraints like prior shape or motion knowledge in the analysis approaches. Experiments show that multi-view fused images are better suited for LV segmentation and tracking, while relatively more failures and errors were observed on single-view images.