Abstract

We demonstrate an efficient and accelerated parallel, sparse depth reconstruction framework using compressed sensing (compressed sensing (CS)) and approximate computing. Employing data parallelism for rapid image formation, the depth image is reconstructed from sparsely sampled scenes using convex optimization. Coupled with faster imaging, this sparse sampling reduces significantly the projected laser power in active systems such as light detection and ranging (LiDAR) to allow eye safe operation at longer range. We also demonstrate how reduced precision is leveraged to reduce the number of logic units in field-programmable gate array (FPGA) implementations for such sparse imaging systems. It enables significant reduction in logic units, memory requirements and power consumption by over 80% with minimal impact on the quality of reconstruction. To further accelerate processing, pre-computed, important components of the lower-upper (LU) decomposition and other linear algebraic computations are used to solve the convex optimization problems. Our methodology is demonstrated by the application of the alternating direction method of multipliers (ADMM) and proximal gradient descent (PGD) algorithms. For comparison, a fully discrete least square reconstruction method ( <inline-formula><tex-math notation="LaTeX">$d$</tex-math></inline-formula> Sparse) is also presented. This demonstrates the feasibility of novel, high resolution, low power and high frame rate LiDAR depth imagers based on sparse illumination for use in applications where resources are strictly limited.

Highlights

  • The recovery of dense 3D images from LiDAR sensors is a challenging task, especially at high resolutions and frame rates, and with constraints on eye safety that limit the signalto-noise ratio (SNR) and operating range as these are highly dependent on the emitted power

  • We report the results of a study on approximate 3D image reconstruction using 1 minimization based on Reduced precision (RP) for small scale least absolute shrinkage and selection operator problems with the optimized lean alternating direction method of multipliers (ADMM) and proximal gradient descent (PGD) algorithms on a FPGA platform

  • In a time-correlated single photon LiDAR imaging system, each pixel can capture a set of returned photon events which are often stored in a histogram, h ∈ Nl of the type shown in Fig. 1, where l is the number of bins or channels [18], [19], [20]

Read more

Summary

INTRODUCTION

The recovery of dense 3D images from LiDAR sensors is a challenging task, especially at high resolutions and frame rates, and with constraints on eye safety that limit the signalto-noise ratio (SNR) and operating range as these are highly dependent on the emitted power. We report the results of a study on approximate 3D image reconstruction using 1 minimization based on RP for small scale least absolute shrinkage and selection operator (lasso) problems with the optimized lean ADMM and PGD algorithms on a FPGA platform. Both optimizers are suitable for compressed sensing of images, in our case depth images using time-of-flight sensing [5], [16]. A comparative study of energy efficient FPGA implementations for approximate, RP parallel depth reconstruction using our ADMM, PGD and dSparse algorithms

BACKGROUND
Arithmetic Precision and Approximation
Pseudo-inverse least-squares: dSparse
Depth Reconstruction
Computational complexity
Accuracy of reconstruction
Real LiDAR data
Approximate algebra modules
Approximate depth reconstruction architecture
Resource utilization and performance
Efficiency evaluation
Findings
CONCLUSION
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.