Design of large-array CMOS real-time imaging system based on FPGA

Abstract

In general, the image processing part is placed on the personal computer (PC) for processing. However, with the amount of data to be processed increases dramatically, the requirement for data processing speed is increasing. Further, a real-time imaging system using Field-Programmable Gate Array (FPGA) is implemented, which is designed for a large-array CMOS camera based on USB3.0 interface. Given the advantages of FPGA parallel processing, this design will implement sensor image processing pipeline (IPP) with the FPGA. At the same time, the high speed storage device double data rate (DDR3) is used in the system to cache image data. A Xilinx FPGA is the core processing unit of the entire system, and it completes all the functional modules, including the CMOS driving, data transmission, real-time image stitching and image caching. FPGA-based IPP and DDR3 frame buffer application can improve the video frame rate. Finally, the imaging experimental results show that the large-array CMOS real-time imaging system has a display resolution of 7920*5432 with a stable frame rate of 8.5 fps, and achieves a good balance between speed and efficiency.