Real-Time Multichannel Imaging Framework for Endoscopy, Catheters, and Fixed Geometry Intraoperative Systems

Abstract

To address the need for a clinically applicable intravital optical imaging system, we developed a new hardware and software framework. We demonstrate its utility by applying it to an endoscope-based white light and fluorescent imaging system. The capabilities include acquisition and visualization algorithms that perform registration, segmentation, and histogram-based autoexposure of two imaging channels (full-spectrum white light and near-infrared fluorescence), all in real time. Data are processed and saved as 12-bit files, matching the standards of clinical imaging. Dynamic range is further improved by the evaluation of flux as a quantitative parameter. The above features are demonstrated in a series of in vitro experiments, and the in vivo application is shown with the visualization of fluorescent-labeled vasculature of a mouse peritoneum. The approach may be applied to diverse systems, including handheld devices, fixed geometry intraoperative devices, catheter-based imaging, and multimodal systems.