Image Acquisition Rate Research Articles

Fast and Artifact-Free Excitation Multiplexing Using Synchronized Image Scanning.

Multicolor fluorescence microscopy is an essential tool to visualize structures and dynamics in the life and materials sciences. However, the near-simultaneous acquisition of labels differing in excitation spectrum is difficult and renders such measurements prone to artifacts. We present a simple strategy to provide quasi-simultaneous fluorescence imaging with multiple excitation wavelengths by using an optical element to displace the sample image on the sensor at a rate that is much faster than the image acquisition rate and synchronizing this with the illumination. The emission elicited by the different wavelengths can then be encoded into the point-spread function of the imaging or visualized as multiple distinct images. In doing so, our approach can eliminate or mitigate artifacts caused by temporal aliasing in conventional sequential imaging. We demonstrate the use of our system to uncover hidden emissive states in single quantum dots and for the imaging of Ca2+ signaling in neurons.

High Sensitivity Stimulated Raman Scattering Microscopy with Electronic Resonance Enhancement.

Raman microscopy is an important tool for labelfree microscopy. However, spontaneous Raman microscopy suffers from slow image acquisition rates and susceptibility to fluorescence background. Coherent Raman microsocopy techniques such as coherent anti-Stokes Raman scattering (CARS) and stimulated Raman scattering (SRS) microscopy, by contrast, offer fast imaging capability and robustness against sample fluorescence. Yet, their rather low sensitivity impedes their broader application. This review discusses sensitivity enhancement of SRS microscopy to M detection levels by using electronically pre-resonant excitation. We present the foundations of this approach, discuss its technological implementation, and show first successful applications. A special emphasis is given to outlining new experimental developments allowing novel types of investigations.

Line-field dynamic optical coherence tomography platform for volumetric assessment of biological tissues.

Dynamic optical coherence tomography (dOCT) utilizes time-dependent signal intensity fluctuations to enhance contrast in OCT images and indirectly probe physiological processes in cells. Majority of the dOCT studies published so far are based on acquisition of 2D images (B-scans or C-scans) by utilizing point-scanning Fourier domain (spectral or swept-source) OCT or full-field OCT respectively, primarily due to limitations in the image acquisition rate. Here we introduce a novel, high-speed spectral domain line-field dOCT (SD-LF-dOCT) system and image acquisition protocols designed for fast, volumetric dOCT imaging of biological tissues. The imaging probe is based on an exchangeable afocal lens pair that enables selection of combinations of transverse resolution (from 1.1 µm to 6.4 µm) and FOV (from 250 × 250 µm2 to 1.4 × 1.4 mm2), suitable for different biomedical applications. The system offers axial resolution of ∼ 1.9 µm in biological tissue, assuming an average refractive index of 1.38. Maximum sensitivity of 90.5 dB is achieved for 3.5 mW optical imaging power at the tissue surface and maximum camera acquisition rate of 2,000 fps. Volumetric dOCT images acquired with the SD-LF-dOCT system from plant tissue (cucumber), animal tissue (mouse liver) and human prostate carcinoma spheroids allow for volumetric visualization of the tissues' cellular and sub-cellular structures and assessment of cellular motility.

The Progress of Optical Coherence Tomography in Industry Applications

Optical coherence tomography (OCT) is a nonintrusive optical imaging method offering micrometer-scale spatial resolution, enabling the generation of internal structural cross-sectional images. Since the first OCT was invented in the early 1990s, its utilization has become prevalent in the field of ophthalmology and has become one of the golden standards in clinical diagnosis. Beyond the extensive research in biomedical fields, because of the accomplished exceptional spatial resolution and rapid imaging acquisition rate, the OCT has also been explored as an emerging solution for characterizing structure of new materials, detecting defects of industrial products in situ. In this paper, we reviewed and summarized recent progresses of OCT in several industrial applications, including structural analysis of composite materials, quality inspection of printed electronic devices, and analysis of industrial fluids. Meanwhile, the potential challenges and future development of OCT application in these fields are also outlined.

Development of a Fast in Situ Scanning Tunneling Microscope for Studies of Electrocatalyst Surfaces

The atomic-scale understanding of processes at the interface between solid electrodes and liquid electrolytes is of high importance for electrochemical energy storage and conversion. Electrochemical scanning tunneling microscopy (ECSTM) is a key technique for the investigation of these interfaces and as such, it has seen widespread use. However, the image acquisition in a conventional ECSTM is a rather slow process, requiring tens of seconds or minutes per image. To help understand the precise reaction mechanisms of atomic and molecular species at solid-liquid interfaces, their movement and interactions need to be resolved. For this, much higher imaging rates are necessary. High-speed STMs (video STMs) are capable of operating at rates >10 images per second, which is sufficiently fast to observe and quantitatively study a wide range of surface dynamic processes, e.g., surface diffusion and growth [1]. However, this technique has not been widely employed, mainly because of the instrumental requirements.The development of an STM for fast in situ measurements poses a set of challenges, which require a carefully planned implementation. For operation in electrochemical environment, the potentials of both STM tip and sample need to be controlled and electrochemical currents at the tip need to be kept way below the tunneling current. Fast image acquisition requires a scanner with high mechanical stability to avoid the excitation of uncontrolled tip oscillations at its resonance frequencies. Additionally, high-bandwidth measurement and control electronics and a sophisticated control software with fast scan generation and data processing capabilities are essential. No commercial system that is capable of fulfilling these requirements exists up to now. For this reason, all existing video-rate STM studies have been performed with home-built setups that employ highly specialized hardware that is not easy to reproduce.In this contribution, we present a new ECSTM developed and built in our group. The setup is based on a Nanonis SPM controller by SPECS and a custom scanner, bipotentiostat, and coarse approach control that were integrated into this system. We show example data and images to demonstrate the performance of the STM. Furthermore, we reveal the modifications employed to make it capable of video-rate imaging. These include a novel scanner design with two independent piezo stacks for slow and high-speed movements and a custom high-bandwidth preamplifier integrated into the scan head as close as possible to the tip. Fast data acquisition is realized by an FPGA-based control software, which features a user-friendly frontend and a backend with good performance even at high image acquisition rates. This software is designed to run alongside the commercial control software for the slow STM operation so that switching between the slow and fast imaging modes is as frictionless as possible. We will show preliminary test results of the early implementation of the fast imaging mode.[1] O. M. Magnussen, Chem. Eur. J. 2019, 25, 12865.

Optical-scanning evanescent sensor for high-speed broadband photoacoustic microscopy

Photoacoustic microscopy with high spatial resolution and fast imaging acquisition allows observing dynamic processes of optical absorption-based microanatomic structures in three dimensions. An evanescent sensor accesses ultrasonic detection with high sensitivity and broad bandwidth while suffering from limited field of view (FOV), thus compromising the photoacoustic imaging acquisition rate. Here, we develop an optical-scanning evanescent sensor by fast deflection of the interrogation light along the interface of prism and water using a one-dimensional galvanometer, demonstrating excellent detection sensitivity of ∼132 Pa with a broadband frequency response of >140-MHz at an enlarged FOV of ∼2.90 × 0.19 mm2. Incorporating the optical-scanning evanescent sensor in photoacoustic microscopy, a volumetric image (∼3.0 × 0.25 × 1.0 mm3) with micrometer-scale spatial resolution is acquired within ∼2.5 s by synergistically scanning both photoacoustic illumination laser and sensor's interrogation light. High-speed imaging of flowing microparticles within a capillary tube offers the visualizations of the traveling processes in three dimensions. Potentially, the optical-scanning evanescent sensor allows photoacoustic microscopy accommodating to dynamic imaging at cellular level such as in vivo flow cytometry of circulating tumor cells.

Motion Artifact Suppression Method for the Clinical Application of Otoscopic Spectral-Domain Optical Coherence Tomography

A compact OCT device and a method for image reconstruction are described. The proposed algorithm contains a novel procedure for motion artifact suppression based on a correction of the phase of the original interferometric signal due to the mutual correlation of adjacent A-scans. This procedure corrects distortions caused by unwanted displacements of the probe relative to the object in real time at a speed of up to 3 mm/s and an image acquisition rate of 20 B-scans per second. All processing is performed in real time using only the CPU, allowing the device to be controlled from a consumer-grade laptop or compact PC without the need for a discrete GPU. Due to its compact size, the device can be used in the conditions of an ENT examination room or operating room and can be freely moved to another room without the help of additional personnel, if necessary.

High-speed hyperspectral imaging enabled by compressed sensing in time domain

Hyperspectral imaging (HSI) is a powerful tool widely used for various scientific and industrial applications due to its ability to provide rich spatiospectral information. However, in exchange for multiplex spectral information, its image acquisition rate is lower than that of conventional imaging, with up to a few colors. In particular, HSI in the infrared region and using nonlinear optical processes is impractically slow because the three-dimensional (3D) data cube must be scanned in a point-by-point manner. In this study, we demonstrate a framework to improve the spectral image acquisition rate of HSI by integrating time-domain HSI and compressed sensing. Specifically, we simulated broadband coherent Raman imaging at a record high frame rate of 25 frames per second (fps) with 100 pixels × 100 pixels, which is 10 × faster than that of previous work, based on an experimentally feasible sampling scheme utilizing 3D Lissajous scanning.

Improved High-resolution Fast Imager

The improved High-resolution Fast Imager (HiFI+) is a multiwavelength imaging filtergraph, which was commissioned at the GREGOR solar telescope at Observatorio del Teide, Izaña, Tenerife, Spain, in March 2022 – followed by science verification in April 2022, after which it entered routine observations. Three camera control computers with two synchronized sCMOS and CMOS cameras each provide near diffraction-limited imaging at high cadence in six wavelength bands (Ca ii H at 396.8 nm, G-band at 430.7 nm, blue continuum at 450.6 nm, narrow- and broad-band Hα at 656.3 nm, and TiO bandhead at 705.8 nm). This unique combination of photospheric and chromospheric images provides “tomographic” access to the dynamic Sun and complements spectropolarimetric observations at the GREGOR telescope. High image acquisition rates of 50 and 100 Hz facilitate image restoration, where time series of restored images have a typical cadence of 6 and 12 s, which is sufficient to resolve the dynamics of the solar photosphere and chromosphere. In principle, all imaging channels can be restored individually using the speckle masking technique or multiframe blind deconvolution (MFBD). However, images recorded strictly simultaneously in the narrow-/broad-band Hα and the G-band/blue continuum channels can be pairwise subjected to multiobject multiframe deconvolution (MOMFBD) expanding the science capabilities of HiFI+. For example, the narrow-band (FWHM = 60 nm) Halle Hα Lyot filter isolates the Hα line core, which facilitates matching chromospheric fibrils and filamentary structures to photospheric bright points. Likewise, dividing G-band by blue continuum images enhances small-scale brightenings, which are often related to small-scale magnetic fields so that their evolution can be tracked in time. A detailed description of the improved high-cadence, large-format imaging system is presented and its performance is assessed based on first-light observations.

Real-World Experience of AI-Assisted Endocytoscopy Using EndoBRAIN—An Observational Study from a Tertiary Care Center

Abstract Background and Aims Precise optical diagnosis of colorectal polyps could improve the cost-effectiveness of colonoscopy and reduce polypectomy-related complications. We conducted this study to estimate the diagnostic performance of visual inspection alone (WLI + NBI) and of EndoBRAIN (endocytoscopy-computer-aided diagnosis [EC-CAD]) in identifying a lesion as neoplastic or nonneoplastic using EC in real-world scenario. Methods In this observational, prospective, pilot study, a total of 55 polyps were studied in the patients aged more than or equal to 18 years. EndoBRAIN is an artificial intelligence (AI)-based system that analyzes cell nuclei, crypt structure, and vessel pattern in differentiating neoplastic and nonneoplastic lesion in real-time. Endoscopist assessed polyps using white light imaging (WLI), narrow band imaging (NBI) initially followed by assessment using EC with NBI and EC with methylene blue staining. The sensitivity, specificity, positive predictive value, negative predictive value, and accuracy of endoscopist and EndoBRAIN in identifying the neoplastic from nonneoplastic polyp was compared using histopathology as gold-standard. Results A total of 55 polyps were studied, in which most of them were diminutive (36/55) and located in rectum (21/55). The image acquisition rate was 78% (43/55) and histopathology of the majority was identified to be hyperplastic (20/43) and low-grade adenoma (16/43). EndoBRAIN identified colonic polyps with 100% sensitivity, 81.82% specificity (95% confidence interval [CI], 59.7–94.8%), 90.7% accuracy (95% CI, 77.86–97.41%), 84% positive predictive value (95% CI, 68.4–92.72%), and 100% negative predictive value. The sensitivity and negative predictive value were significantly greater than visual inspection of endoscopist. The diagnostic accuracy seems to be superior; however, it did not reach statistical significance. Specificity and positive predictive value were similar in both groups. Conclusion Optical diagnosis using EC and EC-CAD has a potential role in predicting the histopathological diagnosis. The diagnostic performance of CAD seems to be better than endoscopist using EC for predicting neoplastic lesions.

Ultrafast optical phase-sensitive ultrasonic detection via dual-comb multiheterodyne interferometry

Highly sensitive and broadband ultrasound detection is important for photoacoustic imaging, biomedical ultrasound, and ultrasonic nondestructive testing. The elasto-optical refractive index modulation induced by ultrasound arouses a transient phase shift of a probe beam. Highly sensitive phase detection with a high Q factor resonator is desirable to visualize the ultraweak transient ultrasonic field. However, current phase-sensitive ultrasonic detectors suffer from limited bandwidth, mutual interference between intensity and phase, and significant phase noise, which become key to limiting further improvement of detection performance. We report a phase-sensitive detector with a bandwidth of up to 100 MHz based on dual-comb multiheterodyne interferometry (DCMHI). By sensing the phase shift induced by the ultrasound without any resonators in the medium, the DCMHI boosted the phase sensitivity by coherent accumulation without any magnitude averaging and extra radio frequency amplification. DCMHI offers high sensitivity and broad bandwidth as the noise-equivalent pressure reaches 31 mPa / √Hz under 70 MHz acoustic responses. With a large repetition rate difference of up to 200 MHz of dual comb, DCMHI can achieve broadband acoustic responses up to 100 MHz and a maximum possible imaging acquisition rate of 200 MHz. It is expected that DCMHI can offer a new perspective on the new generation of optical ultrasound detectors.

Assessing kernel processing score of harvested corn silage in real-time using image analysis and machine learning

Whole Plant Corn Silage (WPCS), produced by Self-Propelled Forage Harvesters (SPFH), is among the most common dietary ingredients for dairy cows. Kernel processor settings at harvest can impact WPCS quality and milk production. Having the capability to monitor machine performance and WPCS quality during harvest would allow farmers, nutritionists, and custom harvesters to optimize feed quality as the WPCS enters storage. A real-time quality assessment system was developed - a device to acquire images of chopped and processed silage moving through the spout of a SPFH and an image analysis algorithm to estimate the Kernel Processing Score (KPS) given a set of images. The system represents automation of the quality assessment process and could be incorporated in a real-time machine parameter tuning system. An initial experiment of corn particle detection in high-resolution images of stationary WPCS resulted in good detection performance (precision of 0.7381, recall of 0.9624, and intersection-over-union of 0.7104) but exposed inadequacies in the image labeling procedure and was not able to accurately estimate KPS. An improved camera system was designed and consisted of specialized exposure components to capture images at 121 frames per second. This system was able to acquire pictures silage moving at a rate of 36.9 m s−1. The KPS estimation was done offline and occurred in two steps: whole undamaged kernels were counted in a set of 1,000 images using machine learning; KPS was then estimated using a linear regression model previously obtained with the comparison between mechanical sieving KPS and number of kernels per image (r(38) = 0.967, p < 0.0001). A comparison between the estimated score to mechanically sieved KPS showed high correlation (r(38) = 0.977, p < 0.0001) and standard error of 2.71 %. Considering the computing power of high-end GPUs, the method is restrained by its current image acquisition rate, that results in one estimate in <10 s.

Dynamic Deformation Calculation of Articular Cartilage and Cells Using Resonance-Driven Laser Scanning Microscopy.

The deformation of articular cartilage and its cells at the micro-scale during dynamic activities such as gait has high mechanoregulatory importance. Measuring the cellular geometries during such dynamics has been limited by the rate of microscopic image acquisition. The introduction of resonating mirrors for image rasterization (resonant scanning), rather than the conventional servo control (galvano scanning), has significantly improved the scanning rate by more than 100×. However, the high scanning rate comes at the cost of image quality, thereby posing challenges in image processing. Here, resonance-driven 3-D laser microscopy is used to observe the transient, micro-scale deformation of articular cartilage and its cells under osmotic challenge conditions. Custom image segmentation and deformable registration software were implemented for analysis of the resonance-scanned microscopy data. The software exhibited robust and accurate performance on the osmotic swelling measurements, as well as quantitative validation testing. The resonance-scanning protocol and developed analysis software allow for simultaneous strain calculation of both the local tissue and cells, and are thus a valuable tool for real-time probing of the cell-matrix interactions that are highly relevant in the fields of orthopedic biomechanics, cell mechanobiology, and functional tissue engineering.

Al2O3:C optically stimulated luminescence dosimetry for evaluation of potential factors contributing to entrance skin doses received by liver cancer patients undergoing Transarterial Chemoembolization

Transarterial Chemoembolization (TACE) has been accepted as an effective technique that can be practically used for liver cancer treatment due to its outstanding benefits for patients with large, infiltrative, and multifocal tumors that cannot be surgically removed. However, this invasive image-guided technique may potentially result in higher radiation doses than general diagnostic radiology. Radiation-induced skin injury caused by excessive exposure to X-rays during fluoroscopically guided procedures has been previously reported. Therefore, dose assessment during TACE examination is relevant to minimize radiological hazards and reduce patient distress.The study aims to 1) quantify the magnitude of radiation doses received in TACE treatments, 2) evaluate potential factors contributing to an increase of the entrance skin dose, and 3) demonstrate an improved image-guided procedure for reducing radiation doses while maintaining high X-ray image quality. The study was carried out employing an anthropomorphic phantom to determine radiation dose using a standard commercial optically stimulated luminescence dosimeter (OSLD). Experimental data was collected from 370 patients under three specific image-guided techniques. They include 1) abdomen frontal 3 fps procedure where a pathway of blood flow was created using an image acquisition rate of three frames per second (fps), 2) navigation where a blood vessel roadmap was created with subtraction of bones and organs, and 3) fluoroscopy where X-ray beams were continuously delivered to a target for creating real-time images with no interference removed. Analysis of variance was used to demonstrate the difference of the mean entrance skin doses (ESDs) among the three imaging techniques. A multiple regression model was also used to investigate potential factors contributing to the increased ESDs.The study confirms that the ESDs received by TACE patients using these three imaging techniques are not significantly different. Moreover, the statistical-based model shows that the five main factors obtained from the exposure parameters and patient dosimetric data contribute to the patient ESDs. They include 1) the dose area product (DAP), 2) fluoroscopy time, 3) X-ray tube voltage, 4) X-ray tube current, and 5) total diagnostic images. All information is reported based on the machine DICOM-RDSR (Digital Imaging and Communication in Medicine – Radiation Dose Structured Report) data after completed examinations. Finally, the ANOVA test confirms that this simplified model can be used to estimate the radiation doses received by TACE patients, accounting for a 95% confidence interval.

Spatial-coherence-based beamforming for image quality enhancement in high frame-rate ultrasound imaging

Several high frame-rate ultrasound imaging techniques have been recently proposed which allow to increase image acquisition rates by transmitting multiple focused beams simultaneously or defocused waves, and reconstructing multiple scan lines in parallel. These methods, which include for example multi-line transmission, plane/diverging wave imaging, and parallel beamforming, have proved to be successful in increasing the frame-rate, but on the other hand they have also showed some limitations in terms of the achievable image quality, partly degrading image contrast and resolution. Different solutions have been proposed to address this problem so far, such as the use of advanced receive beamforming algorithms able to improve the beam shape and the quality of the obtained image. Among these, beamformers based on backscattered signals spatial coherence, as e.g. Filtered Delay Multiply and Sum beamforming, Coherence-Factor-based methods, and Short Lag Spatial Coherence Imaging, have gained increasing attention for their ability to enhance image contrast and suppress clutter. In this presentation, an overview of some recent results obtained by jointly exploiting high frame-rate ultrasound imaging and coherence-based beamforming methods will be presented, showing through experimental tests the performance improvement achievable with these techniques.

Concurrent kilovoltage CBCT imaging and megavoltage beam delivery: suppression of cross-scatter with 2D antiscatter grids and grid-based scatter sampling

Objective. The concept of using kilovoltage (kV) and megavoltage (MV) beams concurrently has potential applications in cone beam computed tomography (CBCT) guided radiation therapy, such as single breath hold scans, metal artifact reduction, and simultaneous imaging during MV treatment delivery. However, MV cross-scatter generated during MV beam delivery degrades CBCT image quality. To address this, a 2D antiscatter grid and a cross-scatter correction method were investigated in the context of high dose MV treatment delivery. Approach. A 3D printed, tungsten 2D antiscatter grid prototype was utilized in kV CBCT scans to reduce MV cross-scatter fluence during concurrent MV beam delivery. Remaining cross-scatter in projections was corrected by using the 2D grid itself as a cross-scatter intensity sampling device, referred to as grid-based scatter sampling (GSS). To test this approach, kV CBCT acquisitions were performed while delivering 6 and 10 MV beams, mimicking high dose rate treatment delivery scenarios. kV and MV beam deliveries were not synchronized to eliminate MV beam delivery interruption. MV cross-scatter suppression performance of the proposed approach was evaluated in projections and CBCT images of phantoms. Main results. 2D grid reduced the intensity of MV cross-scatter in kV projections by a factor of 3 on the average, when compared to conventional antiscatter grid. Remaining cross scatter as measured by the GSS method was within 7% of measured reference intensity values, and subsequently corrected. CBCT image quality was improved substantially during concurrent kV–MV beam delivery. Median Hounsfield Unit (HU) inaccuracy was up to 182 HU without our methods, and it was reduced to a median 6.5 HU with our 2D grid and scatter correction approach. Our methods provided a factor of 2–6 improvement in contrast-to-noise ratio. Significance. This investigation demonstrates the utility of 2D antiscatter grids and grid-based scatter sampling in suppressing MV cross-scatter. Our approach successfully minimized the effects of MV cross-scatter in concurrent kV CBCT imaging and high dose MV treatment delivery scenarios. Hence, robust MV cross-scatter suppression is potentially feasible without MV beam delivery interruption or compromising kV image acquisition rate.

Line-scanning SD-OCT for in-vivo, non-contact, volumetric, cellular resolution imaging of the human cornea and limbus.

In-vivo, non-contact, volumetric imaging of the cellular and sub-cellular structure of the human cornea and limbus with optical coherence tomography (OCT) is challenging due to involuntary eye motion that introduces both motion artifacts and blur in the OCT images. Here we present the design of a line-scanning (LS) spectral-domain (SD) optical coherence tomography system that combines 2 × 3 × 1.7 µm (x, y, z) resolution in biological tissue with an image acquisition rate of ∼2,500 fps, and demonstrate its ability to image in-vivo and without contact with the tissue surface, the cellular structure of the human anterior segment tissues. Volumetric LS-SD-OCT images acquired over a field-of-view (FOV) of 0.7 mm × 1.4 mm reveal fine morphological details in the healthy human cornea, such as epithelial and endothelial cells, sub-basal nerves, as well as the cellular structure of the limbal crypts, the palisades of Vogt (POVs) and the blood microvasculature of the human limbus. LS-SD-OCT is a promising technology that can assist ophthalmologists with the early diagnostics and optimal treatment planning of ocular diseases affecting the human anterior eye.

High speed fringe projection for dynamic shape measurement using binary phase mask. Part 2: manufacture and test

Dynamic measurement of object shape is now achievable at projection rates of up to 30,000 binary fringe patterns per second from a digital micromirror device (DMD) based projector. This two-part paper describes the design, manufacture and test of a binary phase mask in the projection system that produces high-quality greyscale fringes from the binary patterns, with much reduced phase noise compared to the projector defocus approach that has been used until now. Part 2 describes the experimental verification and characterization of the phase masks, manufactured using photolithography and dry etching from the design methods described in Part 1. The height distribution of two masks with point spread function (PSF) dimensions of 1 × 256 and 4 × 64 pixels were assessed using coherence scanning interferometry and contact surface profilometry. Phase noise was determined using standard temporal unwrapping fringe sequences and found to be 20–50% higher than a traditional 8-bit greyscale approach. The projector lens distortion has been observed, and the corresponding compensation method shown to significantly improve the quality of the projected fringes. Increasing the number of projector frames per camera frame reduced phase noise, to less than one-half the 8-bit values for a 10-slice sequence. Fringe image acquisition rates for the 1-slice and 10-slice sequences are up to 255 × and 25 × faster than for the 8-bit greyscale sequence, respectively. Finally, examples are presented of fringe patterns and wrapped phase maps from a high-speed system used to measure moving objects, with projection and acquisition rates of up to 9515 frames s−1.

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( &gt; --> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

Deep Learning for Instrumented Ultrasonic Tracking: From Synthetic Training Data to In Vivo Application.

Instrumented ultrasonic tracking is used to improve needle localization during ultrasound guidance of minimally invasive percutaneous procedures. Here, it is implemented with transmitted ultrasound pulses from a clinical ultrasound imaging probe, which is detected by a fiber-optic hydrophone integrated into a needle. The detected transmissions are then reconstructed to form the tracking image. Two challenges are considered with the current implementation of ultrasonic tracking. First, tracking transmissions are interleaved with the acquisition of B-mode images, and thus, the effective B-mode frame rate is reduced. Second, it is challenging to achieve an accurate localization of the needle tip when the signal-to-noise ratio is low. To address these challenges, we present a framework based on a convolutional neural network (CNN) to maintain spatial resolution with fewer tracking transmissions and enhance signal quality. A major component of the framework included the generation of realistic synthetic training data. The trained network was applied to unseen synthetic data and experimental in vivo tracking data. The performance of needle localization was investigated when reconstruction was performed with fewer (up to eightfold) tracking transmissions. CNN-based processing of conventional reconstructions showed that the axial and lateral spatial resolutions could be improved even with an eightfold reduction in tracking transmissions. The framework presented in this study will significantly improve the performance of ultrasonic tracking, leading to faster image acquisition rates and increased localization accuracy.