Real-time Imaging System Research Articles

X-ray online detection for laser welding T-joint of Al–Li alloy

In order to detect weld defects in laser welding T-joint of Al–Li alloy, a real-time X-ray image system is set up for quality inspection. Experiments on real-time radiography procedure of the weldment are conducted by using this system. Twin fillet welding seam radiographic arrangement is designed according to the structural characteristics of the weldment. The critical parameters including magnification times, focal length, tube current and tube voltage are studied to acquire high quality weld images. Through the theoretical and data analysis, optimum parameters are settled and expected digital images are captured, which is conductive to automatic defect detection.

An Electrostatic MEMS Translational Scanner with Large Out-of-Plane Stroke for Remote Axial-Scanning in Multi-Photon Microscopy

We present an electrostatic microelectromechanical systems (MEMS) resonant scanner with large out-of-plane translational stroke for fast axial-scanning in a multi-photon microscope system for real-time vertical cross-sectional imaging. The scanner has a compact footprint with dimensions of 2.1 mm × 2.1 mm × 0.44 mm, and employs a novel lever-based compliant mechanism to enable large vertical displacements of a reflective mirror with slight tilt angles. Test results show that by using parametrical resonance, the scanner can provide a fast out-of-plane translational motion with ≥400 μm displacement and ≤0.14° tilt angle over a wide frequency range of ~390 Hz at ambient pressure. By employing this MEMS translational scanner and a biaxial MEMS mirror for lateral scanning, vertical cross-sectional imaging with a beam axial-scanning range of 200 μm and a frame rate of ~5–10 Hz is enabled in a remote scan multi-photon fluorescence imaging system.

Non-destructive crack detection of preserved eggs using a machine vision and multivariate analysis

Pidan or century egg, also known as preserved egg, is one of the most traditional and popular egg products in China. The crack detection of preserved eggshell is very important to guarantee its quality. In this study, we develop an image algorithm for preserved eggshell’s crack detection by using natural light and polarized image. Four features including crack length, crack state coefficient, maximum projection and angular point are extracted from the natural light image by morphology calculus algorithms. The support vector machines (SVM) model with radial basis kernel function is established using the four features with an accuracy of about 92%. The detection accuracy is improved to 94% by using a new characteristic parameter of crack length on polarization image. The Multi-information fusion analysis indicates the potential for cracks detection by a real-time synthesis imaging system.

Real-Time Image Processing Based Online Feedback Control System for Cooling Batch Crystallization

Direct nucleation control (DNC) is a process analytical technique (PAT) based model free feedback control strategy for batch and continuous crystallization processes, which has been successfully applied in numerous cases. The basic principle of DNC is the use of controlled dissolution cycles to control a measurement directly related to the particle number in the system. During DNC, in the case of cooling crystallization fines are dissolved by repeated heating–cooling loops. In this context, the controlled variable is the (relative) particle number, which is manipulated using a feedback control approach through the temperature. The particle number is traditionally measured with focused beam reflectance measurement (FBRM); however, other PAT tools can also be employed in a similar feedback control setup. Often, crystallization processes are also monitored by real-time imaging systems. In the current work a novel DNC setup is proposed in which microscopy images are captured and processed by means of image an...

Real-Time Intraoperative MRI Intracerebral Delivery of Induced Pluripotent Stem Cell-Derived Neurons

Induced pluripotent stem cell (iPSC)-derived neurons represent an opportunity for cell replacement strategies for neurodegenerative disorders such as Parkinson's disease (PD). Improvement in cell graft targeting, distribution, and density can be key for disease modification. We have previously developed a trajectory guide system for real-time intraoperative magnetic resonance imaging (RT-IMRI) delivery of infusates, such as viral vector suspensions for gene therapy strategies. Intracerebral delivery of iPSC-derived neurons presents different challenges than viral vectors, including limited cell survival if cells are kept at room temperature for prolonged periods of time, precipitation and aggregation of cells in the cannula, and obstruction during injection, which must be solved for successful application of this delivery approach. To develop procedures suitable for RT-IMRI cell delivery, we first performed in vitro studies to tailor the delivery hardware (e.g., cannula) and defined a range of parameters to be applied (e.g., maximal time span allowable between cell loading in the system and intracerebral injection) to ensure cell survival. Then we performed an in vivo study to evaluate the feasibility of applying the system to nonhuman primates. Our results demonstrate that the RT-IMRI delivery system provides valuable guidance, monitoring, and visualization during intracerebral cell delivery that are compatible with cell survival.

A Fast and Robust Beamspace Adaptive Beamformer for Medical Ultrasound Imaging.

Minimum variance beamformer (MVB) increases the resolution and contrast of medical ultrasound imaging compared with nonadaptive beamformers. These advantages come at the expense of high computational complexity that prevents this adaptive beamformer to be applied in a real-time imaging system. A new beamspace (BS) based on discrete cosine transform is proposed in which the medical ultrasound signals can be represented with less dimensions compared with the standard BS. This is because of symmetric beampattern of the beams in the proposed BS compared with the asymmetric ones in the standard BS. This lets us decrease the dimensions of data to two, so a high complex algorithm, such as the MVB, can be applied faster in this BS. The results indicated that by keeping only two beams, the MVB in the proposed BS provides very similar resolution and also better contrast compared with the standard MVB (SMVB) with only 0.44% of needed flops. Also, this beamformer is more robust against sound speed estimation errors than the SMVB.

Visualization of how light changes affect ion movement in rice plants using a real-time radioisotope imaging system

We developed a real-time radioisotope imaging system (RRIS) technique that can nondestructively visualize the element absorption and transport process in plants, using not only positron emitters but also commercially available radioisotopes. In this study, we applied RRIS to analyze light effects on ion movement in rice plants. As tracers, 28Mg, 32P, and 45Ca were used. During the first 5 h, dark/light cycle of 3/7 min were set up; the RRIS needs dark conditions during capturing. When the light was ceased 5 h after supplying each tracer, 32P transport from root to shoot decreased immediately. In contrast, 28Mg and 45Ca transport did not change with light conditions. These results suggest that the P transport is dependent on water flow, whereas Mg and Ca transport are independent of water flow.

Vemurafenib and trametinib reduce expression of CTGF and IL-8 in V600EBRAF melanoma cells

Clinical evidence has revealed that while RAS/RAF/MEK/ERK pathway is a crucial component of melanomagenesis, other signaling pathways can also contribute to the malignant growth and development of resistance to targeted therapies. We explored the response of V600EBRAF melanoma cells derived from surgical specimens and grown in stem cell medium to vemurafenib and trametinib, drugs targeting the activity of V600EBRAF and MEK1/2, respectively. Cell growth and apoptosis were monitored by real-time imaging system, immunophenotype and cell cycle by flow cytometry, gene expression by quantitative real-time PCR, immunoblotting and enzyme-linked immunosorbent assay. The V600EBRAF melanoma cell populations were diverse. Differences in morphology, pigmentation, cell cycle profiles, and immunophenotype were observed. At the molecular level, melanoma cells differed in the phosphorylation of ERK1/2, NF-κB, and β-catenin, and expression of several relevant genes, including MITF-M, DKK1, CCND1, BRAF, CXCL8, and CTGF. Despite having different characteristics, melanoma cells responded similarly to vemurafenib and trametinib. Both drugs reduced ERK1/2 phosphorylation and percentages of cells expressing Ki-67 at high level, inhibited expression of CCND1 and induced cell cycle arrest in the Go/G1 phase. These expected cytostatic effects were accompanied by increased CD271 expression, a marker of stem-like cells. NF-κB activity was reduced by both drugs, however, not completely abolished, whereas the level of active β-catenin was increased by drugs in three out of six cell populations. Interestingly, expression of IL-8 and CTGF was significantly reduced by treatment with vemurafenib and trametinib. Simultaneous inhibition of NF-κB activity and induction of ERK1/2 phosphorylation revealed that CTGF expression depends on ERK1/2 activity but not on NF-κB activity. Both, the positive effects of treatment with vemurafenib and trametinib such as the newly identified CTGF suppression and undesired effects such as increased CD271 expression suggesting selection of melanoma stem-like cells should be considered in the development of combination treatment for melanoma patients.

High-Speed Compressive Microscopy of Flowing Cells Using Sinusoidal Illumination Patterns

Single-pixel imaging (SPI) exploits the sparsity structure of natural images and enables image acquisition with far fewer measurements than the number of pixels. However, current SPI devices suffer from low imaging speed and an extremely time-consuming image reconstruction operation. Photonic time-stretch (PTS) technique is demonstrated to enable high-speed structured-illumination pattern generation, which significantly accelerates the imaging speed of conventional SPI devices. Meanwhile, to achieve fast image reconstruction, phase-shifted sinusoidal illumination patterns are used to acquire the Fourier spectrum of images and then a simple inverse fast Fourier transform (IFFT) operation is required for image reconstruction, which is quite computationally efficient. This paper presents a high-speed real-time compressive imaging system and its applications to imaging flow cytometry. Not only is a 625-kHz frame rate demonstrated, which is three orders of magnitude higher than that of a conventional SPI device, but the reconstruction process is remarkably accelerated as well, which enables our prototype system to operate in real time.

Research with radiation and radioisotopes to better understand plant physiology and agricultural consequences of radioactive contamination from the Fukushima Daiichi nuclear accident

Research carried out by me and my group over the last almost four decades are summarized here. The main emphasis of my work was and continues to be on plant physiology using radiation and radioisotopes. Plants live on water and inorganic elements. In the case of water, we developed neutron imaging methods and produced 15O-labeled water (half-life 2 min) and applied them to understand water circulation pattern in the plant. In the case of elements, we developed neutron activation analysis methods to analyze a large number of plant tissues to follow element specific distribution. Then, we developed real-time imaging system using conventional radioisotopes for the macroscopic and microscopic observation of element movement. After the accident in Fukushima Daiichi nuclear power plant, we, the academic staff of Graduate School, have been studying agricultural effects of radioactive fallout; the main results are summarized in two books published by Springer.

基于多通道窄带滤光片和彩色图像传感器的实时多光谱成像系统

基于多通道窄带滤光片和彩色图像传感器的实时多光谱成像系统

A Review on Real-Time 3D Ultrasound Imaging Technology.

Real-time three-dimensional (3D) ultrasound (US) has attracted much more attention in medical researches because it provides interactive feedback to help clinicians acquire high-quality images as well as timely spatial information of the scanned area and hence is necessary in intraoperative ultrasound examinations. Plenty of publications have been declared to complete the real-time or near real-time visualization of 3D ultrasound using volumetric probes or the routinely used two-dimensional (2D) probes. So far, a review on how to design an interactive system with appropriate processing algorithms remains missing, resulting in the lack of systematic understanding of the relevant technology. In this article, previous and the latest work on designing a real-time or near real-time 3D ultrasound imaging system are reviewed. Specifically, the data acquisition techniques, reconstruction algorithms, volume rendering methods, and clinical applications are presented. Moreover, the advantages and disadvantages of state-of-the-art approaches are discussed in detail.

The Impacts of Microbubble-Induced Sonoporation on Cell Membrane Permeability and Cytoskeleton Arrangement

Microbubble-mediated sonoporation has shown its great potential in facilitating intracellular uptake of gene/drugs and other therapeutic agents. However, the biophysical mechanisms underlying cell-bubble interactions remain unclear. Particularly, the cell cycle-phase-dependent cellular responses to sonoporation have never been reported. Here, efficient synchronizations were performed to arrest HeLa cells in individual cycle phases. Then, atomic force microscopy was adopted to examine the topography and stiffness of synchronized cells. Finally, real-time fluorescence imaging system was designed to simultaneously visualize sonoporation-induced variations in cell membrane permeabilization and cytoskeleton arrangement. The results showed that G1-phase cells had the largest height and elastic modulus, while S-phase cells were the flattest and softest ones. Consequently, S-Phase might become the preferred cycle for sonoporation treatment, due to the greatest enhancement of membrane permeability and the fastest cytoskeleton disassembly. These findings may benefit ongoing efforts pursuing rational utilization of microbubble-mediated sonoporation in cell-cycle-targeted gene/drug delivery for cancer therapy.

Cell-cycle-specific Cellular Responses to Sonoporation.

Microbubble-mediated sonoporation has shown its great potential in facilitating intracellular uptake of gene/drugs and other therapeutic agents that are otherwise difficult to enter cells. However, the biophysical mechanisms underlying microbubble-cell interactions remain unclear. Particularly, it is still a major challenge to get a comprehensive understanding of the impact of cell cycle phase on the cellular responses simultaneously occurring in cell membrane and cytoskeleton induced by microbubble sonoporation.Methods: Here, efficient synchronizations were performed to arrest human cervical epithelial carcinoma (HeLa) cells in individual cycle phases. The, topography and stiffness of synchronized cells were examined using atomic force microscopy. The variations in cell membrane permeabilization and cytoskeleton arrangement induced by sonoporation were analyzed simultaneously by a real-time fluorescence imaging system.Results: The results showed that G1-phase cells typically had the largest height and elastic modulus, while S-phase cells were generally the flattest and softest ones. Consequently, the S-Phase was found to be the preferred cycle for instantaneous sonoporation treatment, due to the greatest enhancement of membrane permeability and the fastest cytoskeleton disassembly at the early stage after sonoporation.Conclusion: The current findings may benefit ongoing efforts aiming to pursue rational utilization of microbubble-mediated sonoporation in cell cycle-targeted gene/drug delivery for cancer therapy.

Navel Orange Maturity Classification by Multispectral Indexes Based on Hyperspectral Diffuse Transmittance Imaging

Maturity grading is important for the quality of fruits. Nondestructive maturity detection can be greatly beneficial to the consumer and fruit industry. In this paper, a hyperspectral image of navel oranges was obtained using a diffuse transmittance imaging based system. Multispectral indexes were built to identify the maturity with the hyperspectral technique. Five indexes were proposed to combine the spectra at wavelengths of 640, 760 nm (red edges), and 670 nm (for chlorophyll content) to grade the navel oranges into three maturity stages. The index of (T670+T760-T640)/(T670+T760+T640) seemed to be more appropriate to classify maturity, especially to distinguish immature oranges that can be straightly identified in accordance with the value of this index ((T670+T760-T640)/(T670+T760+T640)). Different indexes were used as the input of linear discriminate analysis (LDA) and of k-nearest neighbor (k-NN) algorithm to identify the maturity, and it was found that k-NN with (T670+T760-T640)/(T670+T760+T640) could reach the highest correct classification rate of 96.0%. The results showed that the built index was feasible and accurate in the nondestructive classification of oranges based on the hyperspectral diffuse transmittance imaging. It will greatly help to develop low-cost and real-time multispectral imaging systems for the nondestructive detection of fruit quality in the industry.

A Versatile and Rapidly Deployable Device to Enable Spatiotemporal Observations of the Sessile Microbes and Environmental Surfaces.

Although microbes typically associate with surfaces, detailed observations of surface-associated microbes on natural substrata are technically challenging. We herein introduce a flow channel device named the Stickable Flow Device, which is easily configurable and deployable on various surfaces for the microscopic imaging of environmental microbes. We demonstrated the utility of this device by creating a flow channel on different types of surfaces including live leaves. This device enables the real-time imaging of bacterial biofilms and their substrata. The Stickable Flow Device expands the limits of conventional real-time imaging systems, thereby contributing to a deeper understanding of microbe-surface interactions on various surfaces.

Real-time and quantitative fluorescent live-cell imaging with quadruplex-specific red-edge probe (G4-REP)

The development of quadruplex-directed molecular diagnostic and therapy rely on mechanistic insights gained at both cellular and tissue levels by fluorescence imaging. This technique is based on fluorescent reporters that label cellular DNA and RNA quadruplexes to spatiotemporally address their complex cell biology. The photophysical characteristics of quadruplex probes usually dictate the modality of cell imaging by governing the selection of the light source (lamp, LED, laser), the optical light filters and the detection modality. Here, we report the characterizations of prototype from a new generation of quadruplex dye termed G4-REP (for quadruplex-specific red-edge probe) that provides fluorescence responses regardless of the excitation wavelength and modality (owing to the versatility gained through the red-edge effect), thus allowing for diverse applications and most imaging facilities. This is demonstrated by cell images (and associated quantifications) collected through confocal and multiphoton microscopy as well as through real-time live-cell imaging system over extended period, monitoring both non-cancerous and cancerous human cell lines. Our results promote a new way of designing versatile, efficient and convenient quadruplex-reporting dyes for tracking these higher-order nucleic acid structures in living human cells. This article is part of a Special Issue entitled "G-quadruplex" Guest Editor: Dr. Concetta Giancola and Dr. Daniela Montesarchio.

Long-range, wide-field swept-source optical coherence tomography with GPU accelerated digital lock-in Doppler vibrography for real-time, in vivo middle ear diagnostics.

We present the design, implementation and validation of a swept-source optical coherence tomography (OCT) system for real-time imaging of the human middle ear in live patients. Our system consists of a highly phase-stable Vernier-tuned distributed Bragg-reflector laser along with a real-time processing engine implemented on a graphics processing unit. We use the system to demonstrate, for the first time in live subjects, real-time Doppler measurements of middle ear vibration in response to sound, video rate 2D B-mode imaging of the middle ear and 3D volumetric B-mode imaging. All measurements were performed non-invasively through the intact tympanic membrane demonstrating that the technology is readily translatable to the clinic.

Non-conductive and miniature fiber-optic imaging system for real-time detection of neuronal activity in time-varying electromagnetic fields

Establishing an appropriate threshold value for neuronal modulation by time-varying electromagnetic field (EMF) exposure is important for developing international guidelines to protect against the potential health effects, and to design a variety of medical devices. However, it is technically difficult to achieve real-time detection of neuronal activity under repetitive and long-term exposure to EMF. For this purpose, we developed a non-conductive, miniature, and flexible fiber-optic imaging system that does not affect the electromagnetic noise, induction heating, or vibration in a high-intensity and repetitive time-varying EMF exposure. Using the proposed system, we succeeded at real-time detection of spontaneous Ca2+ oscillations in single neuronal and glial cells, as well as synchronized bursting activities of multiple neuronal networks at a micrometer-scale and millisecond-order spatiotemporal resolution during long-term EMF exposure (sinusoidal wave, 20kHz, 8.6mT, >30min). The results indicated that short-term (<5min) exposure-related neuronal modulation was not detectable; however, long-term (15–30min) exposure was observed to depress neuronal activities. In addition, the simultaneous and real-time recording of neuronal activity and the environmental temperature revealed that the neuronal modulation was accompanied by a 0.5–1°C rise in the temperature of the culture medium induced by the heat generation of exposure coils. These findings suggest that our real-time imaging system can be used for precise evaluation of the threshold values and clarification of the mechanisms of neuronal modulation induced by time-varying EMF exposure.

Pupil Tracking for Real-Time Motion Corrected Anterior Segment Optical Coherence Tomography.

Volumetric acquisition with anterior segment optical coherence tomography (ASOCT) is necessary to obtain accurate representations of the tissue structure and to account for asymmetries of the anterior eye anatomy. Additionally, recent interest in imaging of anterior segment vasculature and aqueous humor flow resulted in application of OCT angiography techniques to generate en face and 3D micro-vasculature maps of the anterior segment. Unfortunately, ASOCT structural and vasculature imaging systems do not capture volumes instantaneously and are subject to motion artifacts due to involuntary eye motion that may hinder their accuracy and repeatability. Several groups have demonstrated real-time tracking for motion-compensated in vivo OCT retinal imaging, but these techniques are not applicable in the anterior segment. In this work, we demonstrate a simple and low-cost pupil tracking system integrated into a custom swept-source OCT system for real-time motion-compensated anterior segment volumetric imaging. Pupil oculography hardware coaxial with the swept-source OCT system enabled fast detection and tracking of the pupil centroid. The pupil tracking ASOCT system with a field of view of 15 x 15 mm achieved diffraction-limited imaging over a lateral tracking range of +/- 2.5 mm and was able to correct eye motion at up to 22 Hz. Pupil tracking ASOCT offers a novel real-time motion compensation approach that may facilitate accurate and reproducible anterior segment imaging.