Optical Scatter Imaging Research Articles

Time-gated imaging through dense fog via physics-driven Swin transformer

Imaging through the fog is valuable for many areas, such as autonomous driving and cosmic exploration. However, due to the influence of strong backscattering and diffuse reflection generated by the dense fog on the temporal-spatial correlations of photons returning from the target object, the reconstruction quality of most existing methods is significantly reduced under dense fog conditions. In this study, we describe the optical scatter imaging process and propose a physics-driven Swin Transformer method utilizing Time-of-Flight (ToF) and Deep Learning principles to mitigate scattering effects and reconstruct targets in conditions of heterogeneous dense fog. The results suggest that, despite the exponential decrease in the number of ballistic photons as the optical thickness of fog increases, the Physics-Driven Swin Transformer method demonstrates satisfactory performance in imaging targets obscured by dense fog. Importantly, this article highlights that even in dense fog imaging experiments with optical thickness reaching up to 3.0, which exceeds previous studies, commonly utilized quantitative evaluation metrics like PSNR and SSIM indicate that our method is cutting-edge in imaging through dense fog.

Optical scatter imaging of resected breast tumor structures matches the patterns of micro-computed tomography

In patients undergoing breast-conserving surgery (BCS), the rate of re-excision procedures to remove residual tumor left behind after initial resection can be high. Projection radiography, and recently, volumetric x-ray imaging are used to assess margin adequacy, but x-ray imaging lacks contrast between healthy, abnormal benign, and malignant fibrous tissues important for surgical decision making. The purpose of this study was to compare micro-CT and optical scatter imagery of surgical breast specimens and to demonstrate enhanced contrast-to intra-tumoral morphologies and tumor boundary features revealed by optical scatter imaging. A total of 57 breast tumor slices from 57 patients were imaged ex vivo by spatially co-registered micro-CT and optical scatter scanning. Optical scatter exhibited greater similarity with micro-CT in 89% (51/57) of specimens versus diffuse white light (DWL) luminance using mutual information (mean ± standard deviation of 0.48 ± 0.21 versus 0.24 ± 0.12; p < 0.001) and in 81% (46/57) of specimens using the Sørensen–Dice coefficient (0.48 ± 0.21 versus 0.33 ± 0.18; p < 0.001). The coefficient of variation (CV) quantified the feature content in each image. Optical scatter exhibited the highest CV in every specimen (optical scatter: 0.70 ± 0.17; diffuse luminance: 0.24 ± 01; micro-CT: 0.15 ± 0.03 for micro-CT; p < 0.001). Optical scatter also exhibited the highest contrast ratios across representative tumor boundaries with adjacent healthy/benign fibrous tissues (1.5–3.7 for optical scatter; 1.0–1.1 for diffuse luminance; 1.0–1.1 for micro-CT). The two main findings from this study were: first, optical scatter contrast was in general similar to the radiological view of the tissue relative to DWL imaging; and second, optical scatter revealed additional features associated with fibrous tissue structures of similar radiodensity that may be relevant to diagnosis. The value of micro-CT lies in its rapid three-dimensional scanning of specimen morphology, and combined with optical scatter imaging with sensitivity to fibrous surface tissues, may be an attractive solution for margin assessment during BCS.

Iterative Algorithms for Joint Scatter and Attenuation Estimation From Broken Ray Transform Data

The single-scatter approximation is fundamental in many tomographic imaging problems including x-ray scatter imaging and optical scatter imaging for certain media. In all cases, noisy measurements are affected by both local scatter events and nonlocal attenuation. Prior works focus on reconstructing one of two images: scatter density or total attenuation. However, both images are media specific and useful for object identification. Nonlocal effects of the attenuation image on the data are summarized by the broken ray transform (BRT). While analytic inversion formulas exist, poor conditioning of the inverse problem is only exacerbated by noisy measurements and sampling errors. This has motivated interest in the related star transforms incorporating BRT measurements from multiple source-detector pairs. However, all analytic methods operate on the log of the data. For media comprising regions with no scatter a new approach is required. We are the first to present a joint estimation algorithm based on Poisson data models for a single-scatter measurement geometry. Monotonic reduction of the log-likelihood function is guaranteed for our iterative algorithm while alternating image updates. We also present a fast algorithm for computing the discrete BRT forward operator. Our generalized approach can incorporate both transmission and scatter measurements from multiple source-detector pairs. Transmission measurements resolve low-frequency ambiguity in the joint image estimation problem, while multiple scatter measurements resolve the attenuation image. The benefits of joint estimation, over single-image estimation, vary with problem scaling. Our results quantify these benefits and should inform design of future acquisition systems.

Label-free dynamic segmentation and morphological analysis of subcellular optical scatterers.

Imaging without fluorescent protein labels or dyes presents significant advantages for studying living cells without confounding staining artifacts and with minimal sample preparation. Here, we combine label-free optical scatter imaging with digital segmentation and processing to create dynamic subcellular masks, which highlight significantly scattering objects within the cells' cytoplasms. The technique is tested by quantifying organelle morphology and redistribution during cell injury induced by calcium overload. Objects within the subcellular mask are first analyzed individually. We show that the objects' aspect ratio and degree of orientation ("orientedness") decrease in response to calcium overload, while they remain unchanged in untreated control cells. These changes are concurrent with mitochondrial fission and rounding observed by fluorescence, and are consistent with our previously published data demonstrating scattering changes associated with mitochondrial rounding during calcium injury. In addition, we show that the magnitude of the textural features associated with the spatial distribution of the masked objects' orientedness values, changes by more than 30% in the calcium-treated cells compared with no change or changes of less than 10% in untreated controls, reflecting dynamic changes in the overall spatial distribution and arrangement of subcellular scatterers in response to injury. Taken together, our results suggest that our method successfully provides label-free morphological signatures associated with cellular injury. Thus, we propose that dynamically segmenting and analyzing the morphology and organizational patterns of subcellular scatterers as a function of time can be utilized to quantify changes in a given cellular condition or state.

Design and calibration of a digital Fourier holographic microscope for particle sizing via goniometry and optical scatter imaging in transmission.

Goniometry and optical scatter imaging have been used for optical determination of particle size based upon optical scattering. Polystyrene microspheres in suspension serve as a standard for system validation purposes. The design and calibration of a digital Fourier holographic microscope (DFHM) are reported. Of crucial importance is the appropriate scaling of scattering angle space in the conjugate Fourier plane. A detailed description of this calibration process is described. Spatial filtering of the acquired digital hologram to use photons scattered within a restricted angular range produces an image. A pair of images, one using photons narrowly scattered within 8 - 15° (LNA), and one using photons broadly scattered within 8 - 39° (HNA), are produced. An image based on the ratio of these two images, OSIR = HNA/LNA, following Boustany et al. (2002), yields a 2D Optical Scatter Image (OSI) whose contrast is based on the angular dependence of photon scattering and is sensitive to the microsphere size, especially in the 0.5-1.0µm range. Goniometric results are also given for polystyrene microspheres in suspension as additional proof of principle for particle sizing via the DFHM.

Label-Free Classification of Bax/Bak Expressing vs. Double-Knockout Cells.

We combine optical scatter imaging with principal component analysis (PCA) to classify apoptosis-competent Bax/Bak-expressing, and apoptosis resistant Bax/Bak-null immortalized baby mouse kidney cells. We apply PCA to 100 stacks each containing 236 dark-field cell images filtered with an optically implemented Gabor filter with period between 0.3 and 2.9μm. Each stack yields an "eigencell" image corresponding to the first principal component obtained at one of the 100 Gabor filter periods used. At each filter period, each cell image is multiplied by (projected onto) the eigencell image. A Feature Matrix consisting of 236×100 scalar values is thus constructed with significantly reduced dimension compared to the initial dataset. Utilizing this Feature Matrix, we implement a supervised linear discriminant analysis and classify successfully the Bax/Bak-expressing and Bax/Bak-null cells with 94.7% accuracy and an area under the curve (AUC) of 0.993. Applying a feature selection algorithm further reveals that the Gabor filter period ranges most significant for the classification correspond to both large (likely nuclear) features as well as small sized features (likely organelles present in the cytoplasm). Our results suggest that cells with a genetic defect in their apoptosis pathway can be differentiated from their normal counterparts by label-free multi-parametric optical scatter data.

Quantitative x-ray dark-field computed tomography

The basic principles of x-ray image formation in radiology have remained essentially unchanged since Röntgen first discovered x-rays over a hundred years ago. The conventional approach relies on x-ray attenuation as the sole source of contrast and draws exclusively on ray or geometrical optics to describe and interpret image formation. Phase-contrast or coherent scatter imaging techniques, which can be understood using wave optics rather than ray optics, offer ways to augment or complement the conventional approach by incorporating the wave-optical interaction of x-rays with the specimen. With a recently developed approach based on x-ray optical gratings, advanced phase-contrast and dark-field scatter imaging modalities are now in reach for routine medical imaging and non-destructive testing applications. To quantitatively assess the new potential of particularly the grating-based dark-field imaging modality, we here introduce a mathematical formalism together with a material-dependent parameter, the so-called linear diffusion coefficient and show that this description can yield quantitative dark-field computed tomography (QDFCT) images of experimental test phantoms.

Alterations in the characteristic size distributions of subcellular scatterers at the onset of apoptosis: effect of Bcl-&lt;inline-formula&gt;&lt;math display="inline" overflow="scroll"&gt;&lt;msub&gt;&lt;mi mathvariant="normal"&gt;x&lt;/mi&gt;&lt;mi mathvariant="normal"&gt;L&lt;/mi&gt;&lt;/msub&gt;&lt;/math&gt;&lt;/inline-formula&gt; and Bax/Bak

Optical scatter imaging is used to estimate organelle size distributions in immortalized baby mouse kidney cells treated with 0.4 microM staurosporine to induce apoptosis. The study comprises apoptosis competent iBMK cells (W2) expressing the proapoptotic proteins Bax/Bak, apoptosis resistant Bax/Bak null cells (D3), and W2 and D3 cells expressing yellow fluorescent protein (YFP) or YFP fused to the antiapoptotic protein Bcl-x(L) (YFP-Bcl-x(L)). YFP expression is diffuse within the transfected cells, while YFP-Bcl-x(L) is localized to the mitochondria. Our results show a significant increase in the mean subcellular particle size from approximately 1.1 to 1.4 microm in both Bax/Bak expressing and Bax/Bak null cells after 60 min of STS treatment compared to DMSO-treated control cells. This dynamic is blocked by overexpression of YFP-Bcl-x(L) in Bax/Bak expressing cells, but is less significantly inhibited by YFP-Bcl-x(L) in Bax/Bak null cells. Our data suggest that the increase in subcellular particle size at the onset of apoptosis is modulated by Bcl-x(L) in the presence of Bax/Bak, but it occurs upstream of the final commitment to programmed cell death. Mitochondrial localization of YFP-Bcl-x(L) and the finding that micron-sized particles give rise to the scattering signal further suggest that alterations in mitochondrial morphology may underlie the observed changes in light scattering.

Microscopic imaging and spectroscopy with scattered light.

Optical contrast based on elastic scattering interactions between light and matter can be used to probe cellular structure, cellular dynamics, and image tissue architecture. The quantitative nature and high sensitivity of light scattering signals to subtle alterations in tissue morphology, as well as the ability to visualize unstained tissue in vivo, has recently generated significant interest in optical-scatter-based biosensing and imaging. Here we review the fundamental methodologies used to acquire and interpret optical scatter data. We report on recent findings in this field and present current advances in optical scatter techniques and computational methods. Cellular and tissue data enabled by current advances in optical scatter spectroscopy and imaging stand to impact a variety of biomedical applications including clinical tissue diagnosis, in vivo imaging, drug discovery, and basic cell biology.

Optical scatter changes at the onset of apoptosis are spatially associated with mitochondria

We combine optical scatter imaging (OSI) with fluorescence imaging of mitochondria to investigate the spatial relationship between the optical scatter signal and the location and structure of mitochondria within endothelial cells undergoing apoptosis. The OSI data corroborate our previous results showing a decrease in the intensity ratio of wide-to-narrow angle scatter [optical scatter image ratio (OSIR)] during the first 60 min of apoptosis. In addition, we find here that this is followed by an increase in OSIR concurrent with mitochondrial fragmentation. We demonstrate that the dynamic change in light scattering is spatially associated with subcellular regions containing fluorescently labeled mitochondria, and remains absent from adjacent nonfluorescent regions dominated by other organelles. These results lend strong support to the hypothesis that mitochondria act as the source of the optical scatter changes measured at the onset of apoptosis.

Optical Scatter Imaging with a digital micromirror device

We had developed Optical Scatter Imaging (OSI) as a method which combines light scattering spectroscopy with microscopic imaging to probe local particle size in situ. Using a variable diameter iris as a Fourier spatial filter, the technique consisted of collecting images that encoded the intensity ratio of wide-to-narrow angle scatter at each pixel in the full field of view. In this paper, we replace the variable diameter Fourier filter with a digital micromirror device (DMD) to extend our assessment of morphology to the characterization of particle shape and orientation. We describe our setup in detail and demonstrate how to eliminate aberrations associated with the placement of the DMD in a conjugate Fourier plane of our microscopic imaging system. Using bacteria and polystyrene spheres, we show how this system can be used to assess particle aspect ratio even when imaged at low resolution. We also show the feasibility of detecting alterations in organelle aspect ratio in situ within living cells. This improved OSI system could be further developed to automate morphological quantification and sorting of non-spherical particles in situ.

Optical scatter imaging using digital Fourier microscopy

An approach reported recently by Alexandrov et al (2005 Int. J. Imag. Syst. Technol. 14 253–8) on optical scatter imaging, termed digital Fourier microscopy (DFM), represents an adaptation of digital Fourier holography to selective imaging of biological matter. The holographic mode of the recording of the sample optical scatter enables reconstruction of the sample image. The form-factor of the sample constituents provides a basis for discrimination of these constituents implemented via flexible digital Fourier filtering at the post-processing stage. As in dark-field microscopy, the DFM image contrast appears to improve due to the suppressed optical scatter from extended sample structures. In this paper, we present the theoretical and experimental study of DFM using a biological phantom that contains polymorphic scatterers.

BCL-x L-Dependent Light Scattering by Apoptotic Cells

We measured the intensity ratio of wide-to-narrow angle scatter, optical scatter image ratio (OSIR), in single cells during apoptosis and after overexpression of the mitochondria-bound antiapoptotic protein BCL-x L. OSIR is sensitive to particle size/shape for objects with wavelength-scale dimensions, and was used as a morphometric measure of cellular response. Three cell variants were treated with staurosporine (STS): nontransfected parental CSM14.1, CSM14.1 stably expressing yellow fluorescent protein (YFP) with diffuse YFP fluorescence, and apoptosis-resistant CSM14.1 stably expressing the fusion protein construct YFP-BCL-x L with YFP fluorescence localized on the mitochondria. After treatment with 1 or 2 μM STS, the measured OSIR decreased monotonically by ∼25% in the nontransfected and YFP variants, and reached a steady-state value 40–60 min after STS treatment. The decrease in OSIR at the onset of apoptosis preceded phosphatidyl serine exposure by 5 h. In the YFP-BCL-x L cell variant, the initial OSIR was already ∼24% lower than the initial OSIR in YFP and nontransfected cells, and only decreased by <10% after STS treatment. Alterations in light scattering by cells overexpressing BCL-x L even before apoptosis induction raise interesting questions as to the role of BCL-x L in conferring apoptosis resistance by preconditioning the cells and possibly altering mitochondrial morphology.

Optical Scatter Imaging Detects Mitochondrial Swelling in Living Tissue Slices

Mitochondrial swelling is observed in neuronal injury and is a key event in many pathways to cell death. Currently, there is no technique for directly measuring mitochondrial size changes within living tissue slices with a field of view of several millimeters. In this paper, we test our hypothesis that Mie light-scatter theory can be used to study mitochondrial swelling in living tissue sections. Using a unique dual-angle scatter ratio (DASR) optical imaging system previously demonstrated to be sensitive to latex particle size changes and N-methyl-D-aspartate (NMDA) treatment of hippocampal slices, we studied mitochondrial swelling induced by 500 μM NMDA treatment of hippocampal slices. We observed a strong ( R 2 = 0.73) and significant ( P < 0.000005) correlation between the electron microscopy-determined diameters of swollen, intact mitochondria and the DASR imaging. We examined the robustness of the technique by evaluating the correlation between the dual-angle scatter ratio and the diameter of the dendrites, observed to swell, in NMDA-treated slices and found no correlation ( R 2 = 0.06). The advantage of DASR imaging over electron microscopy or other methods of studying mitochondrial swelling is the sensitivity of DASR imaging to mitochondrial swelling over a large field of view (>9 mm 2) in an intact tissue slice. This novel technique may allow for the study of regional changes in mitochondrial swelling and recovery as sequential events within a single specimen. This technique will eventually be useful in studying the efficacy of stroke and other disease therapies targeting mitochondrial swelling.

Calcium-Induced Alterations in Mitochondrial Morphology Quantified in Situ with Optical Scatter Imaging

Optical scatter imaging (OSI), a technique we developed recently, was used to measure the ratio of wide-to-narrow angle scatter (OSIR) within endothelial cells subjected to calcium overload (1.6 mM) after permeabilization by ionomycin. Within a few minutes of calcium overload, the mitochondria, which started as elongated organelles, rounded up into spherically shaped particles. This change in morphology was accompanied by a statistically significant 14% increase in OSIR in the cells’ cytoplasm. Mitochondrial rounding and OSIR increase were suppressed by cyclosporin A (25 μM), implying that the observed geometrical and scattering changes were directly attributable to the mitochondrial permeability transition. The angular scattering properties of a long mitochondrion rounding up were approximated by numerical simulations of light scatter from an ellipsoid rounding up into a sphere. The simulations predicted a relative increase in OSIR comparable to that measured experimentally for the case where the shape transition takes place with little or no volume increase. The simulations also suggested that mitochondrial refractive index changes could not account for the OSIR changes observed. Our data show that changes in OSIR correlate with mitochondrial morphology change in situ. OSI provides a new tool for subcellular imaging and complements other microscopy methods, such as fluorescence.

Protection by rapid chemical preconditioning of stressed hippocampal slice: a study of cellular swelling using optical scatter imaging

It has been demonstrated that anoxic preconditioning protects against a subsequent ‘lethal’ injury in the hippocampal slice. The goal of this paper was to test the hypothesis that chemical preconditioning could help reduce the cellular swelling observed in excitotoxically injured hippocampal slices. The control slice was given a 10-min insult of 100 μM N-methyl- d-aspartate (NMDA) to simulate ischemic injury, followed by 30-min perfusion of standard Ringers solution. Cellular swelling was observed with a microscope designed to image light scatter changes resulting from cellular swelling. After the control NMDA injury, the average peak scatter change for CA1, CA3 and DG regions was 31.0±3.4, 22.4±4.8 and 27.6±4.6%, respectively. The peak scatter change of the overall slice was 26.0±3.6%. The experimental slices were preconditioned by three short 100 μM NMDA insults of 15 s each separated by 10 min of standard Ringers solution perfusion. The slices then received 10 min of ‘lethal’ injury by 100 μM NMDA. It was observed that the overall scatter signal, as a measure of cellular swelling, was reduced by 8.0% ( P<0.05, n=11) after preconditioning. A regional heterogeneity in the responses was also observed. Cellular swelling in CA1, CA3 and DG were reduced by 9.8% ( P<0.001, n=11), 9.2% ( P<0.005, n=11) and 7.7% ( P<0.05, n=11), respectively, when compared to the control. This study presents experimental evidence that short episodes of preconditioning may protect against acute cellular swelling under ischemic conditions.

Optical Scatter Imaging for In situ Subcellular Morphometry

Please provide author affiliations Figure 1. Optical Scatter Imaging. Representative cell undergoing programmed cell death (apoptosis). Differential Interference Contrast (DIC) images (left panels) and OSI images (right panels) are displayed at times t = -7 and 37 min. before and after apoptosis induction at t=0. C and N respectively point to the cytoplasm and nucleus. The decreased scatter ratio within the cytoplasm at t = 37 is consistent with an increase in the average particle size within the cytoplasm, and might be attributable to a loss in the volume homeostasis of mitochondria. OSI complements current microscopic techniques such as DIC by revealing subcellular alterations that might otherwise remain undetected in conventional microscopic images. OSIR = Optical Scatter Image Ratio.

Optical scatter imaging: subcellular morphometry in situ with Fourier filtering

We demonstrate a quantitative optical scatter imaging (OSI) technique, based on Fourier filtering, for detecting alterations in the size of particles with wavelength-scale dimensions. We generate our scatter image by taking the ratio of images collected at high and low numerical aperture in central dark-field microscopy. Such an image spatially encodes the ratio of wide to narrow angle scatter and hence provides a measure of local particle size. We validated OSI on sphere suspensions and live cells. In live cells, OSI revealed biochemically induced morphological changes that were not apparent in unprocessed differential interference contrast images. Unlike high-resolution imaging methods, OSI can provide size information for particles smaller than the camera's spatial resolution.

Optical light scatter imaging of cellular and sub-cellular morphology changes in stressed rat hippocampal slices

Optical imaging, such as transmission imaging, is used to study brain tissue injury. Transmission imaging detects cellular swelling via an increase in light transmitted by tissue slices due to a decrease in scattering particle concentration. Transmission imaging cannot distinguish sub-cellular particle size changes from cellular swelling or shrinkage. We present an optical imaging method, based on Mie scatter theory, to detect changes in sub-cellular particle size and concentration. The system uses a modified inverted microscope and a 16-bit cooled CCD camera to image tissue light scatter at two angles. Dual-angle scatter ratio imaging successfully discriminated latex microsphere suspensions of differing sizes (0.6, 0.8, 1 and 2 μm) and concentrations. We applied scatter imaging to hippocampal slices treated with 100 μM N-methyl- d-aspartate (NMDA) to model excitotoxic injury or −40 mOsm hypotonic perfusion solution to cause edema injury. We detected light scatter decreases similar to transmission imaging in the CA1 region of the hippocampus for both treatments. Using our system, we could distinguish between NMDA and hypotonic treatments on the basis of statistically significant ( P<0.0003) differences in the scatter ratio measured in CA1. Scatter imaging should be useful in studying tissue injuries or activity resulting in brain tissue swelling as well as morphological changes in sub-cellular organelles such as mitochondrial swelling.