Ptychography Research Articles

Deep Multi-Feature Transfer Network for Fourier Ptychographic Microscopy Imaging Reconstruction.

Fourier ptychographic microscopy (FPM) is a potential imaging technique, which is used to achieve wide field-of-view (FOV), high-resolution and quantitative phase information. The LED array is used to irradiate the samples from different angles to obtain the corresponding low-resolution intensity images. However, the performance of reconstruction still suffers from noise and image data redundancy, which needs to be considered. In this paper, we present a novel Fourier ptychographic microscopy imaging reconstruction method based on a deep multi-feature transfer network, which can achieve good anti-noise performance and realize high-resolution reconstruction with reduced image data. First, in this paper, the image features are deeply extracted through transfer learning ResNet50, Xception and DenseNet121 networks, and utilize the complementarity of deep multiple features and adopt cascaded feature fusion strategy for channel merging to improve the quality of image reconstruction; then the pre-upsampling is used to reconstruct the network to improve the texture details of the high-resolution reconstructed image. We validate the performance of the reported method via both simulation and experiment. The model has good robustness to noise and blurred images. Better reconstruction results are obtained under the conditions of short time and low resolution. We hope that the end-to-end mapping method of neural network can provide a neural-network perspective to solve the FPM reconstruction.

A lensless LED matrix-based ptychographic microscopy imaging method using loss correction and adaptive step size

Lensless microscopy is an emerging technology that does not rely on the lens to focus and record the measured value. In conventional ptychography, the incremental gradient methods are widely used because of the superior computing efficiency and flexibility. However, because there are usually various noises collected by the sensor, which causes the reconstruction result to degrade sharply. The key point is how to control and design the step size. Therefore, we propose a loss correction algorithm with adaptive step size for lensless ptychography via multi-angle LED illumination. We add a loss correction term and adjust the step size according to the value of this term, which can effectively improve the convergence performance of the algorithm and can significantly improve the algorithm's anti-noise ability. Comparing with classical methods, both simulations and experiments prove that our method is better in efficiency and quality. Meanwhile, the results indicate the initial step size can be appropriately increased to improve the convergence speed without reducing the reconstruction quality.

Lessons learned from FeSb2O4 on stereoactive lone pairs as a design principle for anion insertion

Fluoride-ion batteries are an attractive energy storage concept analogous to lithium-ion batteries but feature an inverted paradigm where anions are the principal charge carriers. Insertion hosts that can reversibly insert fluoride ions at room temperature are exceedingly sparse. Here, we report that topochemical insertion of fluoride ions in FeSb 2 O 4 involves Fe 2+ /Fe 3+ redox but is mediated by multi-center synergies between iron and antimony centers. Separation of the redox center from the p-block coordination site alleviates structural strain by enabling compensatory contraction and expansion of FeO 6 and SbO 3 polyhedra, respectively. p-block electron lone pairs play a critical role in weakening anion-lattice interactions, enabling reversible fluoride-ion diffusion across microns. The results illuminate the key principle that interactions traceable to stereoactive lone pairs can be used to mediate anion-lattice interactions and suggest that anion insertion hosts can be designed by pairing redox-active transition metals with p-block cations bearing stereochemically active electron lone pairs. Topochemical insertion of fluoride ions is mediated by synergies between Fe and Sb centers p-block electron lone pairs weaken anion-lattice interactions X-ray ptychography imaging demonstrates bulk fluoride-ion diffusion Sb 5 s 2 electron lone pairs enable fluoride-ion deinsertion and facile diffusion Despite several decades of research, fundamental design principles for anion insertion in crystalline lattices remain poorly explored. Zaheer et al. provide a fundamental design principle based on electronic structure considerations that allows use of anions (fluoride ions) instead of cations for electrochemical energy storage.

Collaborative software solutions and data standards for ptychographic imaging

Collaborative software solutions and data standards for ptychographic imaging

Development and application of a tender X-ray ptychographic coherent diffraction imaging system on BL27SU at SPring-8.

Ptychographic coherent diffraction imaging (CDI) allows the visualization of both the structure and chemical state of materials on the nanoscale, and has been developed for use in the soft and hard X-ray regions. In this study, a ptychographic CDI system with pinhole or Fresnel zone-plate optics for use in the tender X-ray region (2-5 keV) was developed on beamline BL27SU at SPring-8, in which high-precision pinholes optimized for the tender energy range were used to obtain diffraction intensity patterns with a low background, and a temperature stabilization system was developed to reduce the drift of the sample position. A ptychography measurement of a 200 nm thick tantalum test chart was performed at an incident X-ray energy of 2.500 keV, and the phase image of the test chart was successfully reconstructed with approximately 50 nm resolution. As an application to practical materials, a sulfur polymer material was measured in the range of 2.465 to 2.500 keV including the sulfur K absorption edge, and the phase and absorption images were successfully reconstructed and the nanoscale absorption/phase spectra were derived from images at multiple energies. In 3 GeV synchrotron radiation facilities with a low-emittance storage ring, the use of the present system will allow the visualization on the nanoscale of the chemical states of various light elements that play important roles in materials science, biology and environmental science.

Quantitative phase measurements of human cell nuclei using X-ray ptychography.

The human cell nucleus serves as an important organelle holding the genetic blueprint for life. In this work, X-ray ptychography was applied to assess themasses of human cell nuclei using its unique phase shift information. Measurements were carried out at the I13-1 beamline at the Diamond Light Source that has extremely large transverse coherence properties. The ptychographic diffractive imaging approach allowed imaging of large structures that gave quantitative measurements of the phase shift in 2D projections. In this paper a modified ptychography algorithm that improves the quality of the reconstruction for weak scattering samples is presented. The application of this approach to calculate the mass of several human nuclei is also demonstrated.

Mask-modulated lensless imaging via translated structured illumination.

Lensless microscopy technique enables high-resolution image recovery over a large field of view. By integrating the concept of phase retrieval, it can also retrieve the lost phase information from intensity-only measurements. Here we report a mask-modulated lensless imaging platform based on translated structured illumination. In the reported platform, we sandwich the object in-between a coded mask and a naked image sensor for lensless data acquisition. An LED array is used to provide angle-varied illumination for projecting a translated structured pattern without involving mechanical scanning. For different LED elements, we acquire the lensless intensity data for recovering the complex-valued object. In the reconstruction process, we employ the regularized ptychographic iterative engine and implement an up-sampling process in the reciprocal space. As demonstrated by experimental results, the reported platform is able to recover complex-valued object images with higher resolution and better quality than previous implementations. Our approach may provide a cost-effective solution for high-resolution and wide field-of-view ptychographic imaging without involving mechanical scanning.

X-ray Ptychography Imaging of Human Chromosomes After Low-dose Irradiation

Studies of the structural and functional role of chromosomes in cytogenetics have spanned more than 10 decades. In this work, we take advantage of the coherent X-rays available at the latest synchrotron sources to extract the individual masses of all 46 chromosomes of metaphase human B and T cells using hard X-ray ptychography. We have produced ‘X-ray karyotypes’ of both heavy metal–stained and unstained spreads to determine the gain or loss of genetic material upon low-level X-ray irradiation doses due to radiation damage. The experiments were performed at the I-13 beamline, Diamond Light Source, Didcot, UK, using the phase-sensitive X-ray ptychography method.

Plasmon-induced enhancement of ptychographic phase microscopy via sub-surface nanoaperture arrays

The invention of phase contrast microscopy revolutionized optics, enabling the visualization of highly optically transparent samples without the need for staining. The technique utilizes phase shifts within the sample and is routinely employed in the characterization of biological material and other weakly interacting objects. However, the demand for increased contrast and quantification has continued to drive research into more advanced approaches to phase imaging. Here, we demonstrate that the combination of ptychographic coherent diffractive imaging with plasmonically active metamaterials yields a massive enhancement of both the reconstructed phase and amplitude by exploiting near-field interactions at the metamaterial surface. We present results from nanofabricated samples and tissue sections with thickness ranging from 4 nm to 4 μm. In addition to enabling quantitative phase imaging of metamaterials, this approach opens the way to imaging a wide range of extremely thin or highly transparent objects previously inaccessible to optical microscopy. Plasmonics and metamaterials enable ptychographic coherent diffractive imaging with improved reconstructed phase and amplitude. The approach may be particularly useful for imaging of extremely thin or highly transparent objects.

4D Imaging of ZnO-Coated Nanoporous Al2O3 Aerogels by Chemically Sensitive Ptychographic Tomography: Implications for Designer Catalysts

The 3D chemical structure (4D spectromicroscopy) of nanoporous Al2O3 aerogels coated with ZnO by atomic layer deposition (ALD) was studied by multienergy scanning transmission X-ray microscopy. These materials are representative of a class of designer catalysts in which the nanoporous support is prepared separately from the active catalyst material, which is subsequently introduced by ALD, thereby allowing independent optimization of the morphology, chemistry, and spatial distribution of the support and catalyst. The samples studied were prepared by Ga ion and Xe plasma focused ion beam (FIB) milling as well as drop casting from water suspension. Zn L and Al K edge spectra of six samples with three different ZnO loadings were measured to investigate how loading and different sample preparation methods affect the 3D distribution of the ZnO and Al2O3. Scanning transmission X-ray microscopy (STXM) and ptychographic imaging at two energies each at the Zn L3 and Al K edge were measured. The ptychography data were analyzed by using the SHARP reconstruction code to generate quantitative 2D chemical maps of the Al2O3 and the ZnO. The STXM and ptychography maps were then measured at a sequence of tilt angles, covering up to 160° of rotation. The 3D structure of the ZnO and Al2O3 was derived from the tilt series data by tomographic reconstruction using a compressed sensing algorithm. A two-dimensional spatial resolution (half-period) of 6 nm, measured by Fourier ring correlation, and a 3D spatial resolution (half-period) of 9 nm, measured by Fourier shell correlation, were achieved when using the COSMIC beamline at the Advanced Light Source (ALS). The results show that for all of the ZnO loadings studied there is nonuniform coverage of the ZnO on the Al2O3 aerogel framework. In addition, we found that both FIB methods create sample artifacts, although the distortion was less with Xe plasma than Ga ion FIB.

Overlapping Domain Decomposition Methods for Ptychographic Imaging

In ptychography experiments, redundant scanning is usually required to guarantee the stable recovery, such that a huge number of frames are generated, and thus it poses a great demand on parallel c...

Broadband X-ray ptychography using multi-wavelength algorithm.

Ptychography is a rapidly developing scanning microscopy which is able to view the internal structures of samples at a high resolution beyond the illumination size. The achieved spatial resolution is theoretically dose-limited. A broadband source can provide much higher flux compared with a monochromatic source; however, it conflicts with the necessary coherence requirements of this coherent diffraction imaging technique. In this paper, a multi-wavelength reconstruction algorithm has been developed to deal with the broad bandwidth in ptychography. Compared with the latest development of mixed-state reconstruction approach, this multi-wavelength approach is more accurate in the physical model, and also considers the spot size variation as a function of energy due to the chromatic focusing optics. Therefore, this method has been proved in both simulation and experiment to significantly improve the reconstruction when the source bandwidth, illumination size and scan step size increase. It is worth mentioning that the accurate and detailed information of the energy spectrum for the incident beam is not required in advance for the proposed method. Further, we combine multi-wavelength and mixed-state approaches to jointly solve temporal and spatial partial coherence in ptychography so that itcan handle various disadvantageous experimental effects. The significant relaxation in coherence requirements by our approaches allows the use of high-flux broadband X-ray sources for high-efficient and high-resolution ptychographic imaging.

Optofluidic ptychography on a chip.

We report the implementation of a fully on-chip, lensless microscopy technique termed optofluidic ptychography. This imaging modality complements the miniaturization provided by microfluidics and allows the integration of ptychographic microscopy into various lab-on-a-chip devices. In our prototype, we place a microfluidic channel on the top surface of a coverslip and coat the bottom surface with a scattering layer. The channel and the coated coverslip substrate are then placed on top of an image sensor for diffraction data acquisition. Similar to the operation of a flow cytometer, the device utilizes microfluidic flow to deliver specimens across the channel. The diffracted light from the flowing objects is modulated by the scattering layer and recorded by the image sensor for ptychographic reconstruction, where high-resolution quantitative complex images are recovered from the diffraction measurements. By using an image sensor with a 1.85 μm pixel size, our device can resolve the 550 nm linewidth on the resolution target. We validate the device by imaging different types of biospecimens, including C. elegans, yeast cells, paramecium, and closterium sp. We also demonstrate a high-resolution ptychographic reconstruction at a video framerate of 30 frames per second. The reported technique can address a wide range of biomedical needs and engenders new ptychographic imaging innovations in a flow cytometer configuration.

Fourier ptychographic rapid superresolution imaging via line-scanning microscopy with virtual structural- modulated

In this paper, we proposed a new method that combines virtual structural-modulated (VSM), line-scanning microscopy (LSM) and the Fourier ptychography (FP) algorithm to rapid super-resolution imaging. VSM provides an easy, low-cost and phase-artifact-free strategy to achieve super-resolution imaging. However, the practical application of this method is challenging due to a limited image acquisition speed and signal-to-noise ratio (SNR). We report here the combination of VSM, LSM, and FP algorithm to improve the image acquisition speed, resolution and SNR. The recovery process starts with a low-resolution intensity image as the initial guess. This initial guess is then sequentially updated by other low-resolution measurements taken under virtual modulation patterns with different spatial frequencies and phases. This sequential updating process is iterated until the sample estimate converges. The images with high resolution and SNR are reconstructed by iterating in the Fourier domain and the space domain. Both an optical resolution target, fluorescent beads, and BPAE cells were used to verify resolution enhancement. As the FP algorithm is fully compatible with vLSM, it may provide a turnkey solution for imaging biological samples with 2 times lateral resolution of wide-field and improved SNR and imaging speed.

Ptychographic imaging and micromagnetic modeling of thermal melting of nanoscale magnetic domains in antidot lattices

Antidot lattices are potential candidates to act as bit patterned media for data storage as they are able to trap nanoscale magnetic domains between two adjacent holes. Here, we demonstrate the combination of micromagnetic modeling and x-ray microscopy. Detailed simulation of these systems can only be achieved by micromagnetic modeling that takes thermal effects into account. For this purpose, a Landau–Lifshitz–Bloch approach is used here. The calculated melting of magnetic domains within the antidot lattice is reproduced experimentally by x-ray microscopy. Furthermore, we compare conventional scanning transmission x-ray microscopy with resolution enhanced ptychography. Hence, we achieve a resolution of 13 nm. The results demonstrate that ptychographic imaging can also recover magnetic contrast in the presence of a strong topological variation and is generally applicable toward magnetic samples requiring ultimate resolution.

Detection of double orbital angular momentum modes in monochromic dynamic bi-orbital angular momentum multiplexing by ptychography

Coherent diffractive ptychographic imaging via a modified multi-state ptychographic algorithm can be used to simultaneously detect double orbital angular momentum (OAM) modes in monochromatic bi-OAM-mode multiplexing. The wavefronts for individual vortex beams modulated by two-dimensional amplitude and temporal pulses and mixed together can be reconstructed independently. In contrast to most other OAM detection methods, this approach solves for the OAM detection in a monochromatic dynamic multi-OAM beam and can be applied as an early step in OAM mode demultiplexing.

Multi-beam X-ray ptychography for high-throughput coherent diffraction imaging

X-ray ptychography is a rapidly developing coherent diffraction imaging technique that provides nanoscale resolution on extended field-of-view. However, the requirement of coherence and the scanning mechanism limit the throughput of ptychographic imaging. In this paper, we propose X-ray ptychography using multiple illuminations instead of single illumination in conventional ptychography. Multiple locations of the sample are simultaneously imaged by spatially separated X-ray beams, therefore, the obtained field-of-view in one scan can be enlarged by a factor equal to the number of illuminations. We have demonstrated this technique experimentally using two X-ray beams focused by a house-made Fresnel zone plate array. Two areas of the object and corresponding double illuminations were successfully reconstructed from diffraction patterns acquired in one scan, with image quality similar with those obtained by conventional single-beam ptychography in sequence. Multi-beam ptychography approach increases the imaging speed, providing an efficient way for high-resolution imaging of large extended specimens.

Reference-free quantitative microscopic imaging of coherent arbitrary vectorial light beams.

Precise spatial characterization of vectorial beams is crucial for many advanced optical experiments, but challenging when wavefront and polarization features are involved together. Here we propose a reference-free method aimed at extracting the map of the complex-amplitude components of any coherent beam at an optical-microscopy resolution. Our method exploits recent advances in ptychographic imaging approaches. We emphasize its versatility by reconstructing successfully various experimental vectorial beams including polarization and phase vortices, the exit field of a multicore fiber and a speckle pattern.

Backside-illuminated scientific CMOS detector for soft X-ray resonant scattering and ptychography.

The impressive progress in the performance of synchrotron radiation sources is nowadays driven by the so-called `ultimate storage ring' projects which promise an unprecedented improvement in brightness. Progress on the detector side has not always been at the same pace, especially as far as soft X-ray 2D detectors are concerned. While the most commonly used detectors are still based on microchannel plates or CCD technology, recent developments of CMOS (complementary metal oxide semiconductor)-type detectors will play an ever more important role as 2D detectors in the soft X-ray range. This paper describes the capabilities and performance of a camera equipped with a newly commercialized backside-illuminated scientific CMOS (sCMOS-BSI) sensor, integrated in a vacuum environment, for soft X-ray experiments at synchrotron sources. The 4 Mpixel sensor reaches a frame rate of up to 48 frames s-1 while matching the requirements for X-ray experiments in terms of high-intensity linearity (>98%), good spatial homogeneity (<1%), high charge capacity (up to 80 ke-), and low readout noise (down to 2 e- r.m.s.) and dark current (3 e- per second per pixel). Performance evaluations in the soft X-ray range have been carried out at the METROLOGIE beamline of the SOLEIL synchrotron. The quantum efficiency, spatial resolution (24 line-pairs mm-1), energy resolution (<100 eV) and radiation damage versus the X-ray dose (<600 Gy) have been measured in the energy range from 40 to 2000 eV. In order to illustrate the capabilities of this new sCMOS-BSI sensor, several experiments have been performed at the SEXTANTS and HERMES soft X-ray beamlines of the SOLEIL synchrotron: acquisition of a coherent diffraction pattern from a pinhole at 186 eV, a scattering experiment from a nanostructured Co/Cu multilayer at 767 eV and ptychographic imaging in transmission at 706 eV.

Well-conditioned ptychographic imaging via lost subspace completion

Ptychography, a special case of the phase retrieval problem, is a popular method in modern imaging. Its measurements are based on the shifts of a locally supported window function. In general, direct recovery of an object from such measurements is known to be an ill-posed problem. Although for some windows the conditioning can be controlled, for a number of important cases it is not possible, for instance for Gaussian windows. In this paper we develop a subspace completion algorithm, which enables stable reconstruction for a much wider choice of windows, including Gaussian windows. The combination with a regularization technique leads to improved conditioning and better noise robustness.