Light Imaging Research Articles

An Ultrasensitive Bi2O2Se/In2S3 Photodetector with Low Detection Limit and Fast Response toward High-Precision Unmanned Driving.

The machine vision utilized in unmanned driving systems must possess the ability to accurately perceive scenes under low-light illumination conditions. To achieve this, photodetectors with low detection limits and a fast response are essential. Current systems rely on avalanche diodes or lidars, which come with the drawbacks of increased energy consumption and complexity. Here, we present an ultrasensitive photodetector based on a two-dimensional (2D) Bi2O2Se/In2S3 heterostructure, incorporating a homotype unilateral depletion band design. This innovative architecture effectively modulates the transport of both free and photoexcited carriers, suppressing the dark current and facilitating the rapid and efficient separation of photocarriers. Owing to these features, this device exhibits a responsivity of 144 A/W, a specific detectivity of 1.2 × 1014 Jones, and a light on/off ratio of 1.1 × 105. These metrics rank among the top values reported for state-of-the-art 2D devices. Moreover, this device also demonstrates a fast response time of 170/296 μs and a low noise equivalent power of 0.57 fW/Hz1/2, attributes that endow it with ultraweak light imaging capabilities. Furthermore, we have successfully integrated this device into an unmanned driving system, providing a perspective on the design and fabrication of future optoelectronic devices.

ACDF-YOLO: Attentive and Cross-Differential Fusion Network for Multimodal Remote Sensing Object Detection

Object detection in remote sensing images has received significant attention for a wide range of applications. However, traditional unimodal remote sensing images, whether based on visible light or infrared, have limitations that cannot be ignored. Visible light images are susceptible to ambient lighting conditions, and their detection accuracy can be greatly reduced. Infrared images often lack rich texture information, resulting in a high false-detection rate during target identification and classification. To address these challenges, we propose a novel multimodal fusion network detection model, named ACDF-YOLO, basedon the lightweight and efficient YOLOv5 structure, which aims to amalgamate synergistic data from both visible and infrared imagery, thereby enhancing the efficiency of target identification in remote sensing imagery. Firstly, a novel efficient shuffle attention module is designed to assist in extracting the features of various modalities. Secondly, deeper multimodal information fusion is achieved by introducing a new cross-modal difference module to fuse the features that have been acquired. Finally, we combine the two modules mentioned above in an effective manner to achieve ACDF. The ACDF not only enhances the characterization ability for the fused features but also further refines the capture and reinforcement of important channel features. Experimental validation was performed using several publicly available multimodal real-world and remote sensing datasets. Compared with other advanced unimodal and multimodal methods, ACDF-YOLO separately achieved a 95.87% and 78.10% mAP0.5 on the LLVIP and VEDAI datasets, demonstrating that the deep fusion of different modal information can effectively improve the accuracy of object detection.

Deep diffusion learning of mutual-reflective structured light patterns for multi-body three-dimensional imaging

Simultaneous structured light imaging of multiple objects has become more demanding and widely in many scenarios involving robot operations in intelligent manufacturing. However, it is challenged by pattern aliasing caused by mutual reflection between high-reflective objects. To this end, we propose to learn clear fringe patterns from aliased mutual-reflective observations by diffusion models for achieving high-fidelity multi-body reconstruction in line with typical phase-shift algorithms. Regarding mutual reflection imaging as a formation of adding significant noise, we build a supervised generative learning framework based on diffusion models and then train a self-attention-based deep network with a U-Net-like skip-connected encoder-decoder architecture. We demonstrate the generalization capability of the trained model in fringe pattern recovery and its performance in phase and three-dimensional (3D) shape reconstruction. Both experimental results show that the proposed method has the expected feasibility and accuracy, heralding a promising solution for addressing the current challenge in various multi-body mutual-reflective 3D reconstruction tasks.

Design of a Novel Microlens Array and Imaging System for Light Fields.

Light field cameras are unsuitable for further acquisition of high-quality images due to their small depth of field, insufficient spatial resolution, and poor imaging quality. To address these issues, we proposed a novel four-focal-square microlens and light field system. A square aspheric microlens array with four orthogonal focal lengths was designed, in which the aperture of a single lens was 100 μm. The square arrangement improves pixel utilization, the four focal lengths increase the depth of field, and the aspheric improves image quality. The simulations demonstrate pixel utilization rates exceeding 90%, depth-of-field ranges 6.57 times that of a single focal length, and image quality is significantly improved. We have provided a potential solution for improving the depth of field and image quality of the light field imaging system.

Retraction Note: Light image enhancement and virtual reality application in automatic generation of basketball game scenes and training data simulation

Retraction Note: Light image enhancement and virtual reality application in automatic generation of basketball game scenes and training data simulation

Retraction Note: Design of fine motion control system for aerobics athletes based on light imaging equipment detection and image processing technology

Retraction Note: Design of fine motion control system for aerobics athletes based on light imaging equipment detection and image processing technology

Retraction Note: Application of wearable light imaging device based on particle search algorithm in sports competition motion simulation

Retraction Note: Application of wearable light imaging device based on particle search algorithm in sports competition motion simulation

Retraction Note: Light imaging detection based on cluster analysis for the prevention of sports injury in tennis players

Retraction Note: Light imaging detection based on cluster analysis for the prevention of sports injury in tennis players

Decreased GABA levels during development result in increased connectivity in the larval zebrafish tectum.

γ-aminobutyric acid (GABA) is an abundant neurotransmitter that plays multiple roles in the vertebrate central nervous system (CNS). In the early developing CNS, GABAergic signaling acts to depolarize cells. It mediates several aspects of neural development, including cell proliferation, neuronal migration, neurite growth, and synapse formation, as well as the development of critical periods. Later in CNS development, GABAergic signaling acts in an inhibitory manner when it becomes the predominant inhibitory neurotransmitter in the brain. This behavior switch occurs due to changes in chloride/cation transporter expression. Abnormalities of GABAergic signaling appear to underlie several human neurological conditions, including seizure disorders. However, the impact of reduced GABAergic signaling on brain development has been challenging to study in mammals. Here we take advantage of zebrafish and light sheet imaging to assess the impact of reduced GABAergic signaling on the functional circuitry in the larval zebrafish optic tectum. Zebrafish have three gad genes: two gad1 paralogs known as gad1a and gad1b, and gad2. The gad1b and gad2 genes are expressed in the developing optic tectum. Null mutations in gad1b significantly reduce GABA levels in the brain and increase electrophysiological activity in the optic tectum. Fast light sheet imaging of genetically encoded calcium indicator (GCaMP)-expressing gab1b null larval zebrafish revealed patterns of neural activity that were different than either gad1b-normal larvae or gad1b-normal larvae acutely exposed to pentylenetetrazole (PTZ). These results demonstrate that reduced GABAergic signaling during development increases functional connectivity and concomitantly hyper-synchronization of neuronal networks.

Rice Leaf Nitrogen Content Estimation Through A Methodological Framework Using Single-Sensor Multispectral Images

Using non-destructive evaluation tools based on imaging techniques, including single-sensor multispectral cameras, provides a cost-effective solution for optimizing rice nitrogen fertilization through site-specific nutrient management. However, their accuracy and precision have been identified as areas for improvement. This study aims to develop a methodology to improve the accuracy of estimations through field experiments. It utilizes multispectral images captured by MAPIR Survey3W Orange Cyan Near-Infrared and MAPIR Survey3W Red Edge cameras. The Normalized Difference Vegetation Index and Red Edge values derived from these images are correlated with Soil Plant Analysis Development values to assess rice nitrogen levels. A prediction model is then built using the Support Vector Regression algorithm. Findings from the experiments underscore the importance of addressing shadow effects, integrating the dataset on light intensity and image capture time, conducting radiometric calibration, filtering outlier data, employing image segmentation, and utilizing nonlinear Canova tests to enhance estimation accuracy. By configuring the Support Vector Regression model with RBF kernel, gamma set to 1.24, and epsilon set to 0.1, the R2 of the train data and validation data reaches 0.851, and 0.840 respectively. Meanwhile, the R2 of the test data achieves 0.793 with a mean absolute percentage error of 3.49 % and a root mean square error of 1.70. These findings underscore the potential of the proposed methodology to improve the estimation of rice nitrogen status based on single-sensor multispectral images, paving the way for more effective nutrient management strategies in rice cultivation.

Estimation Model and Spatio-Temporal Analysis of Carbon Emissions from Energy Consumption with NPP-VIIRS-like Nighttime Light Images: A Case Study in the Pearl River Delta Urban Agglomeration of China

Urbanization is growing at a rapid pace, and this is being reflected in the rising energy consumption from fossil fuels, which is contributing significantly to greenhouse gas impacts and carbon emissions (CE). Aiming at the problems of the time delay, inconsistency, uneven spatial coverage scale, and low precision of the current regional carbon emissions from energy consumption accounting statistics, this study builds a precise model for estimating the carbon emissions from regional energy consumption and analyzes the spatio-temporal characteristics. Firstly, in order to estimate the carbon emissions resulting from energy consumption, a fixed effects model was built using data on province energy consumption and NPP-VIIRS-like nighttime lighting data. Secondly, the PRD urban agglomeration was selected as the case study area to estimate the carbon emissions from 2012 to 2020 and predict the carbon emissions from 2021 to 2023. Then, their multi-scale spatial and temporal distribution characteristics were analyzed through trends and hotspots. Lastly, the influence factors of CE from 2012 to 2020 were examined with the OLS, GWR, GTWR, and MGWR models, as well as a ridge regression to enhance the MGWR model. The findings indicate that, from 2012 to 2020, the carbon emissions in the PRD urban agglomeration were characterized by the non-equilibrium feature of “high in the middle and low at both ends”; from 2021 to 2023, the central and eastern regions saw the majority of its high carbon emission areas, the east saw the region with the highest rate of growth, the east and the periphery of the high value area were home to the area of medium values, while the southern, central, and northern regions were home to the low value areas; carbon emissions were positively impacted by population, economics, land area, and energy, and they were negatively impacted by science, technology, and environmental factors. This study could provide technical support for the long-term time-series monitoring and remote sensing inversion of the carbon emissions from energy consumption in large-scale, complex urban agglomerations.

Evolutionary computation-based self-supervised learning for image processing: a big data-driven approach to feature extraction and fusion for multispectral object detection

The image object recognition and detection technology are widely used in many scenarios. In recent years, big data has become increasingly abundant, and big data-driven artificial intelligence models have attracted more and more attention. Evolutionary computation has also provided a powerful driving force for the optimization and improvement of deep learning models. In this paper, we propose an image object detection method based on self-supervised and data-driven learning. Differ from other methods, our approach stands out due to its innovative use of multispectral data fusion and evolutionary computation for model optimization. Specifically, our method uniquely combines visible light images and infrared images to detect and identify image targets. Firstly, we utilize a self-supervised learning method and the AutoEncoder model to perform high-dimensional feature extraction on the two types of images. Secondly, we fuse the extracted features from the visible light and infrared images to detect and identify objects. Thirdly, we introduce a model parameter optimization method using evolutionary learning algorithms to enhance model performance. Validation on public datasets shows that our method achieves comparable or superior performance to existing methods.

Remarks on the light ring images and the optical appearance of hairy black holes in Einstein–Maxwell-dilaton gravity

The behaviors of null geodesics in the spherical symmetric black holes in Einstein–Maxwell-dilaton (EMD) theory with coupling function f(Φ)=e-2αΦ\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$f(\\Phi )=e^{-2\\alpha \\Phi }$$\\end{document} are meticulously analyzed. We investigate the effects of coupling constant α\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha $$\\end{document} on the effective potential of photon trajectories within three ranges, namely 0<α<1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$0<\\alpha <1$$\\end{document}, α=1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha =1$$\\end{document} and α>1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha >1$$\\end{document}. We find that the thicknesses of lensing and photon rings are smaller at larger α\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha $$\\end{document} and fixed electric charge in the unit of mass q, whereas they are larger at fixed α\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha $$\\end{document} and larger q. This behavior can be described by using the angular Lyapunov exponent γ\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\gamma $$\\end{document} in the vicinity of the critical curve. Remarkably, the behaviors of photon trajectories are found to be more interesting when α>1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha >1$$\\end{document}. Namely, the radius of the black hole shadow Rs\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$R_\ ext {s}$$\\end{document} becomes to be smaller than the photon sphere radius rph\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$r_\ ext {ph}$$\\end{document} when α>1\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha > 1$$\\end{document} and q>q∗\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$q>q^*$$\\end{document}. Moreover, Rs\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$R_\ ext {s}$$\\end{document} goes to zero as q saturates the extremal limit, beyond which the photon orbit becomes absent. Furthermore, we construct the optical appearance of black holes surrounded by optically and geometrically thin accretion disk with three cases of Gralla–Lupsasca–Marrone (GLM) emission profile. Our results indicate that the observed flux originating from the lensing and photon rings exhibits suppression as α\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$$\\alpha $$\\end{document} increases, while it undergoes amplification with the increasing parameter q.

Pavement damage characteristics in the permafrost regions based on UAV images and airborne LiDAR data

The rapid degradation of “Xing'an-Baikal permafrost” in Northeast China has led to various road engineering problems. Efficient inspection and control of pavement quality are critical for maintaining the structural integrity of roads and driving safety in cold regions. Taking the Jagdaqi-Walagan section (JWS) of the Jagdaqi-Mo'he Highway as the object, based on field investigation, unmanned aerial vehicle images and airborne LiDAR data, combined with geographical information system, this study analyzed the pavement damage characteristics in mid- to high-latitude permafrost regions, including quantification of damage ratio, extraction of pavement cracks, and evaluation of pavement roughness and driving quality. The results showed that the average pavement damage ratio was 8.80 %, significantly higher in isolated permafrost regions. A higher damage rate in the Jagdaqi-Mo'he direction than the opposite, with a more concentrated cracking distribution. The worst pavement roughness and most severe pavement bumping at repetitive repair locations. This study provides an effective method for investigating pavement damages and analyzing their mechanisms, and explores the application potential of visible light images combined with LiDAR data in frozen soil engineering. The results provide a scientific basis for assessing current highway conditions, enabling scientific maintenance, and evaluating the risk of engineering damages.

A Distorted Light Field Image Correction Method Based on Improved Hough Transform

Introduction: In using a camera to take photos, due to environmental limitations, uneven lighting can cause uneven distribution of the image light field, resulting in distortion of the image background and target, blurring of details, and distorted light field images. Method: In view of this, research is conducted on the correction of distorted light field images based on the Hough transform. First, the improved Hough transform is utilized to locate the four coordinates, the matrix information of the normal image is applied to calculate the corresponding parameter amount, and then the low-frequency part of the image spectrum is removed. Finally, it uses the Gaussian function for difference, inputs the original data, and gets the correction result of the distorted light field image. Result: The research results indicate that in the practical application of the distorted light field image correction algorithm based on the Hough transform, the improved Hough transform algorithm is superior to the traditional one. Conclusion: In comparative experiments, the research algorithm outperforms the other three algorithms, with an average color restoration of 93.76% and an average signal-to-noise ratio of 54.22dB. The superiority of the research algorithm has been verified, indicating that the research method can perfectly correct distorted light field images and achieve good correction results.

A Distortion Self-Calibration Method for Binocular High Dynamic Light Adjusting and Imaging System Based on Digital Micromirror Device

A Distortion Self-Calibration Method for Binocular High Dynamic Light Adjusting and Imaging System Based on Digital Micromirror Device

Sex differences in neural networks recruited by frontloaded binge alcohol drinking.

Frontloading is an alcohol drinking pattern where intake is skewed towards the onset of access. This study aimed to identify brain regions involved in frontloading. Whole brain imaging was performed in 63 C57Bl/6J (32 female, 31 male) mice that underwent 8 days of binge drinking using drinking-in-the-dark (DID). On Days 1-7 mice received 20% (v/v) alcohol or water for 2 h. Intake was measured in 1-min bins using volumetric sippers. On Day 8 mice were perfused 80 min into the DID session and brains were extracted. Brains were processed to stain for Fos protein using iDISCO+. Following light sheet imaging, ClearMap2.1 was used to register brains to the Allen Brain Atlas and detect Fos+ cells. For network analyses, Day 8 drinking patterns were used to characterize mice as frontloaders or non-frontloaders using a change-point analysis. Functional correlation matrices were calculated for each group from log10 Fos values. Euclidean distances were calculated from these R values and clustering was used to determine modules (highly connected groups of brain regions). In males, alcohol access decreased modularity (three modules in both frontloaders and non-frontloaders) as compared to water (seven modules). In females, an opposite effect was observed. Alcohol access (nine modules for frontloaders) increased modularity as compared to water (five modules). Further, different brain regions served as hubs in frontloaders as compared to control groups. In conclusion, alcohol consumption led to fewer, but more densely connected, groups of brain regions in males but not females and we identify several brain-wide signatures of frontloading.

MRCNN: Multi-input residual convolution neural network for three-dimensional reconstruction of bubble flows from light field images

Accurate measurement of bubbles in air-water two-phase flows holds immense significance in the realm of thermal hydraulics assessments within nuclear reactors. Nevertheless, conventional bubble measurement techniques grapple with challenges encompassing system intricacy, limited real-time capabilities, and inaccuracies stemming from their inherent two-dimensional (2-D) nature. In response, we pioneered an innovative three-dimensional (3-D) analysis approach that leverages light field (LF) imaging diagnosis and deep learning algorithms. Unlike traditional 2-D reconstruction methods, our approach enables direct computation of bubble depth from LF images using digital refocusing technology. Following calibration, a seamless transformation is established between the camera coordinate system and the real-world coordinate system using a sharpness evaluation algorithm. This calibration process ensures precise alignment of refocused images with real-world positions. Subsequently, fully automated and highly accurate computations of bubble depth are realized from input images via the incorporation of a multi-input residual convolution neural network (MRCNN). The limitations of traditional two-dimensional imaging techniques are effectively addressed by this methodology, resulting in a reduction in measurement errors. The study confirms the feasibility of employing LF imaging diagnosis and deep learning algorithms for bubble measurements in an air-water two-phase flow, offering a significant improvement over traditional methods.

Photonic modes prediction via multi-modal diffusion model

Abstract The concept of photonic modes is the cornerstone in optics and photonics, which can describe the propagation of the light. The Maxwell's equations play the role in calculating the mode field based on the structure information, while this process needs a great deal of computations, especially in the handle with a three-dimensional model. To overcome this obstacle, we introduce the Multi-Modal Diffusion model to predict the photonic modes in one certain structure. The Contrastive Language–Image Pre-training (CLIP) model is used to build the connections between photonic structures and the corresponding modes. Then we exemplify Stable Diffusion (SD) model to realize the function of optical fields generation from structure information. Our work introduces Multi-Modal deep learning to construct complex mapping between structural information and light field as high-dimensional vectors, and generates light field images based on this mapping.

Reconstruction algorithm for cross-waveband optical computing imaging

Abstract In a single-pixel fast imaging setup, the data collected by the single-pixel detector needs to be processed by a computer, but the speed of the latter will affect the image reconstruction time. Here we propose two kinds of setups which are able to transform non-visible into visible light imaging, wherein their computing process is replaced by a camera integration mode. The image captured by the camera has a low contrast, so here we present an algorithm that can realize a high quality image in near-infrared to visible cross-waveband imaging. The scheme is verified both by simulation and in actual experiments. The setups demonstrate the great potential for single-pixel imaging and high-speed cross-waveband imaging for future practical applications.