Spectral Image Data Research Articles

Enhancing 3D Models with Spectral Imaging for Surface Reflectivity.

The increasing demand for accurate and detailed 3D modeling in fields such as cultural heritage preservation, industrial inspection, and scientific research necessitates advanced techniques to enhance model quality. This paper addresses this necessity by incorporating spectral imaging data to improve the surface detail and reflectivity of 3D models. The methodology integrates spectral imaging with traditional 3D modeling processes, offering a novel approach to capturing fine textures and subtle surface variations. The experimental results of this paper underscore the advantages of incorporating spectral imaging data in the creation of 3D models, particularly in terms of enhancing surface detail and reflectivity. The achieved experimental results demonstrate that 3D models generated with spectral imaging data exhibit significant improvements in surface detail and accuracy, particularly for objects with intricate surface patterns. These findings highlight the potential of spectral imaging in enhancing 3D model quality. This approach offers significant advancements in 3D modeling, contributing to more precise and reliable representations of complex surfaces.

Rational partitioning of spectral feature space for effective clustering of massive spectral image data

We have successfully proposed and demonstrated a clustering method that overcomes the “needle-in-a-haystack problem” (finding minuscule important regions from massive spectral image data sets). The needle-in-a-haystack problem is of central importance in the characterization of materials since in bulk materials, the properties of a very tiny region often dominate the entire function. To solve this problem, we propose that rational partitioning of the spectral feature space in which spectra are distributed, or defining of the decision boundaries for clustering, can be performed by focusing on the discrimination limit defined by the measurement noise and partitioning the space at intervals of this limit. We verified the proposed method, applied it to actual measurement data, and succeeded in detecting tiny (~ 0.5%) important regions that were difficult for human researchers and other machine learning methods to detect in discovering unknown phases. The ability to detect these crucial regions helps in understanding materials and designing more functional materials.

Precision estimation of winter wheat crop height and above-ground biomass using unmanned aerial vehicle imagery and oblique photoghraphy point cloud data.

Crop height and above-ground biomass (AGB) serve as crucial indicators for monitoring crop growth and estimating grain yield. Timely and accurate acquisition of wheat crop height and AGB data is paramount for guiding agricultural production. However, traditional data acquisition methods suffer from drawbacks such as time-consuming, laborious and destructive sampling. The current approach to estimating AGB using unmanned aerial vehicles (UAVs) remote sensing relies solely on spectral data, resulting in low accuracy in estimation. This method fails to address the ill-posed inverse problem of mapping from two-dimensional to three-dimensional and issues related to spectral saturation. To overcome these challenges, RGB and multispectral sensors mounted on UAVs were employed to acquire spectral image data. The five-directional oblique photography technique was utilized to construct the three-dimensional point cloud for extracting crop height. This study comparatively analyzed the potential of the mean method and the Accumulated Incremental Height (AIH) method in crop height extraction. Utilizing Vegetation Indices (VIs), AIH and their feature combinations, models including Random Forest Regression (RFR), eXtreme Gradient Boosting (XGBoost), Gradient Boosting Regression Trees (GBRT), Support Vector Regression (SVR) and Ridge Regression (RR) were constructed to estimate winter wheat AGB. The research results indicated that the AIH method performed well in crop height extraction, with minimal differences between 95% AIH and measured crop height values were observed across various growth stages of wheat, yielding R2 ranging from 0.768 to 0.784. Compared to individual features, the combination of multiple features significantly improved the model's estimate accuracy. The incorporation of AIH features helps alleviate the effects of spectral saturation. Coupling VIs with AIH features, the model's R2 increases from 0.694-0.885 with only VIs features to 0.728-0.925. In comparing the performance of five machine learning algorithms, it was discovered that models constructed based on decision trees were superior to other machine learning algorithms. Among them, the RFR algorithm performed optimally, with R2 ranging from 0.9 to 0.93. In conclusion, leveraging multi-source remote sensing data from UAVs with machine learning algorithms overcomes the limitations of traditional crop monitoring methods, offering a technological reference for precision agriculture management and decision-making.

Construction of a predictive model for gastric cancer neuroaggression and clinical validation analysis: A single-center retrospective study.

This study investigated the construction and clinical validation of a predictive model for neuroaggression in patients with gastric cancer. Gastric cancer is one of the most common malignant tumors in the world, and neuroinvasion is the key factor affecting the prognosis of patients. However, there is a lack of systematic analysis on the construction and clinical application of its prediction model. This study adopted a single-center retrospective study method, collected a large amount of clinical data, and applied statistics and machine learning technology to build and verify an effective prediction model for neuroaggression, with a view to providing scientific basis for clinical treatment decisions and improving the treatment effect and survival rate of patients with gastric cancer. To investigate the value of a model based on clinical data, spectral computed tomography (CT) parameters and image omics characteristics for the preoperative prediction of nerve invasion in patients with gastric cancer. A retrospective analysis was performed on 80 gastric cancer patients who underwent preoperative energy spectrum CT at our hospital between January 2022 and August 2023, these patients were divided into a positive group and a negative group according to their pathological results. Clinicopathological data were collected, the energy spectrum parameters of primary gastric cancer lesions were measured, and single factor analysis was performed. A total of 214 image omics features were extracted from two-phase mixed energy images, and the features were screened by single factor analysis and a support vector machine. The variables with statistically significant differences were included in logistic regression analysis to construct a prediction model, and the performance of the model was evaluated using the subject working characteristic curve. There were statistically significant differences in sex, carbohydrate antigen 199 expression, tumor thickness, Lauren classification and Borrmann classification between the two groups (all P < 0.05). Among the energy spectrum parameters, there were statistically significant differences in the single energy values (CT60-CT110 keV) at the arterial stage between the two groups (all P < 0.05) and statistically significant differences in CT values, iodide group values, standardized iodide group values and single energy values except CT80 keV at the portal vein stage between the two groups (all P < 0.05). The support vector machine model with the largest area under the curve was selected by image omics analysis, and its area under the curve, sensitivity, specificity, accuracy, P value and parameters were 0.843, 0.923, 0.714, 0.925, < 0.001, and c:g 2.64:10.56, respectively. Finally, based on the logistic regression algorithm, a clinical model, an energy spectrum CT model, an imaging model, a clinical + energy spectrum model, a clinical + imaging model, an energy spectrum + imaging model, and a clinical + energy spectrum + imaging model were established, among which the clinical + energy spectrum + imaging model had the best efficacy in diagnosing gastric cancer nerve invasion. The area under the curve, optimal threshold, Youden index, sensitivity and specificity were 0.927 (95%CI: 0.850-1.000), 0.879, 0.778, 0.778, and 1.000, respectively. The combined model based on clinical features, spectral CT parameters and imaging data has good value for the preoperative prediction of gastric cancer neuroinvasion.

Root phenotype detection of rice seedling under nitrogen conditions based on terahertz imaging technique

Root phenotype detection is the basis for screening of dominant root and improving of seed breeding. The efficiency of root phenotype detection is restricted by the concealment and complexity of crop roots. In this paper, a new method based on terahertz imaging technology was proposed to detect the phenotypic characteristics of rice root and quantitatively predict root nitrogen content. First, the terahertz imaging spectral data of rice root were preprocessed with de-overlapping, reconstruction, enhancement, and segmentation. Then, the phenotypic characteristics of root length, diameter and surface area of rice roots were extracted according to the refinement algorithm. In addition, three linear regression models were fitted between root phenotype and root nitrogen content. Finally, Convolutional Neural Network (CNN), Genetic Algorithm-Back Propagation Neural Network (GA-BPNN), and Sparrow Search Algorithm-Support Vector Regression (SSA-SVR) were used to predict nitrogen content in rice roots by training and testing terahertz time domain data. Compared with two kinds of root phenotypic analysis software, the average errors of root length, diameter and root surface area calculated in this paper were 10.68 %, 7.29 % and 3.49 %, respectively. The fitting determination coefficients between root length, root surface area and the root nitrogen content were 0.88 and 0.87 after removing three groups of high-nitrogen data and one group of contrast data. The prediction accuracy of SSA-SVR model was 0.99 and the root mean square error was 0.05. Studies show that terahertz imaging technique can provide an effective analytical way for qualitative analysis of root phenotype.

Remote Sensing Inversion of Soil Organic Matter Content in Straw-Returned Fields in China’s Black Soil Region

China’s black earth region is the country’s corn golden belt, and returning corn straw to the field not only helps improve the Soil Organic Matter (SOM) content and soil fertility, but also resolves environmental pollution caused by straw burning. To study the effects of different years and amounts of straw returned to the field on SOM content, this study used soil sampling data from a conservation tillage experimental base in Gaojia Village, Lishu County, combined with indoor measurements of imaging spectral data, to establish a prediction model of SOM content by applying partial least squares regression, and inverting the SOM content in the study area. The results showed that the PLSR model accuracy using indoor measured soil imaging spectral data as the independent variable was high. The accuracy coefficients of samples with different field return and different field return amounts, R2, were 0.9176 and 0.8901, respectively, which better predicted SOM content. In the 0–50 cm tillage layer, the highest average SOM content of 39.73 g/kg was found under the NT-1 treatment with different no-tillage straw return year treatments. The depth of the tillage layer in the typical black soil region of Northeast China is around 0–20 cm, and the most significant increase in SOM content was observed in the experimental samples under the NT-1 treatment. SOM content in NT-1 treatment increased by 31.83% compared with CK-1, 68.24% compared with CK-2, 72.18% compared with NT-0, 699.48% compared with NT-2, and 311.44% compared with NT-3, respectively. The highest SOM content of 31.9 g/kg was found in NT-100 under the different treatments of different years of field return. At the 0–20 cm soil layer, the SOM content increases most significantly under NT-100 treatment, which is the most suitable treatment method for straw return to the field. And NT-100 is 22.09% higher than CK-1, 55.36% higher than CK-2, 58.99% higher than NC-0, 115.95% higher than NT-33, and 48.72% higher than NT-67, respectively. This study provides data that can support the conservation of soil ecosystem diversity and sustainable soil use, and it also enriches the application of the PLSR model application.

Studying on the in vivo pathological evolution of spinal cord injury with the rat model by the method of integrated multispectral imaging and Raman spectroscopy

Spinal cord injury (SCI) is a debilitating neurological and pathological condition that results in significant impairments in motor, sensory, and autonomic functions. By integrating multispectral imaging (MSI) with Raman spectroscopy, a label-free optical methodology was developed for achieving a non-invasive in vivo understanding on the pathological features of SCI evolution. Under the guidance of captured the spectral imaging data cube with a rigid endoscope based MSI system, a special designed fiber probe passed through the instrumental channel for acquiring the finger-print spectral information from compression rat SCI models. After identifying the main visual features of injured spinal cord tissue in all Sham, 0-, 3- and 7-days post injury (0 DPI, 3 DPI, and 7 DPI) groups, the blood volume and oxygen content were visualized to describe hemorrhage, hypoxia and inflammatory state after acute injury. The averaged reflectance spectra, which were deduced from MSI data cubes, were utilized for describing oxygen saturation and hemoglobin concentration in living tissue. The results of Raman spectroscopy addressed complex compositional and conformational phenomena during SCI progression, correlated with the well-known event like neuronal apoptosis, hemorrhage, demyelination, and even the upregulation of chondroitin sulfate proteoglycans (CSPGs). A principal component analysis and linear discriminate algorithm (PCA-LDA) based discriminate model was introduced for categorizing spectral features in different injury stages, which was applicable for intraoperative interpretations on the complex pathological courses of SCI and therapeutic outcomes.

CTIS spectral image reconstruction technology based on slit-scanning architecture

The computed tomography imaging spectrometer (CTIS) is a snapshot imaging spectrometer, excelling in dynamic detection tasks. It can capture two-dimensional spatial information and spectrally compressed information of a target within a single exposure time. However, traditional CTIS image reconstruction algorithms suffer from missing-cone problem, which reduces the accuracy of spectral reconstruction. In recent years, deep learning has been applied to CTIS spectral image reconstruction, significantly improving spectral reconstruction accuracy compared to traditional algorithms. However, due to the missing-cone problem, it is difficult to accurately recover the truth of spectral data cube in the real scene. Currently, most CTIS neural network reconstruction models are trained using simulated datasets of spectral data cubes and diffractive images. Because these data differ significantly from real data under actual application conditions, the established models may not be effectively applicable to real-world scenes. Therefore, we propose a new CTIS system based on slit-scanning architecture utilizing an adjustable slit aperture to obtain the real spectral data cube of the target while maintaining the simplicity of the CTIS structure. By limiting the field of view (FOV) through the slit, the area of diffraction overlap can be reduced, thereby enhancing the accuracy of CTIS spectral reconstruction using the expectation-maximization (EM) algorithm. This architecture allows us to obtain accurate spectral cubes that match the CTIS diffractive image of real-world scenes, providing a real dataset for training the reconstruction network. A prototype has been built to demonstrate the feasibility of our proposed solution. Furthermore, we also constructed a residual network based on multi-scale and attention mechanism. This network is trained using a combination of simulated and real spectral imaging data. Compared to the reconstruction performance of the EM algorithm and convolutional neural networks, our approach demonstrates superior spectral reconstruction accuracy, validating the importance of real spectral data in CTIS spectral reconstruction tasks.

Photon-counting detector CT - first experiences in the field of musculoskeletal radiology.

The introduction of photon-counting detector CT (PCD-CT) marks a remarkable leap in innovation in CT imaging. The new detector technology allows X-rays to be converted directly into an electrical signal without an intermediate step via a scintillation layer and allows the energy of individual photons to be measured. Initial data show high spatial resolution, complete elimination of electronic noise, and steady availability of spectral image data sets. In particular, the new technology shows promise with respect to the imaging of osseous structures. Recently, PCD-CT was implemented in the clinical routine. The aim of this review was to summarize recent studies and to show our first experiences with photon-counting detector technology in the field of musculoskeletal radiology.We performed a literature search using Medline and included a total of 90 articles and reviews that covered recent experimental and clinical experiences with the new technology.In this review, we focus on (1) spatial resolution and delineation of fine anatomic structures, (2) reduction of radiation dose, (3) electronic noise, (4) techniques for metal artifact reduction, and (5) possibilities of spectral imaging. This article provides insight into our first experiences with photon-counting detector technology and shows results and images from experimental and clinical studies. · This review summarizes recent experimental and clinical studies in the field of photon-counting detector CT and musculoskeletal radiology.. · The potential of photon-counting detector technology in the field of musculoskeletal radiology includes improved spatial resolution, reduction in radiation dose, metal artifact reduction, and spectral imaging.. · PCD-CT enables imaging at lower radiation doses while maintaining or even enhancing spatial resolution, crucial for reducing patient exposure, especially in repeated or prolonged imaging scenarios.. · It offers promising results in reducing metal artifacts commonly encountered in orthopedic or dental implants, enhancing the interpretability of adjacent structures in postoperative and follow-up imaging.. · With its ability to routinely acquire spectral data, PCD-CT scans allow for material classification, such as detecting urate crystals in suspected gout or visualizing bone marrow edema, potentially reducing reliance on MRI in certain cases.. Bette S, Risch F, Becker J et al. Photon-counting detector CT - first experiences in the field of musculoskeletal radiology. Fortschr Röntgenstr 2024; DOI 10.1055/a-2312-6914.

PDRs4All

Context. Mid-infrared observations of photodissociation regions (PDRs) are dominated by strong emission features called aromatic infrared bands (AIBs). The most prominent AIBs are found at 3.3, 6.2, 7.7, 8.6, and 11.2 µm. The most sensitive, highest-resolution infrared spectral imaging data ever taken of the prototypical PDR, the Orion Bar, have been captured by JWST. These high-quality data allow for an unprecedentedly detailed view of AIBs. Aims. We provide an inventory of the AIBs found in the Orion Bar, along with mid-IR template spectra from five distinct regions in the Bar: the molecular PDR (i.e. the three H2 dissociation fronts), the atomic PDR, and the H II region. Methods. We used JWST NIRSpec IFU and MIRI MRS observations of the Orion Bar from the JWST Early Release Science Program, PDRs4All (ID: 1288). We extracted five template spectra to represent the morphology and environment of the Orion Bar PDR. We investigated and characterised the AIBs in these template spectra. We describe the variations among them here. Results. The superb sensitivity and the spectral and spatial resolution of these JWST observations reveal many details of the AIB emission and enable an improved characterization of their detailed profile shapes and sub-components. The Orion Bar spectra are dominated by the well-known AIBs at 3.3, 6.2, 7.7, 8.6, 11.2, and 12.7 µm with well-defined profiles. In addition, the spectra display a wealth of weaker features and sub-components. The widths of many AIBs show clear and systematic variations, being narrowest in the atomic PDR template, but showing a clear broadening in the H II region template while the broadest bands are found in the three dissociation front templates. In addition, the relative strengths of AIB (sub-)components vary among the template spectra as well. All AIB profiles are characteristic of class A sources as designated by Peeters (2022, A&amp;A, 390, 1089), except for the 11.2 µm AIB profile deep in the molecular zone, which belongs to class B11.2. Furthermore, the observations show that the sub-components that contribute to the 5.75, 7.7, and 11.2 µm AIBs become much weaker in the PDR surface layers. We attribute this to the presence of small, more labile carriers in the deeper PDR layers that are photolysed away in the harsh radiation field near the surface. The 3.3/11.2 AIB intensity ratio decreases by about 40% between the dissociation fronts and the H II region, indicating a shift in the polycyclic aromatic hydrocarbon (PAH) size distribution to larger PAHs in the PDR surface layers, also likely due to the effects of photochemistry. The observed broadening of the bands in the molecular PDR is consistent with an enhanced importance of smaller PAHs since smaller PAHs attain a higher internal excitation energy at a fixed photon energy. Conclusions. Spectral-imaging observations of the Orion Bar using JWST yield key insights into the photochemical evolution of PAHs, such as the evolution responsible for the shift of 11.2 µm AIB emission from class B11.2 in the molecular PDR to class A11.2 in the PDR surface layers. This photochemical evolution is driven by the increased importance of FUV processing in the PDR surface layers, resulting in a “weeding out” of the weakest links of the PAH family in these layers. For now, these JWST observations are consistent with a model in which the underlying PAH family is composed of a few species: the so-called ‘grandPAHs’.

Combining canopy spectral reflectance and RGB images to estimate leaf chlorophyll content and grain yield in rice

Predicting rice grain yield using multi-source remotely sensed data is crucial for improving prediction accuracy, optimizing nitrogen management, and advancing precision agricultural development. However, the feasibility and reliability of using multi-source remotely sensed data to predict the grain yield remain unclear. Therefore, this study aimed to explore the possibility of providing rice leaf chlorophyll content (LCC) estimations and predictions of the grain yield using multi-source remotely sensed data. Two rice field experiments were conducted with various rice cultivars and nitrogen rates, and a field spectrometer and an unmanned aerial vehicle (UAV) equipped with a digital camera were employed to acquire the spectral reflectance and red–green–blue (RGB) images at the tillering, jointing, and full-heading stages. Destructive sampling was then conducted to measure the LCC and grain yield. The LCC was used as a bridge to develop remotely sensed prediction models for the grain yield. First, the linear relationship between grain yield and the LCC was determined at the tillering, jointing, and full-heading stages. A multiple linear regression (MLR) model was then developed to predict grain yield using multi-temporal LCCs at three growth stages. Second, multiple stepwise regression, support vector regression, and back propagation neural network were used to evaluate the estimation performance of spectral reflectance, RGB image data, and their combination for LCC. Third, the most accurate LCC estimation model was selected and coupled with the linear and MLR models of grain yield. The results showed that grain yield was significantly and positively related to the LCC at the tillering, jointing, and full-heading stages, and that the MLR model of grain yield achieved the best estimation accuracy using multi-temporal LCCs. The fusion models established by combining spectral reflectance and RGB image data improved LCC estimation accuracies. Using multi-growth stages, the most accurate predictions of grain yield were obtained from LCC estimation models (R2 = 0.698, RMSE = 0.742 t ha−1, rRMSE = 9.004 %) compared to those using single growth stages. Our study concluded that multi-source remotely sensed data fused from ground-based spectral reference and UAV-based RGB images can better predict and explain the grain yield for both single and multi-growth stages. This study provides a novel method of estimating the crop chlorophyll content and grain yield.

Spectral imaging based on custom-made multi-strip filter arrays

Spectral imaging technology based on on-chip spectroscopy can find applications in areas including aerospace, industrial and consumer electronics, and so on. Since each application normally requires a different set and number of spectral bands, the development of customized spectroscopy solutions with more compact size and lower cost becomes quite important. In this paper, we demonstrate a compact, highly customizable imaging spectrometer scheme based on custom-made multi-strip filter arrays, which maintains an average high transmission of ∼85%, narrow bandwidth of ∼30nm, and high optical density of ∼OD2 in the blocking regions across the visible to near-infrared waveband. Spectral imaging experiments are conducted, and the accurate reconstruction of sparse spectral image data is demonstrated as well to prove the validity of the proposed scheme. As a result, the work reported in this paper allows researchers to develop customized spectral imaging equipment in a relatively easy way and also has a great potential to be engineered further for scalable production with a quite low cost.

Synthesis of virtual monoenergetic images from kilovoltage peak images using wavelet loss enhanced CycleGAN for improving radiomics features reproducibility.

Dual-energy computed tomography (CT) can provide a range of image information beyond conventional CT through virtual monoenergetic images (VMIs). The purpose of this study was to investigate the impact of material decomposition in detector-based spectral CT on radiomics features and effectiveness of using deep learning-based image synthesis to improve the reproducibility of radiomics features. In this paper, spectral CT image data from 45 esophageal cancer patients were collected for investigation retrospectively. First, we computed the correlation coefficient of radiomics features between conventional kilovoltage peak (kVp) CT images and VMI. Then, a wavelet loss-enhanced CycleGAN (WLL-CycleGAN) with paired loss terms was developed to synthesize virtual monoenergetic CT images from the corresponding conventional single-energy CT (SECT) images for improving radiomics reproducibility. Finally, the radiomic features in 6 different categories, including gray-level co-occurrence matrix (GLCM), gray-level difference matrix (GLDM), gray-level run-length matrix (GLRLM), gray-level size-zone matrix (GLSZM), neighborhood gray-tone difference matrix (NGTDM), and wavelet, were extracted from the gross tumor volumes from conventional single energy CT, synthetic virtual monoenergetic CT images, and virtual monoenergetic CT images. Comparison between errors in the VMI and synthetic VMI (sVMI) suggested that the performance of our proposed deep learning method improved the radiomic feature accuracy. Material decomposition of dual-layer dual-energy CT (DECT) can substantially influence the reproducibility of the radiomic features, and the degree of impact is feature dependent. The average reduction of radiomics errors for 15 patients in testing sets was 96.9% for first-order, 12.1% for GLCM, 12.9% for GLDM, 15.7% for GLRLM, 50.3% for GLSZM, 53.4% for NGTDM, and 6% for wavelet features. The work revealed that material decomposition has a significant effect on the radiomic feature values. The deep learning-based method reduced the influence of material decomposition in VMIs and might improve the robustness and reproducibility of radiomic features in esophageal cancer. Quantitative results demonstrated that our proposed wavelet loss-enhanced paired CycleGAN outperforms the original CycleGAN.

Tracing sulphur dioxide in volcanic deposits and ash emission during the 2019 Sinabung eruptions

Sulphur dioxide (SO2) emissions from Mt. Sinabung eruption were quantified in time series for 2019. Both pyroclastic materials and gas or aerosol ejected during volcanic eruption contain sulphur as sulphate salt deposits coating volcanic ash grains or gasses. Sulphur dioxide from the eruption will directly impact the surrounding area. Spectral from satellite optical sensors can be used to monitor and measure SO2 gas near real-time after an eruption. The distribution of SO2 column density in the atmosphere was tracked using the Sentinel-5P satellite. Regression kriging (RK) is applied to predict the spatial distribution of sulphur. The area under study is located in a radius of 3 to 7 km from the eruptive center, covering an area of about 4,517 ha. A total of 51 soil samples and volcanic ash were collected from 0- 20 cm soil depth based on a 1x1 km grid interval. All samples were air- dried, sieved, and analyzed for pH, sulphate, and total SO3 using XRF. The Google Earth Engine (GEE) platform was also used to process Sentinel-5P satellite imagery to determine the number and distribution of SO2 column density in the atmosphere during 2019. The pH of the ash is very acidic to neutral (3.56 - 6.55), while soils are considered acidic to neutral (4.67 - 6.52). The available sulphate content in soil ranges from 0 to 303.39 ppm and 0 to 142.47 ppm in volcanic ash samples. SO2 content in ash ranges from 0 to 16.53% and 0 to 3.71% in soils. Sentinel-5P satellite image spectral data shows that SO2 is concentrated mainly in the southern region, with the highest level occurring in August 2019. This study can serve as one of the volcanic mitigation programs and forecast the distribution of SO2 in an active volcanic region of Indonesia.

BINGO: a blind unmixing algorithm for ultra-multiplexing fluorescence images.

Spectral imaging is often used to observe different objects with multiple fluorescent labels to reveal the development of the biological event. As the number of observed objects increases, the spectral overlap between fluorophores becomes more serious, and obtaining a "pure" picture of each fluorophore becomes a major challenge. Here, we propose a blind spectral unmixing algorithm called BINGO (Blind unmixing via SVD-based Initialization Nmf with project Gradient descent and spare cOnstrain), which can extract all kinds of fluorophores more accurately from highly overlapping multichannel data, even if the spectra of the fluorophores are extremely similar or their fluorescence intensity varies greatly. BINGO can isolate up to 10 fluorophores from spectral imaging data for a single excitation. nine-color living HeLa cells were visualized distinctly with BINGO. It provides an important algorithmic tool for multiplex imaging studies, especially in intravital imaging. BINGO shows great potential in multicolor imaging for biomedical sciences. The source code used for this paper is available with the test data at https://github.com/Xinyuan555/BINGO_unmixing.

Using spectral sensing in plant science

Digital cameras are widely used tools for plant monitoring in plant science today. Used to track plant growth or even visible symptoms, they are important tools for breeding and plant protection field trials. Nevertheless, its extension to measure the near infrared (NIR) region (700–1000 nm) includes great potential as plants show a higher light reflectance within this spectrum. Various applications have shown its use for disease detection, quantification, virus content estimation, and stress monitoring. As the next step is a comprehensive integration into agricultural routines, this study will show two use-cases with a high technological readiness level. One use-case shows a handheld multispectral sensor, which is used for manual measurements to detect and discriminate different virus types in sugar beet. In contrast, the second use-case shows a transfer to an UAV based disease quantification routine based on spectral imaging for Cercospora leaf spot. In addition, two prototypical workflows are shown for processing non-imaging and imaging spectral data in an agricultural setting. This study shows the state of the art in spectral sensing in the field for the two major sugar beet diseases – virus yellows and Cercospora leaf spot. Furthermore a future perspective for coming technological challenges regarding the integration of AI in sensors or robotic workflows is provided.

Balancing composite motion optimization using R-ERNN with plant disease

Soybean is a crop with a long cultivation history that plays a significant role on agricultural field. Early diagnosis of Soybean Mosaic Virus Disease (SMVD) is must require, because it causes a fast reduction and significant losses in soybean yields. Therefore, this paper proposes a Balancing Composite Motion optimization utilizing Recalling-Enhanced Recurrent Neural Network with Plant Disease for separating its severity into 0, 1 and 2 grades. Initially, hyper spectral image data was taken from Spec View software. Then, the spectral imageries of soybean leaves are processed to remove the redundancy in frequency bands that emerges owing to hyper spectral camera does not present any important information are filtered by Dual Tree Complex Wavelet Transform (DTCWT). In this, hyper spectral image features are extracted using Ternary pattern and discrete wavelet transform (TP-DWT) method. After completing the process of feature extraction, the feature extracted imageries are given to Recalling-Enhanced Recurrent Neural Network (RE-RNN) and it is used to classify the Soybean mosaic disease. Here, Balancing Composite Motion Optimization (BCMO) algorithm is employed for tuning the RE-RNN hyper parameters. The proposed PDI-RE-RNN-BCMO-HSI method provides 27.03%, 28.94% and 39.04% higher precision compared with existing method like grading model of soybean mosaic infection depending upon hyper spectral imaging technology (PDI-CNN-SVM-HSI), recognization of soybean varieties under hyper spectral imaging technology and one-dimensional CNN (PDI-1D-CNN-HSI) and hyper spectral imaging technology combined with multivariate models to recognize soybean disease (PDI-SNV-ELM-HSI) respectively.

Enhancing spatial resolution in Fourier transform infrared spectral image via machine learning algorithms

Owing to the intrinsic signal noise in the characterization of chemical structures through Fourier transform infrared (FT-IR) spectroscopy, the determination of the signal-to-noise ratio (SNR) depends on the level of the concentration of the chemical structures. In situations characterized by limited concentrations of chemical structures, the traditional approach involves mitigating the resulting low SNR by superimposing repetitive measurements. In this study, we achieved comparable high-quality results to data scanned 64 times and superimposed by employing machine learning algorithms such as the principal component analysis and non-negative matrix factorization, which perform the dimensionality reduction, on FT-IR spectral image data that was only scanned once. Furthermore, the spatial resolution of the mapping images correlated to each chemical structure was enhanced by applying both the machine learning algorithms and the Gaussian fitting simultaneously. Significantly, our investigation demonstrated that the spatial resolution of the mapping images acquired through relative intensity is further improved by employing dimensionality reduction techniques. Collectively, our findings imply that by optimizing research data through noise reduction enhancing spatial resolution using the machine learning algorithms, research processes can be more efficient, for instance by reducing redundant physical measurements.

Virtual non-contrast images of detector-based spectral computed tomography in dogs: a promising alternative to true non-contrast images in veterinary medicine.

In veterinary medicine, abdominal computer tomographic (CT) examinations regularly require a minimum of two scans, with a native scan (true unenhanced, TUE) as a reference for the subsequent contrast-enhanced CT scan (CECT). Spectral detector CT (SDCT) offers the possibility to calculate virtual non-contrast (VNC) images from the post-contrast scan, but this has not yet been investigated in veterinary medicine. The purpose of this study was to assess the reliability of VNC images for abdominal organs in 44 dogs without abdominal pathologies by evaluating their quantitative and qualitative parameters compared to TUE images. We hypothesized that the subtraction of iodine is sufficient in the VNC series compared to the TUE series and that the image quality of the SDCT series is superior to conventional CT images. Corresponding attenuation values in the VNC and TUE series regarding the regions of interest (ROI) in different parenchymal organs and major vessels of the abdominal cavity were assessed by means of a two one-sided t-test (TOST) and Bland-Altman plots. Additionally, the signal-to-noise ratio (SNR) was calculated for each ROI in the different series. In the second step, two board-certified veterinary radiologists made a qualitative assessment of VNC images vs. TUE images in consensus by rating the iodine subtraction, image noise, and image quality of VNC images based on a specific 5-point Likert scale. The difference in corresponding Hounsfield units (HUs) between TUE and VNC images was less than 10 HU in 78.67% of all ROIs. Regarding the limit of less than 10 HU, in the performed TOST, significant p-values of < 0.05 were reached for the liver, spleen, pancreas, and musculature, implying equivalence of both modalities. The quality of spectral base image (SBI) data was rated equivalent to calculated conventional images in the subjective assessment by reaching an average Likert scale score of 3.2 points. VNC images calculated from SDCT data prove a valid alternative to conventional TUE images in the abdominal organs of canine patients without abdominal pathology. VNC offers the possibility to reduce time under general anesthesia and minimize radiation exposure. Future studies are needed to prove the application of this method in clinically diseased patients.

Analysis of Infrared and Raman Imaging Data Using Alternating and Modified Alternating Least Squares

Modified alternating least squares (MALS) outperforms alternating least squares (ALS) in the analysis of infrared and Raman image spectral data. MALS offers superior stability thanks to ridge regression and a substantial speed advantage due to the kernel nature of the algorithm, reducing computational overhead. MALS excels in resolving basis vectors even in low signal-to-noise, nearly collinear data, whereas ALS often falls short. For spectroscopic imaging, both MALS and other ALS methods rely on spatial resolution between sample components, as low spatial resolution leads to increased mixing of components. Spectroscopic imaging combines spectroscopy and digital imaging to extract chemical composition. Multivariate curve resolution (MCR)’s foundation in ALS regression makes it a vital tool for this analysis, enabling a comprehensive examination of complex spectroscopic images. This tutorial delves into the mathematical techniques necessary for extracting chemical insights from infrared and Raman spectroscopic images. While this discussion focuses on two-dimensional spatial data, the methodology can be extended to three-dimensional data.