Hyperspectral Data Analysis Research Articles

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. The results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

APiS (AI powered intelligence spectrum analyser): hyperspectral imaging machine learning analyser app for mineral processing

ABSTRACT Hyperspectral data, encompassing hundreds of spectral wavelengths, is a powerful tool for mineral processing, as minerals display unique reflection spectra. Machine learning can identify mineral species from hyperspectral data, but its high dimensionality poses challenges for ordinary users. To address this, we developed APiS (AI Powered intelligence Spectrum Analyser), an interactive hyperspectral analysis application requiring no coding. APiS offers a user-friendly interface for data visualisation, learning data generation, advanced machine learning analysis, and model evaluation. This App surpasses previous script-based methods, enabling diverse users in geometallurgy to conduct sophisticated hyperspectral data analysis and fostering creativity in their work.

An integrated analysis of aeromagnetic and PRISMA hyperspectral imagery data for potential gold mineralization exploration in Mwanza, Malawi

An integrated analysis of aeromagnetic and PRISMA hyperspectral imagery data for potential gold mineralization exploration in Mwanza, Malawi

A contribution to the harmonization of microplastic analysis in beverages and food

AbstractSampling, sample preparation and particle detection are the key steps in microplastics (MP) analysis. In order to harmonize MP analysis, implementing strict measures for quality assurance and control (QA/QC) for all steps is key. However, especially QA and QC for the analysis of hyperspectral MP data has remained widely neglected. To fill this gap, a transparent and detailed QA/QC method for data analysis based on the automated evaluation of a ground truth reference image is presented.

Análise de dados hiperespectrais para derivação do teor de clorofila em videiras

RESUMO: A qualidade e a produtividade de um vinhedo estão relacionadas com a biomassa do dossel e o vigor foliar, e técnicas de sensoriamento próximo têm sido utilizadas como alternativas aos métodos convencionais para estimar esses parâmetros. O conhecimento do teor de clorofila é fundamental para as avaliações fitossanitárias. No entanto, índices de clorofila também podem ser extraídos de espectros de refletância obtidos para uma ampla gama de aplicações. Nesta perspectiva, foram investigadas as relações entre os índices de clorofila obtidos por medidas diretas e derivados de radiometria de campo, com o objetivo de avaliar a acurácia do teor de clorofila previsto. A investigação foi realizada em plantas da variedade Cabernet Sauvignon, baseando-se em levantamentos diretos de clorofila, espectrorradiometria foliar e na derivação de Índices de Vegetação Hiperespectrais (HVIs), sendo a aquisição de dados realizada em duas fases do ciclo vegetativo. Os resultados das estimativas mostraram que os maiores coeficientes de determinação expressando a correlação entre medições e predições foram obtidas para Chl a e Chl a/Chl b modeladas pelo algoritmo RFR, com valores de R ² tão altos quanto 0,8 e erros quadráticos médios tão baixos quanto 0,093. Com relação aos HVIs, o Photochemical Reflectance Index (PRI) calculado para a segunda data de aquisição, correspondente às folhas que atingiram a senescência, foi o que produziu o maior percentual de explicações de predição. Em conclusão, sugere-se que este estudo pode trazer uma contribuição significativa para o desenvolvimento de técnicas não invasivas de monitoramento de vinhedos.

Optimizing multi-spectral ore sorting incorporating wavelength selection utilizing neighborhood component analysis for effective arsenic mineral detection

Arsenic contamination not only complicates mineral processing but also poses environmental and health risks. To address these challenges, this research investigates the feasibility of utilizing Hyperspectral imaging combined with machine learning techniques for the identification of arsenic-containing minerals in copper ore samples, with a focus on practical application in sorting and processing operations. Through experimentation with various copper sulfide ores, Neighborhood Component Analysis (NCA) was employed to select essential wavelength bands from Hyperspectral data, subsequently used as inputs for machine learning algorithms to identify arsenic concentrations. Results demonstrate that by selecting a subset of informative bands using NCA, accurate mineral identification can be achieved with a significantly reduced the size of dataset, enabling efficient processing and analysis. Comparison with other wavelength selection methods highlights the superiority of NCA in optimizing classification accuracy. Specifically, the identification accuracy showed 91.9% or more when utilizing 8 or more bands selected by NCA and was comparable to hyperspectral data analysis with 204 bands. The findings suggest potential for cost-effective implementation of multispectral cameras in mineral processing operations. Future research directions include refining machine learning algorithms, exploring broader applications across diverse ore types, and integrating hyperspectral imaging with emerging sensor technologies for enhanced mineral processing capabilities.

3U CubeSat-Based Hyperspectral Remote Sensing by Offner Imaging Hyperspectrometer with Radially-Fastened Primary Elements.

This paper presents findings from a spaceborne Earth observation experiment utilizing a novel, ultra-compact hyperspectral imaging camera aboard a 3U CubeSat. Leveraging the Offner optical scheme, the camera's hyperspectrometer captures hyperspectral images of terrestrial regions with a 200 m spatial resolution and 12 nanometer spectral resolution across a 400 to 1000 nanometer wavelength range, covering 150 channels in the visible and near-infrared spectrums. The hyperspectrometer is specifically designed for deployment on a 3U CubeSat nanosatellite platform, featuring a robust all-metal cylindrical body of the hyperspectrometer, and a coaxial arrangement of the optical elements ensures optimal compactness and vibration stability. The performance of the imaging hyperspectrometer was rigorously evaluated through numerical simulations prior to construction. Analysis of hyperspectral data acquired over a year-long orbital operation demonstrates the 3U CubeSat's ability to produce various vegetation indices, including the normalized difference vegetation index (NDVI). A comparative study with the European Space Agency's Sentinel-2 L2A data shows a strong agreement at critical points, confirming the 3U CubeSat's suitability for hyperspectral imaging in the visible and near-infrared spectrums. Notably, the ISOI 3U CubeSat can generate unique index images beyond the reach of Sentinel-2 L2A, underscoring its potential for advancing remote sensing applications.

Evaluation of Leaf Chlorophyll Content from Acousto-Optic Hyperspectral Data: A Multi-Crop Study

Chlorophyll plays a crucial role in the process of photosynthesis and helps to regulate plants’ growth and development. Timely and accurate evaluation of leaf chlorophyll content provides valuable information about the health and productivity of plants as well as the effectiveness of agricultural treatments. For non-contact and high-performance chlorophyll content mapping in plants, spectral imaging techniques are the most widely used. Due to agility and rapid random-spectral-access tuning, acousto-optical imagers seem to be very attractive for the detection of vegetation indices and chlorophyll content assessment. This laboratory study demonstrates the capabilities of an acousto-optic imager for evaluation of leaf chlorophyll content in six crops with different biophysical properties: Ribes rubrum, Betula populifolia, Hibiscus rosa-sinensis, Prunus padus, Hordeum vulgare and Triticum aestivum. The experimental protocol includes plant collecting, reference spectrophotometric measurements, hyperspectral imaging data acquisition, processing and analysis and building a multi-crop chlorophyll model. For 90 inspected samples of plant leaves, the optimal vegetation index and model were found. Obtained values of chlorophyll concentrations correlate well with reference values (determination coefficient of 0.89 and relative error of 15%). Applying a multi-crop model to each pixel, we calculated chlorophyll content maps across all plant samples. The results of this study demonstrate that acousto-optic imagery is very promising for fast chlorophyll content assessment and other laboratory spectral-index-based measurements.

Innovative Methods for Diagnosis Evergreen Utilizing Ultraspectral Image Inspection: A Review

Plant diseases result in large financial losses in the global agricultural production industry. Regarding crop production, early disease detection, measurement, and identification are essential for the focused use of control measures. Extensive scientific research is now underway to provide novel hyperspectral technology-based solutions for plant disease diagnosis. By looking at the reflectance spectrum of plant tissue, you can tell the difference between healthy and sick plants, figure out how bad the disease is, name different pathogen species, and find early signs of biotic stress, even when the symptoms are not readily apparent to the unaided eye during the incubation phase. The review covers of fundamentals determining the reflectance spectrum of plant tissue. There is a discussion and evaluation of the potential applications of several kinds of hyperspectral Sensor technology and platforms for plant disease examination. Hyperspectral analysis, a relatively new field, employs techniques from image analysis and optical spectroscopy to measure physiological and morphological characteristics simultaneously. The following are the key phases of hyperspectral data analysis: modeling and data analysis; data extraction and processing; and picture collection and pre-processing. The algorithms and techniques used in each step are listed, then examine the primary uses of hyperspectral sensors in plant disease diagnosis, which include illness detection, disease classification and identification, damage assessment, andgenetic resistance evaluation. An extensive analysis of scholarly literature highlights the advantages of hyperspectral technology in investigating pathogen-plant interactions across various measurement scales. Despite significant advancements in plant disease monitoring using hyperspectral technology over the past few decades, several unresolved technical issues still hinder their practical application. Finally, we explore the issues and future directions for the application of new technology in agriculture.

Tangent Space Based Alternating Projections for Nonnegative Low Rank Matrix Approximation

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto the manifold of fixed rank matrices can be expensive as the singular value decomposition is required. We propose to use the tangent space of the point in the manifold to approximate the projection onto the manifold in order to reduce the computational cost. We show that the sequence generated by the alternating projections onto the tangent spaces of the fixed rank matrices manifold and the nonnegative matrix manifold, converge linearly to a point in the intersection of the two manifolds where the convergent point is sufficiently close to optimal solutions. This convergence result based inexact projection onto the manifold is new and is not studied in the literature. Numerical examples in data clustering, pattern recognition and hyperspectral data analysis are given to demonstrate that the performance of the proposed method is better than that of nonnegative matrix factorization methods in terms of computational time and accuracy.

Hyperspectral Image Study based on Deep Learning Model HSI-ConvNext

In recent years, deep learning techniques have made significant research progress in the field of hyperspectral image processing. Hyperspectral images are widely used in agriculture, environmental monitoring, geological exploration and other fields due to their richness in material and spectral information about objects. Deep learning models play an important role in hyperspectral image research and are able to learn feature representations from large-scale high-dimensional data, improving the performance of tasks such as classification, segmentation, and detection. In the study, researchers usually improve and optimize for the features of hyperspectral images by constructing deep learning models such as HSI-ConvNext. It is able to capture the correlation between different bands, thus realizing semantic segmentation and target detection for hyperspectral images. Data augmentation can effectively expand the limited hyperspectral dataset, and migration learning is able to migrate the knowledge of models trained in other domains to hyperspectral image tasks. Realistic hyperspectral images can be generated for data enhancement and model training. In conclusion, the study of hyperspectral images based on the deep learning model HSI-ConvNext provides new methods and techniques for the analysis and application of hyperspectral data. In the future, with the continuous development of deep learning technology, we can expect more innovations and breakthroughs in the field of hyperspectral image processing.

Comparison and analysis of hyperspectral temperature data in directed energy deposition

Directed energy deposition is an additive manufacturing process that allows the production of near net shape structures. Moreover, the process can also be applied for the repair of high value components. To obtain structures with consistent good characteristics, the directed energy deposition process requires the implementation of a control system. The currently applied approaches for control that are discussed in the literature have specifically focused on melt-pool temperature control. Pyrometers have been used for such purposes; however, they provide only a single scalar value without any spatial information. In this paper, the implementation of a high-speed hyperspectral camera-based system is discussed with a high spatial resolution unlike the pyrometers. Different calibration and temperature estimation procedures for this camera-based system are evaluated and analyzed. The number of effective wavelengths needed for temperature estimation will be discussed in detail and provide an outlook on the potential of this hyperspectral camera-based system. In addition to the number of wavelengths, another important aspect of the temperature estimation methods is the stability with respect to disturbances. Within this paper, the impact of the nominal laser power will be evaluated on the stability of the temperature signals for a control system.

Utilizing Hyperspectral Reflectance and Machine Learning Algorithms for Non-Destructive Estimation of Chlorophyll Content in Citrus Leaves

To address the demands of precision agriculture and the measurement of plant photosynthetic response and nitrogen status, it is necessary to employ advanced methods for estimating chlorophyll content quickly and non-destructively at a large scale. Therefore, we explored the utilization of both linear regression and machine learning methodology to improve the prediction of leaf chlorophyll content (LCC) in citrus trees through the analysis of hyperspectral reflectance data in a field experiment. And the relationship between phenology and LCC estimation was also tested in this study. The LCC of citrus tree leaves at five growth seasons (May, June, August, October, and December) were measured alongside measurements of leaf hyperspectral reflectance. The measured LCC data and spectral parameters were used for evaluating LCC using univariate linear regression (ULR), multivariate linear regression (MLR), random forest regression (RFR), K-nearest neighbor regression (KNNR), and support vector regression (SVR). The results revealed the following: the MLR and machine learning models (RFR, KNNR, SVR), in both October and December, performed well in LCC estimation with a coefficient of determination (R2) greater than 0.70. In August, the ULR model performed the best, achieving an R2 of 0.69 and root mean square error (RMSE) of 8.92. However, the RFR model demonstrated the highest predictive power for estimating LCC in May, June, October, and December. Furthermore, the prediction accuracy was the best with the RFR model with parameters VOG2 and Carte4 in October, achieving an R2 of 0.83 and RMSE of 6.67. Our findings revealed that using just a few spectral parameters can efficiently estimate LCC in citrus trees, showing substantial promise for implementation in large-scale orchards.

Remote Detection and Quantification of Methane Emissions Based on Hyperspectral Data Analysis

Measurement of methane emissions from leaks occurring on the territorially extensive network of transmission gas grid is a topical issue and highly desirable from the point of view of safety and reducing methane emissions into the atmosphere. Remote detection of methane is a problem whose technical solution is based on several types of optoelectronic devices, e.g. thermal imaging cameras with sets of optical filters, spectroradiometers, laser systems of the DIAL (DIfferential Absorption Lidar) type. On the other hand, the quantification of emission magnitudes is in most cases realized by spectoradiometric systems. This paper will present a method for analyzing hyperspectral data from an imaging Fourier infrared spectroradiometer. Measurements will be made on a purpose-built bench simulating methane emissions from a transmission network. Data obtained from ground level under different atmospheric conditions will be presented, together with the results of their analysis for different methane emissions.

Improving the Spatial Prediction of Sand Content in Forest Soils Using a Multivariate Geostatistical Analysis of LiDAR and Hyperspectral Data

Soil sand particles play a crucial role in soil erosion because they are more susceptible to being detached and transported by erosive forces than silt and clay particles. Therefore, in soil erosion assessment and mitigation, it is crucial to model and predict soil sand particles at unsampled locations using appropriate methods. The study was aimed to evaluate the ability of a multivariate approach based on non-stationary geostatistics to merge LiDAR and visible-near infrared (Vis-NIR) diffuse reflectance data with laboratory analyses to produce high-resolution maps of soil sand content. Remotely sensed, high-resolution LiDAR-derived topographic attributes can be used as auxiliary variables to estimate soil textural particle-size fractions. The proposed approach was compared with the commonly used univariate approach of ordinary kriging to evaluate the contribution of auxiliary variables. Soil samples (0–0.20 m depth) were collected at 135 locations within a 139 ha forest catchment with granitic parent material and subordinately alluvial deposits, where soils classified as Typic Xerumbrepts and Ultic Haploxeralf crop out. A number of linear trend models coupled with different auxiliary variables were compared. The best model for predicting sand content was the one with elevation derived from LIDAR data as the only auxiliary variable. Although the improvement in estimation over the univariate model was rather marginal, the proposed approach proved very flexible and scalable to include any type of auxiliary variable. The application of LiDAR data is expected to expand as it allows the high-resolution prediction of soil properties, generally insufficiently sampled, at different spatial scales.

A Review of Practical AI for Remote Sensing in Earth Sciences

Integrating Artificial Intelligence (AI) techniques with remote sensing holds great potential for revolutionizing data analysis and applications in many domains of Earth sciences. This review paper synthesizes the existing literature on AI applications in remote sensing, consolidating and analyzing AI methodologies, outcomes, and limitations. The primary objectives are to identify research gaps, assess the effectiveness of AI approaches in practice, and highlight emerging trends and challenges. We explore diverse applications of AI in remote sensing, including image classification, land cover mapping, object detection, change detection, hyperspectral and radar data analysis, and data fusion. We present an overview of the remote sensing technologies, methods employed, and relevant use cases. We further explore challenges associated with practical AI in remote sensing, such as data quality and availability, model uncertainty and interpretability, and integration with domain expertise as well as potential solutions, advancements, and future directions. We provide a comprehensive overview for researchers, practitioners, and decision makers, informing future research and applications at the exciting intersection of AI and remote sensing.

Analysis of Hyperspectral Data to Develop an Approach for Document Images.

Hyperspectral data analysis is being utilized as an effective and compelling tool for image processing, providing unprecedented levels of information and insights for various applications. In this manuscript, we have compiled and presented a comprehensive overview of recent advances in hyperspectral data analysis that can provide assistance for the development of customized techniques for hyperspectral document images. We review the fundamental concepts of hyperspectral imaging, discuss various techniques for data acquisition, and examine state-of-the-art approaches to the preprocessing, feature extraction, and classification of hyperspectral data by taking into consideration the complexities of document images. We also explore the possibility of utilizing hyperspectral imaging for addressing critical challenges in document analysis, including document forgery, ink age estimation, and text extraction from degraded or damaged documents. Finally, we discuss the current limitations of hyperspectral imaging and identify future research directions in this rapidly evolving field. Our review provides a valuable resource for researchers and practitioners working on document image processing and highlights the potential of hyperspectral imaging for addressing complex challenges in this domain.

Non-destructive pre-symptomatic detection of gray mold infection in kiwifruit using hyperspectral data and chemometrics

Application of hyperspectral imaging (HSI) and data analysis algorithms was investigated for early and non-destructive detection of Botrytis cinerea infection. Hyperspectral images were collected from laboratory-based contaminated and non-contaminated fruits at different day intervals. The spectral wavelengths of 450 nm to 900 nm were pretreated by applying moving window smoothing (MWS), standard normal variates (SNV), multiplicative scatter correction (MSC), Savitzky–Golay 1st derivative, and Savitzky–Golay 2nd derivative algorithms. In addition, three different wavelength selection algorithms, namely; competitive adaptive reweighted sampling (CARS), uninformative variable elimination (UVE), and successive projection algorithm (SPA), were executed on the spectra to invoke the most informative wavelengths. The linear discriminant analysis (LDA), developed with SNV-filtered spectral data, was the most accurate classifier to differentiate the contaminated and non-contaminated kiwifruits with accuracies of 96.67% and 96.00% in the cross-validation and evaluation stages, respectively. The system was able to detect infected samples before the appearance of disease symptoms. Results also showed that the gray-mold infection significantly influenced the kiwifruits’ firmness, soluble solid content (SSC), and titratable acidity (TA) attributes. Moreover, the Savitzky–Golay 1st derivative-CARS-PLSR model obtained the highest prediction rate for kiwifruit firmness, SSC, and TA with the determination coefficient (R2) values of 0.9879, 0.9644, 0.9797, respectively, in calibration stage. The corresponding cross-validation R2 values were equal to 0.9722, 0.9317, 0.9500 for firmness, SSC, and TA, respectively. HSI and chemometric analysis demonstrated a high potential for rapid and non-destructive assessments of fungal-infected kiwifruits during storage.

Deep Generative Modeling of Infrared Images Provides Signature of Cracking in Cross-Linked Polyethylene Pipe

Hyperspectral infrared (IR) images contain a large amount of highly spatially resolved information about the chemical composition of a sample. However, the analysis of hyperspectral IR imaging data for complex heterogeneous systems can be challenging because of the spectroscopic and spatial complexity of the data. We implement a deep generative modeling approach using a β-variational autoencoder to learn disentangled representations of the generative factors of variance in a data set of cross-linked polyethylene (PEX-a) pipe. We identify three distinct physicochemical factors of aging and degradation learned by the model and apply the trained model to high-resolution hyperspectral IR images of cross-sectional slices of unused virgin, used in-service, and cracked PEX-a pipe. By mapping the learned representations of aging and degradation to the IR images, we extract detailed information on the physicochemical changes that occur during aging, degradation, and cracking in PEX-a pipe. This study shows how representation learning by deep generative modeling can significantly enhance the analysis of high-resolution IR images of complex heterogeneous samples.

Genome-wide association analysis of hyperspectral reflectance data to dissect the genetic architecture of growth-related traits in maize under plant growth-promoting bacteria inoculation.

Plant growth-promoting bacteria (PGPB) may be of use for increasing crop yield and plant resilience to biotic and abiotic stressors. Using hyperspectral reflectance data to assess growth-related traits may shed light on the underlying genetics as such data can help assess biochemical and physiological traits. This study aimed to integrate hyperspectral reflectance data with genome-wide association analyses to examine maize growth-related traits under PGPB inoculation. A total of 360 inbred maize lines with 13,826 single nucleotide polymorphisms (SNPs) were evaluated with and without PGPB inoculation; 150 hyperspectral wavelength reflectances at 386-1021 nm and 131 hyperspectral indices were used in the analysis. Plant height, stalk diameter, and shoot dry mass were measured manually. Overall, hyperspectral signatures produced similar or higher genomic heritability estimates than those of manually measured phenotypes, and they were genetically correlated with manually measured phenotypes. Furthermore, several hyperspectral reflectance values and spectral indices were identified by genome-wide association analysis as potential markers for growth-related traits under PGPB inoculation. Eight SNPs were detected, which were commonly associated with manually measured and hyperspectral phenotypes. Different genomic regions were found for plant growth and hyperspectral phenotypes between with and without PGPB inoculation. Moreover, the hyperspectral phenotypes were associated with genes previously reported as candidates for nitrogen uptake efficiency, tolerance to abiotic stressors, and kernel size. In addition, a Shiny web application was developed to explore multiphenotype genome-wide association results interactively. Taken together, our results demonstrate the usefulness of hyperspectral-based phenotyping for studying maize growth-related traits in response to PGPB inoculation.