Synthetic Multispectral Images Research Articles

A General-purpose Pipeline for Realistic Synthetic Multispectral Image Dataset Generation

A General-purpose Pipeline for Realistic Synthetic Multispectral Image Dataset Generation

Machine learning for cyanobacteria mapping on tropical urban reservoirs using PRISMA hyperspectral data

Urban reservoirs are important for drinking water services and urban living. However, potentially toxic cyanobacteria blooms are frequently present due to human pollution and might threaten the urban water supply. Conveniently, cyanobacteria can be monitored by remote sensing-based approaches based on the spectral features of C-Phycocyanin (PC). Furthermore, methods leveraging Machine Learning Algorithms (MLA) for PC estimation from hyperspectral data have highlighted the potential to estimate PC more accurately - even at low concentrations. Since relatively few methodologies for PC retrieval in tropical environments have been developed or validated, this research evaluated PRISMA hyperspectral data processed with three MLA (Random Forest, Extreme Gradient Boost, and Support Vector Machines) to estimate PC concentrations in the Billings reservoir, Brazil. The same MLA were used to generate PC models using Wordview-3 and Landsat-8/OLI simulated data to assess the potential gain of using hyperspectral over multispectral data. A PRISMA image was processed with three atmospheric correction methods and validated with co-located in-situ data, where the best atmospherically corrected product was used to generate synthetic Landsat-8/OLI and Worldview-3 images. The PC models were calibrated and validated through Monte Carlo simulation using field radiometric and biological data (Chlorophyll-a, PC, and phytoplankton taxonomy) collected in eight field campaigns (N = 115). The PRISMA and the synthetic multispectral images were used for a second round of models’ validation using co-located PC measurements (match-up window ± 4 h). The global PC Mixture Density Network was also applied to the PRISMA data, and the estimates were compared with the other MLA. The results showed that the standard PRISMA surface reflectance product provided the best atmospheric correction (MAE < 20% for the 500–700 nm bands), while ACOLITE and 6SV underperformed it from two to more than ten-fold. Cyanobacteria species were abundant in 96% of the taxonomical samples, even though relatively low PC concentrations were found (PC from 0 to 301.81 μg/L and median PC = 2.9 μg/L). The global Mixture Density Network sharply overestimated PC (MAE = 280% and Bias = 280%), potentially due to Billings reservoir’s low PC:Chlorophyll-a ratio relative to the original training dataset. PRISMA/Random Forest (MAE = 45%) achieved the lowest error for orbital PC estimate, while Extreme Gradient Boost outperformed the other MLA using Worldview-3 (MAE = 49%) and Landsat-8 (MAE = 74%) synthetic imagery. Therefore, the results suggest hyperspectral and multispectral orbital data aligned with MLA are feasible for monitoring PC, even for waters containing low PC concentrations and reduced PC:Chlorophyll-a ratios.

A Multi-Spectral Fractal Image Model and Its Associated Fractal Dimension Estimator

We propose both a probabilistic fractal model and fractal dimension estimator for multi-spectral images. The model is based on the widely known fractional Brownian motion fractal model, which is extended to the case of images with multiple spectral bands. The model is validated mathematically under the assumption of statistical independence of the spectral components. Using this model, we generate several synthetic multi-spectral fractal images of varying complexity, with seven statistically independent spectral bands at specific wavelengths in the visible domain. The fractal dimension estimator is based on the widely used probabilistic box-counting classical approach extended to the multivariate domain of multi-spectral images. We validate the estimator on the previously generated synthetic multi-spectral images having fractal properties. Furthermore, we deploy the proposed multi-spectral fractal image estimator for the complexity assessment of real remotely sensed data sets and show the usefulness of the proposed approach.

Generating synthetic multispectral images using neural style transfer: A study with application in channel alignment

We can obtain information about food plantations by imaging technology such as satellite and unmanned aerial vehicles which enables rapid decision-making. Unmanned aerial vehicles provide fast and precise high-resolution multispectral imaging of plantation areas. However, unmanned aerial vehicle images are subject to some misalignment among their bands mainly due to the sensor’s displacement, vehicle movements, and others. To quantitatively evaluate channel alignment algorithms, it is necessary to have fully aligned images. For this purpose, we propose a method for generating fully aligned synthetic multispectral images based on real misaligned unmanned aerial vehicle multispectral images using Neural Style Transferring algorithms. We applied our methods over a real multispectral images dataset and we generated a new synthetic aligned image for each original misaligned multispectral image. Our experiments demonstrate that images generated by our method have fully aligned channels, and the new channels resemble the original ones. We also designed two case studies that demonstrate the applicability of our approach.

A Superresolution Land-Cover Change Detection Method Using Remotely Sensed Images With Different Spatial Resolutions

The development of remote sensing has enabled the acquisition of information on land-cover change at different spatial scales. However, a tradeoff between spatial and temporal resolutions normally exists. Fine-spatial-resolution images have low temporal resolutions, whereas coarse-spatial-resolution images have high temporal repetition rates. A novel superresolution change detection method (SRCD) is proposed to detect land-cover changes at both fine spatial and temporal resolutions with the use of a coarse-resolution image and a fine-resolution land-cover map acquired at different times. SRCD is an iterative method that involves endmember estimation, spectral unmixing, land-cover fraction change detection, and superresolution land-cover mapping. Both the land-cover change/no-change map and from-to change map at fine spatial resolution can be generated by SRCD. In this paper, SRCD was applied to a synthetic multispectral image, a Moderate-Resolution Imaging Spectroradiometer multispectral image, and a Landsat-8 Operational Land Imager multispectral image. The land-cover from-to change maps are found to have the highest overall accuracy (higher than 85%) in all of the three experiments. Most of the changed land-cover patches, which were larger than the coarse-resolution pixel, were correctly detected.

Land Cover Change Detection at Subpixel Resolution With a Hopfield Neural Network

In this paper, a new subpixel resolution land cover change detection (LCCD) method based on the Hopfield neural network (HNN) is proposed. The new method borrows information from a known fine spatial resolution land cover map (FSRM) representing one date for subpixel mapping (SPM) from a coarse spatial resolution image on another, closer date. It is implemented by using the thematic information in the FSRM to modify the initialization of neuron values in the original HNN. The predicted SPM result was compared to the original FSRM to achieve subpixel resolution LCCD. The proposed method was compared with the original unmodified HNN method as well as six state-of-the-art methods for LCCD. To explore the effect of uncertainty in spectral unmixing, which mainly originates from spectral separability in the input, coarse image, and the point spread function (PSF) of the sensor, a set of synthetic multispectral images with different class separabilities and PSFs was used in experiments. It was found that the proposed LCCD method (i.e., HNN with an FSRM) can separate more real changes from noise and produce more accurate LCCD results than the state-of-the-art methods. The advantage of the proposed method is more evident when the class separability is small and the variance in the PSF is large, that is, the uncertainty in spectral unmixing is large. Furthermore, the utilization of an FSRM can expedite the HNN-based processing required for LCCD. The advantage of the proposed method was also validated by applying to a set of real Landsat-Moderate Resolution Imaging Spectroradiometer (MODIS) images.

Unsupervised Subpixel Mapping of Remotely Sensed Imagery Based on Fuzzy C-Means Clustering Approach

Subpixel mapping (SPM) is a technique to obtain a land cover map with finer spatial resolution than the original remotely sensed imagery. An image-based SPM model that directly uses the original image data as input by integrating both the spectral and spatial information has been demonstrated as a promising SPM model. However, all existing image-based SPM models are based on a supervised approach, since the spectral term in these SPM models is composed of a supervised unmixing method. The endmembers and training samples for different land cover classes must be determined before implementing these supervised SPM algorithms. In this letter, a novel unsupervised image-based SPM model based on the fuzzy c-means (FCM) clustering approach (usFCM_SPM) was proposed. By incorporating the unsupervised unmixing criterion of the FCM clustering algorithm and the maximal land cover spatial-dependence principle, the proposed usFCM_SPM can generate a subpixel land cover map without any prior endmember information. Both synthetic multispectral image and real IKONOS image experiments demonstrate that the usFCM_SPM can generate higher accuracy subpixel land cover maps than the traditional unsupervised pixel-scale classification approaches and the unsupervised pixel-swapping model.

Fuzzy-based dialectical non-supervised image classification and clustering

The materialist dialectical method is a philosophical investigative method to analyze aspects of reality. These aspects are viewed as complex processes composed by basic units named poles, which interact with each other. Dialectics has experienced considerable progress in the 19th century, with Hegel's dialectics and, in the 20th century, with the works of Marx, Engels, and Gramsci, in Philosophy and Economics. The movement of poles through their contradictions is viewed as a dynamic process with intertwined phases of evolution and revolutionary crisis. In order to build a computational process based on dialectics, the interaction between poles can be modeled using fuzzy membership functions. Based on this assumption, we introduce the Objective Dialectical Classifier (ODC), a non-supervised map for classification based on materialist dialectics and designed as an extension of fuzzy c-means classifier. As a case study, we used ODC to classify 181 magnetic resonance synthetic multispectral images composed by proton density, $T_1$- and $T_2$-weighted synthetic brain images. Comparing ODC to k-means, fuzzy c-means, and Kohonen's self-organized maps, concerning with image fidelity indexes as estimatives of quantization distortion, we proved that ODC can reach almost the same quantization performance as optimal non-supervised classifiers like Kohonen's self-organized maps.

Evaluation of Alzheimer’s disease by analysis of MR images using multilayer perceptrons and committee machines

Alzheimer’s disease is the most common cause of dementia, yet hard to diagnose precisely without invasive techniques, particularly at the onset of the disease. This work approaches image analysis and classification of synthetic multispectral images composed by diffusion-weighted magnetic resonance (MR) cerebral images for the evaluation of cerebrospinal fluid area and its correlation with the advance of Alzheimer’s disease. The MR images were acquired from a unique volunteer with Alzheimer’s, using an image system based on a clinical 1.5 T tomographer. The classification methods are based on multilayer perceptrons and committee machines and the classification results are used to correlate clinical and imaging findings. The classification results are used to improve the usual analysis of the ADC map.