Visual Interpretation Research Articles

Detection and risk stratification of cardiac amyloidosis patients by integration of imaging and non-imaging data using a machine learning approach

Abstract Background With the advent of amyloid-targeting therapies, early and reliable diagnosis as well as precise risk estimation of cardiac amyloidosis (CA) have become of substantial importance. While the current diagnostic approach relies on difficult-to-standardize, visual interpretation of 99mTc-scintigraphy, risk assessment is largely based on a combination of blood and imaging parameters. Purpose Aim of this study is to assess the possibility of machine learning-based integration of scintigraphy, echocardiography, and non-imaging parameters such as blood parameters and comorbidities for the detection and risk stratification of patients with CA. Methods This study included all patients who underwent 99mTc-scintigraphy at a university affiliated tertiary care centre between 2010 and 2023. Two machine learning models were developed, and the relative predictive importance of their parameters were assessed (Figure 1): First, a model to detect patients with CA-suggestive uptake (Perugini grade 2/3) on 99mTc-scintigraphy scans; Second, a model to assess the risk of patients with CA-suggestive uptake for future heart failure hospitalization (HFH). A total of 58 features were extracted from electronic health records including blood, echocardiographic, demographic parameters and comorbidities. Scintigraphy imaging features were extracted from the raw imaging data using a deep learning approach. For the time to HFH prediction, a random survival forest machine learning model was employed. Results Overall, 12 380 consecutively enrolled patients were included, 279 (2.3%) of which were affected by CA-suggestive uptake. The machine learning model showed higher accuracy for the detection of CA (AUC 0.96 [95% CI 0.95-0.97], sensitivity 0.78 [95% CI 0.77-0.80] and specificity 0.99 [95% CI 0.99-0.99]. In the outcome analysis, the machine model showed good accuracy in predicting future HFH (C-index 0.71 [95% CI 0.68-0.75]). Parameter importance for the time to event analysis revealed right ventricular diameter, previous diagnosis of chronic heart failure and creatine kinase as the three most important predictors (Figure 2). Conclusions Detection of patients with cardiac amyloidosis and their risk estimation for heart failure can be aided using machine learning-based integration of imaging and non-imaging data. Our findings may guide novel approaches for assessing disease progression and treatment response.

First in-human study of 64Cu-DOTATATE positron emission tomography/computed tomography(PET/CT) in infective endocarditis: a prospective head-to-head comparison with 18-FDG PET/CT

Abstract Background Infective endocarditis (IE) is a severe and potentially fatal condition, which can be challenging to diagnose. Positron emission tomography/computed tomography (PET/CT) with [18F]fluorodeoxyglucose ([18F]FDG) is proposed as a diagnostic tool in the ESC endocarditis guidelines, but holds limitations. Purpose To compare the tracer uptake between [64Cu]Cu-DOTATATE and [18F]FDG in patients with IE, and to examine sensitivity and specificity in patients with prosthetic valve endocarditis (PVE) or native valve endocarditis (NVE). Methods The CuDOS-study was a prospective study including 20 cases with IE (10 with PVE and 10 with NVE) and 20 controls. [64Cu]Cu-DOTATATE and [18F]FDG PET/CT were performed in all participants. Scans were read blinded to clinical data. Tracer uptakes were measured as maximum standardized uptake values (SUVmax) in each heart valve. A visual interpretation of the presence or absence of IE was recorded for [64Cu]Cu-DOTATATE and [18F]FDG, respectively. Results The median age of the cases and controls was 68 years [IQR 53-71] and 61 years [IQR 56-67], respectively. In cases and controls, 85% and 70% were men, respectively. [64Cu]Cu-DOTATATE uptake (median SUVmax [IQR]) in patients with IE was higher than in controls (2.38 [1.87-2.90] vs. 1.43 [1.30-1.56], p<0.001), although this difference was mainly driven by PVE-cases (2.99 [2.22-3.75] vs. 1.43 [1.30-1.56 (controls), p<0.001) and to a lesser extent the NVE-cases (1.78 [1.22-2.33] vs. 1.43 [1.30-1.56 (controls), p=0.079), Figure 1. The sensitivity of [64Cu]Cu-DOTATATE and [18F]FDG PET/CT in 20 cases and the 20 controls were comparable, and the specificity was 90% and 75%, respectively. The analysis of PVE versus the 20 controls showed equal sensitivity (80%) for [64Cu]Cu-DOTATATE and [18F]FDG PET/CT and a specificity of 90% and 75%, respectively. The difference in the specificity between [64Cu]Cu-DOTATATE and [18F]FDG was 15% [IQR -5.9-36%], p=0.38. Conclusion [64Cu]Cu-DOTATATE PET/CT showed relevant uptake in the infected valve in patients with infective endocarditis. [64Cu]Cu-DOTATATE had a numerically higher specificity than [18F]FDG in prosthetic valve endocarditis, although the difference was not statistically significant. Both tracers were limited in the detection of native valve endocarditis.Figure 1 [64Cu]Cu-DOTATATE and [18F]FDG

Land covers associated with forest expansion hot spots in the Nepal Himalaya

Abstract Many regions of the Himalaya are experiencing forest expansion, signifying a widespread forest transition across this fragile mountain system. In the Nepal Himalaya, forest expansion is increasingly attributed to the narrative of cropland abandonment driven by rural outmigration. Understanding forest change dynamics as consequences of land use changes is critical in the context of rural mountain societies such as Nepal, which exhibit complex interactions between forest, agriculture, and livelihoods. We analysed forest gain in Nepal from 2000–2019 to inquire where and when forests have expanded and what land covers transitioned into forests. We integrated spatiotemporal analysis of national land cover maps and photointerpretation of very high resolution (VHR) imagery to improve analytical estimates. The Middle Mountain physiographic region experienced the strongest hot spots of forest gains relative to the high mountains or lowlands. Visual interpretation of VHR showed that 68.8% of forest gains since 2000 occurred on shrubland, and 26.5% on cropland. The dominance of shrubland-forest transitions implied that shrubland is an intermediate stage in a multi-decadal succession process, or a semi-permanent state such as arrested succession. Notably however, we also detected cropland-forest transitions occurring as fast as 6–10 years, indicating the potential for rapid forest succession if biophysical conditions permit. Thus, variations in land cover transitions to forests in the hills implicated multiple pathways of forest regeneration, reflecting a variety of spatiotemporally explicit drivers. Our results differ from previous studies because VHR image analysis accounted for land cover classification errors and improved land cover quantification. Further research on spatially explicit mechanisms and drivers of forest gain are needed to understand the synergies of forest, agriculture, and livelihoods to inform land use land cover policies that could be leveraged to enhance rural mountain livelihoods.

A Case Study on the Integration of Remote Sensing for Predicting Complicated Forest Fire Spread

Forest fires can occur suddenly and have significant environmental, economic, and social consequences. The timely and accurate evaluation and prediction of their progression, particularly the spread speed in difficult-to-access areas, are essential for emergency management departments to proactively implement prevention strategies and extinguish fires using scientific methods. This paper provides an analysis of models for predicting forest fire spread in China and globally. Incorporating remote sensing (RS) technology and forest fire science as the theoretical foundation, and utilizing the Wang Zhengfei forest fire spread model (1983), which is noted for its broad adaptability in China as the technical framework, this study constructs a forest fire spread model based on remote sensing interpretation. The model improves the existing model by adding elevation an factor and optimizes the method for acquiring certain parameters. By considering regional landforms (ridge lines, valley lines, and slopes) and vegetation coverage, this paper establishes three-dimensional visual interpretation markers for identifying hotspots; the orientation of the hotspots can be identified to simulate the spread of the fire uphill, downhill, in the direction of the wind, left-level slope, and right-level slope. Then, the data of Sentinel-2 and DEM were used to invert the fuel humidity and slope of pixels in the fire line areas. The statistical inversion data from pixels, which replaced fixed-point values in traditional models, were utilized for predicting forest fire spread speed. In this paper, the model was applied to the case of a forest fire in Mianning County, Sichuan Province, China, and verified using high-time-resolution Himawari-8 data, Gaofen-4 data, and historical data. The results demonstrate that the direction and maximum speed of fire spread for the fire lines in Baifen Mountai, Jiaguer Villageand, Muchanggou, Xujiabaozi, and Zhaizigou are uphill, 16.5 m/min; wind direction, 17.32 m/min; wind direction, 1.59 m/min; and wind direction, 5.67 m/min. The differences are mainly due to the locations of the fire lines, moisture content of combustibles, and maximum slopes being different. Across the entire fire line area, the average rate of increase in the area of open flames within one hour was 3.257 hm2/10 min (square hectares per 10 min), closely matching the average increase rate (3.297 hm2/10 min) monitored by the Himawari-8 satellite in 10 min intervals. In contrast, conventional fixed-point fire spread models predicted an average rate of increase of 3.5637 hm2/10 min, which shows a larger discrepancy compared to the Himawari-8 satellite monitoring results. Moreover, when compared to the fire spot monitoring results from the Gaofen-4 satellite taken 54 min after the initial location of the fire line, the predictions from the RS-enabled fire spread model, which integrates remote sensing interpretations, closely matched the actual observed fire boundaries. Although the predictions from the RS-enabled fire spread model and the traditional model both align with historical data in terms of the overall fire development trends, the RS-enabled model exhibits higher reliability and can provide more accurate information for forest fire emergency departments, enabling effective pre-emptive measures and scientific firefighting strategies.

Characteristics and Correlation Study of Mountainous Lake Ice Phenology Changes in Xinjiang, China Based on Passive Microwave Remote Sensing Data

Lake ice phenology directly reflects local climate changes, serving as a key indicator of climate change. In today’s rapidly evolving climate, utilizing advanced remote sensing techniques to quickly extract long-term lake ice phenology features and studying their correlation with other climate factors is crucial. This study focuses on lakes in Xinjiang, China, with a mountainous area greater than 100 km2, including Sayram Lake, Ayahkum Lake, Achihkul Lake, Jingyu Lake, and Ahsaykan Lake. The Bayesian ensemble change detection algorithm was employed to extract lake ice phenology information, and the Mann–Kendall (MK) non-parametric test was used to analyze trends. The visual interpretation method was used to interpret the spatial evolution characteristics of lake ice, and the Pearson correlation coefficient was used to explore the driving factors of lake ice phenology. Results indicate the following: (1) Jingyu Lake exhibited the most significant delay in both freezing and complete freezing days, while Ayahkum Lake showed the most stable pattern. Ahsaykan Lake demonstrated the least delay in both starting and complete melting days. (2) Sayram Lake’s ice evolution was unstable, with wind causing variability in the locations where freezing begins and melting spreading from the west shore. Ayahkum Lake, Ahsaykan Lake, and Jingyu Lake exhibited similar seasonal variations, while Achihkul Lake’s ice spatial changes spread from the east to the center during freezing and from the center to the shore during melting. (3) The study found that the freeze–thaw process is influenced by a combination of factors including lake area, precipitation, wind speed, and temperature.

Evaluating vision-capable chatbots in interpreting kinematics graphs: a comparative study of free and subscription-based models

This study investigates the performance of eight large multimodal model (LMM)-based chatbots on the Test of Understanding Graphs in Kinematics (TUG-K), a research-based concept inventory. Graphs are a widely used representation in STEM and medical fields, making them a relevant topic for exploring LMM-based chatbots’ visual interpretation abilities. We evaluated both freely available chatbots (Gemini 1.0 Pro, Claude 3 Sonnet, Microsoft Copilot, and ChatGPT-4o) and subscription-based ones (Gemini 1.0 Ultra, Gemini 1.5 Pro API, Claude 3 Opus, and ChatGPT-4). We found that OpenAI’s chatbots outperform all the others, with ChatGPT-4o showing the overall best performance. Contrary to expectations, we found no notable differences in the overall performance between freely available and subscription-based versions of Gemini and Claude 3 chatbots, with the exception of Gemini 1.5 Pro, available via API. In addition, we found that tasks relying more heavily on linguistic input were generally easier for chatbots than those requiring visual interpretation. The study provides a basis for considerations of LMM-based chatbot applications in STEM and medical education, and suggests directions for future research.

Permanent pastures identification in Portugal using remote sensing and multi-level machine learning

IntroductionThe Common Agricultural Policy (CAP) is a vital policy framework implemented by the European Union to regulate and support agricultural production within member states. The Land Parcel Identification System (LPIS) is a key component that provides reliable land identification for administrative control procedures. On-the-spot checks (OTSC) are carried out to verify compliance with CAP requirements, typically relying on visual interpretation or field visits. However, the CAP is embracing advanced technologies to enhance its efficiency.MethodsThis study focuses on using Sentinel-2 time series data and a two-level approach involving recurrent neural networks (RNN) and convolutional neural networks (CNN) to accurately identify permanent pastures.ResultsIn the first step, using RNN, the model achieved an accuracy of 68%, a precision of 36%, a recall of 97% and a F1-score of 52%, which indicates the model’s ability to identify all the true positive parcels (correctly identified permanent pasture parcels) and minimize the false negative parcels (non-identified permanent pasture parcels). This occurs due to the difficulty in distinguishing between permanent pastures and other similar land covers (such as temporary pastures and shrublands). In the second step, it was possible to distinguish the permanent pasture parcels from the others. The obtained results improved significantly from the first to the second step. Using CNN, an accuracy of 93%, a precision of 89%, and a recall of 98% were achieved for the “Permanent pasture” class. The F1-score was 94%, indicating a balanced measure of the model’s performance.DiscussionThe integration of advanced technologies in the CAP’s control mechanisms, as demonstrated, has the potential to automate the verification of farmers’ declarations and subsequent subsidy payments.

DCV2I$\text{DCV}^2\text{I}$: Leveraging deep vision models to support geographers' visual interpretation in dune segmentation

AbstractVisual interpretation is extremely important in human geography as the primary technique for geographers to use photograph data in identifying, classifying, and quantifying geographic and topological objects or regions. However, it is also time‐consuming and requires overwhelming manual effort from professional geographers. This paper describes our interdisciplinary team's efforts in integrating computer vision models with geographers' visual image interpretation process to reduce their workload in interpreting images. Focusing on the dune segmentation task, we proposed an approach called featuring a deep dune segmentation model to identify dunes and label their ranges in an automated way. By developing a tool to connect our model with ArcGIS—one of the most popular workbenches for visual interpretation, geographers can further refine the automatically generated dune segmentation on images without learning any CV or deep learning techniques. Our approach thus realized a noninvasive change to geographers' visual interpretation routines, reducing their manual efforts while incurring minimal interruptions to their work routines and tools they are familiar with. Deployment with a leading Chinese geography research institution demonstrated the potential of in supporting geographers in researching and solving drylands desertification.

Tracking the impact of typhoons on maize growth and recovery using Sentinel-1 and Sentinel-2 data: A case study of Northeast China

The increasing frequency of typhoon events, attributed to global climate change, has significantly affected agricultural production, predominantly resulting in substantial negative consequences. Accurate and timely assessment of crop damage is crucial for understanding economic implications, devising effective agricultural strategies, and enhancing resilience amid mounting climate uncertainties. This study investigates the utility of Sentinel-1 Synthetic Aperture Radar (SAR) and Sentinel-2 MultiSpectral Instrument (MSI) data in tracking maize damage severity following typhoon events. By employing continuous field sampling techniques and conducting visual interpretation of high-resolution remote sensing imagery, sample sets representing a spectrum of maize damage severity were systematically established. The application of time series analysis on Sentinel data enables a comprehensive exploration of spectral and polarization responses, providing insights into the correlation with maize damage severity. Segmentation of the maize damage timeline into pre-disaster, disaster, and recovery periods, coupled with optimization of relevant feature parameters, was undertaken to bolster monitoring precision. Leveraging the Google Earth Engine (GEE) cloud platform, a Random Forest algorithm was used to develop a model for monitoring maize damage severity across different post-typhoon periods, yielding maps delineating the distribution and magnitude of maize damage in Northeast China. Results indicate that integrating spectral indices from the pre-disaster phase with backscatter variations of polarization bands during various post-typhoon periods enhances maize damage assessment. Maize damage severity is notably elevated during the disaster period, achieving an overall accuracy of 87.22 %. While mitigated during the recovery phase, localized exacerbation occurs in severely affected regions, yielding an overall accuracy of 88.54 %. Analysis incorporating terrain and meteorological data reveals that post-typhoon maize disasters predominantly occur in low-lying and flat areas, with meteorological factors, particularly maximum wind speed and daily cumulative precipitation, exerting significant influence on damage severity. This study underscores the critical role of SAR and optical data fusion in elucidating typhoon-induced crop damage dynamics, thereby providing essential insights for proactive mitigation strategies against future agricultural losses.

Improving Underwater Photogrammetric 3D Reconstruction Processing of Shipwreck Sites

Abstract. Applying image processing algorithms to enhance the clarity of underwater images can significantly assist in the visual interpretation of subsea environments. Taking advantage of techniques to maximise the information extracted from the captured input data to produce the highest quality output ensures a higher utilisation of the valuable recorded content which may have been collected at the high cost of a laborious diver survey or an expensive ROV (Remotely Operated Vehicle) expedition. Adopting photogrammetric 3D reconstruction processing in underwater imaging has enabled the creation of high-fidelity digital 3D models which have been used to map subsea infrastructure for maintenance and repair, coral reefs for ecological monitoring, and in the primary context of this article, shipwrecks sites for maritime archaeology and accident investigation. Alongside exploring algorithms to reduce the characteristic haze of underwater photography, this article illustrates the advantages of optimising the processes utilised at distinct stages of the photogrammetric 3D reconstruction workflow to improve the photorealism of the digital 3D models.

Anisotropy of object nonrigidity: High-level perceptual consequences of cortical anisotropy.

We present a surprising anisotropy in perceived object nonrigidity, a complex, higher-level perceptual phenomenon, and explain it unexpectedly by the distribution of low-level neural properties in primary visual cortex. We examined the visual interpretation of two rigidly connected rotating circular rings. At speeds where observers predominantly perceived rigid rotation of the rings rotating horizontally, observers perceived only nonrigid wobbling when the image was rotated by 90°. Additionally, vertically rotating rings appeared narrower and longer compared to their physically identical horizontally rotating counterparts. We show that these perceived shape changes can be decoded from V1 outputs by incorporating documented anisotropies in orientation selectivity. We then show that even when the shapes are matched, the increased nonrigidity persists in vertical rotations, suggesting that motion mechanisms also play a role. By incorporating cortical anisotropies into optic flow computations, we show that the kinematic gradients (Divergence, Curl, Deformation) for vertical rotations align more with physical nonrigidity, while those for horizontal rotations align closer to rigidity, indicating that cortical anisotropies contribute to the orientation dependence of the perception of nonrigidity. Our results reveal how high-level percepts are shaped by low-level anisotropies, which raises questions about their evolutionary significance, particularly regarding shape constancy and motion perception.

Mangroves Invaded by Spartina alterniflora Loisel: A Remote Sensing-Based Comparison for Two Protected Areas in China

Mangroves are one of the world’s most productive and ecologically important ecosystems, and they are threatened by the widespread invasion of Spartina alterniflora Loisel in China. As few studies have examined the spatial pattern differences of S. alterniflora invasion and the nearby mangroves in different latitudes, we chose the Zhangjiang Estuary and the Dandou Sea, two representative mangrove–salt marsh ecotones in the north and south of the Tropic of Cancer, as the study areas for comparison. The object-based image analysis and visual interpretation methods were combined to construct fine-scale mangrove and S. alterniflora maps using high-resolution satellite imagery from 2005 to 2019. We applied spatial analysis, centroid migration, and landscape indexes to analyze the spatio–temporal distribution changes of mangroves and S. alterniflora in these two ecotones over time. We used the landscape expansion index to investigate the S. alterniflora invasion process and expansion patterns. The annual change rates of mangrove and S. alterniflora areas in the Zhangjiang Estuary showed a continuous growth trend. However, the mangrove areas in the Dandou Sea showed a fluctuating trend of increasing, decreasing, and then increasing again, while S. alterniflora areas kept rising from 2005 to 2019. Spartina alterniflora showed larger annual change rates compared with mangroves, indicating rapid S. alterniflora invasion in the intertidal zones. The opposite centroid migration directions of mangroves and S. alterniflora and the decreasing distances between the mangrove and S. alterniflora centroids indirectly revealed the fierce competition between mangroves and S. alterniflora for habitat resources. Both regions saw a decrease in mangrove patch integrality and connectivity. The integrality of mangrove patches in the Zhangjiang Estuary was always higher than those in the Dandou Sea. We observed the growth stage (2011–2014) and outbreak stage (2014–2019) of S. alterniflora expansion in the Zhangjiang Estuary and the outbreak stage (2005–2009) and plateau stage (2009–2019) of S. alterniflora expansion in the Dandou Sea. The expansion pattern of S. alterniflora varies in time and place. Since the expansion of S. alterniflora in the outbreak stage is rapid, with a large annual change rate, early warning of S. alterniflora invasion is quite important for the efficient and economical removal of the invasive plant. Continuous and accurate monitoring of S. alterniflora is highly necessary and beneficial for the scientific management and sustainable development of coastal wetlands.

Identification of texture MRI brain abnormalities on Fibromyalgia syndrome using interpretable machine learning models

To provide objective diagnostic markers for fibromyalgia symptoms (FMS) diagnosis, we have created interpretable extreme gradient boosting (XGBoost) models using radiomics to aid in the diagnosis of chronic pain (CP) and to develop nomogram models for diagnosing subgroups of FMS. A group of 54 patients with CP and 71 healthy controls was randomly separated into training and validation groups, using a 7:3 ratio. Radiomics features were extracted from grey-matter and white-matter in the filtered mwp0* image. The Mann-Whitney U test, Spearman’s rank correlation test, and least absolute shrinkage and selection operator (LASSO) were utilized to select features. An XGBoost model was created based on these features, and Shapley Additive exPlanations (SHAP) was used for personalization and visual interpretation. A nomogram was developed for the diagnosis of FMS subgroups, utilizing radiomics scores and clinical predictors. The efficacy of the nomogram was evaluated using the area under the receiver operating characteristic curve, while decision curve analysis was employed to evaluate its clinical efficacy. The XGBoost model displays stability in the training validation group, indicating lower overfitting of CP model. The nomogram model combined with the rad-score has a greater ability to distinguish between typical and sub-clinical than the clinical factor model alone. We developed and validated a CP diagnosis model by XGBoost and realized model visualization through SHAP. The rad-score obtained by machine learning was used to build a nomogram model that combines clinical scales to distinguish patients with typical and sub-clinical fibromyalgia.

Study of the patterns of ice lake variation and the factors influencing these changes in the western Nyingchi area

Abstract The current ice lake dataset in the western region of Nyingchi requires further improvement. Due to the intricate distribution of ice lakes and imprecise boundary delineation, research tends to overlook small-scale ice lakes in this area. Moreover, most related studies have focused solely on variations in ice lake areas within key regions, such as the Himalayas, with little attention given to changes occurring in southeastern Tibet. The frequency of ice and snow disasters in the study area has been steadily increasing over the years. Therefore, this study utilizes Landsat satellite images and employs visual interpretation methods to generate more precise and comprehensive maps depicting the distribution of ice lakes in the western region of Nyingchi Province for the years 1994, 2010, 2018, and 2022. Additionally, changes in scale and spatial patterns of different types of ice lakes were investigated. Between 1994 and 2022, the ice lake area in the study area significantly increased by 22.5%, reaching a total of 35.8 ± 3.0 km2. This expansion was primarily driven by glacier-fed lakes, which experienced a remarkable growth rate of 30.8%. In contrast, the non-glacier-fed lakes experienced an increase by only 15.6%. Notably, ice lakes at higher elevations exhibited a peak in expansion, with those above 5143.0 m experiencing the most substantial growth rate of 44.8%. The long-term expansion rate of ice lakes is investigated through the measurement of changes in their boundaries, with the aim to understand the factors contributing to their growth. These findings indicate the rapid expansion of the ice lake near the glacier, with an annual growth rate of 1.3% per annum. Specifically, the glacial-fed section exhibited an expansion rate of 1.1% per annum, while the nonglacial-fed section experienced a growth rate of 0.6% per annum. The seasonal variability in marine glaciers is the primary factor influencing the expansion of ice lakes in this region, with temperature and precipitation serving as the principal driving forces impacting the transformation of these lakes. The data provided by the research results will facilitate a comprehensive understanding of the dynamics and mechanisms governing the ice lake in western Nyingchi, thereby contributing to an enhanced scientific comprehension of potential disaster risks associated with this ice lake.

Ranking attention multiple instance learning for lymph node metastasis prediction on multicenter cervical cancer MRI.

In the current clinical diagnostic process, the gold standard for lymph node metastasis (LNM) diagnosis is histopathological examination following surgical lymphadenectomy. Developing a non-invasive and preoperative method for predicting LNM is necessary and holds significant clinical importance. We develop a ranking attention multiple instance learning (RA-MIL) model that integrates convolutional neural networks (CNNs) and ranking attention pooling to diagnose LNM from T2 MRI. Our RA-MIL model applies the CNNs to derive imaging features from 2D MRI slices and employs ranking attention pooling to create patient-level feature representation for diagnostic classification. Based on the MIL and attention theory, informative regions of top-ranking MRI slices from LNM-positive patients are visualized to enhance the interpretability of automatic LNM prediction. This retrospective study collected 300 female patients with cervical cancer who underwent T2-weighted magnetic resonance imaging (MRI) scanning and histopathological diagnosis from one hospital (289 patients) and one open-source dataset (11 patients). Our RA-MIL model delivers promising LNM prediction performance, achieving the area under the receiver operating characteristic curve (AUC) of 0.809 on the internal test set and 0.833 on the public dataset. Experiments show significant improvements in LNM status prediction using the proposed RA-MIL model compared with other state-of-the-art (SOTA) comparative deep learning models. The developed RA-MIL model has the potential to serve as a non-invasive auxiliary tool for preoperative LNM prediction, offering visual interpretability regarding informative MRI slices and regions in LNM-positive patients.

Incremental learning model for sustainable agricultural land assessment using multimodal satellite data

ABSTRACT The identification of agricultural lands is crucial for sustainable development in rural areas. In this paper, an augmented model that utilizes multimodal satellite-based data samples for identifying agricultural lands via incremental learning. The Whale Optimization Algorithm (WOA) is used for augmenting collected images and data samples to enhance the accuracy of the model under real-time conditions. To identify agricultural lands, Deep Convolutional Neural Networks (CNNs) are trained on the augmented data samples. Additionally, the incorporation of Q-Learning for continuous optimization of the model to enhance its efficiency and effectiveness in identifying agricultural lands. The proposed model offers many edges over existing methods. Firstly, the use of multimodal satellite-based data samples allows for a comprehensive and accurate analysis of agricultural lands. Secondly, the incorporation of the Whale Optimization Algorithm enables the augmentation of collected data samples, leading to improved accuracy and reliability of the model. Thirdly, Deep CNNs allows the extraction of complex features from the data, leading to more accurate identification of agricultural lands. Finally, the use of Q-Learning ensures that the model is continuously optimized to improve its efficiency and effectiveness. The need for this work arises from the limitations of existing methods in accurately identifying agricultural lands. Traditional methods based on manual surveys and visual interpretation are time-consuming, expensive, and prone to errors. Moreover, existing automated methods often lack the ability to analyse multimodal satellite-based data samples and fail to provide accurate results. Based on these observations, the proposed augmented model offers a promising solution for identifying agricultural lands for sustainable development. The use of multimodal satellite-based data samples, WOA, Deep CNNs, and Q-Learning allows for an accurate and efficient analysis of agricultural lands, which can aid in sustainable development planning and decision-making operations.

Reflectance spectrometry and multispectral data for mapping fractures and hydrothermal alterations in the northern edge of the eastern High Atlas, Morocco

The Marginal Folds, in the north-western axis of Moroccan eastern High Atlas, are mainly composed of the Infra-Cenomanian terrains. These latter contain continental detrital deposits (red beds) and are characterized by a network of fractures. These marginal folds host significant concentrations of metallic minerals, such as Cu, Pb, Ag, and Zn, particularly at the Merija (Cu) and Bou Sellam (Pb-Zn) sites.Several techniques were applied to the Landsat-8 Oli images to improve the clarity and visibility of the linear features. Radiometric and atmospheric corrections, color compositions, directional filters, and principal component analysis were adopted. The lineaments resulting from automatic extraction, as well as their statistical analysis were validated by visual interpretation and field investigations. Statistical analysis revealed three dominants fracture systems: N-S, NE-SW, and E-W; the first two systems show a high density in the study area.The mineral alteration of the outcropping rocks is well described by ASTER multispectral imaging techniques. In this work, the effectiveness of this techniques for mineral alteration mapping was demonstrated on the Merija area. Several occurrences of mineral alteration were highlighted, using a combination of false color and band ratios, the principal component analysis (PCA), and the band ratios. This research was completed by reflectance spectrometry, covering the visible, near-infrared (VNIR), and short-wave infrared (SWIR) domains, to identify mineral alteration.Hydrothermal alteration in the Merija region includes clay, phyllite, carbonate, and phyllosilicate alteration, such as kaolinite, illite, montmorillonite, palygorskite, and vermiculite. Regarding to oxidation, as evidenced by the presence of goethite, jarosite, and hematite, it is widespread in most of the analyzed samples, resulting from the alteration of pyrite, followed by jarosite and goethite.

Surging dynamics of unnamed glaciers at the Abi Gamin Peak in the central Himalayas

Surge-type glaciers in the Himalayas have been extensively documented, however, understanding of the mechanisms behind glacier surges remain limited. Herein, based on multi-source remote sensing data, we systematically investigated the characteristics and subglacial processes of the unnamed glacier at Abi Gamin Peak in central Himalayas. Our approach integrated optical stereo photogrammetry, feature tracking, visual interpretation, and glacier velocity decomposition. Our study reveals that the glacier surge was initiated in August 2019 and lasted for less than six months, with rapid acceleration and deceleration phases. During the surge, the glacier transported approximately 0.233 km3 of mass from higher to lower elevations, leading to a thickness increase of >70 m at the glacier terminus. The glacier terminus advanced by >800 m, accompanied by significant expansion of the crevasses. Furthermore, we quantitatively revealed the evolution of basal stresses, strain rates, and sliding velocities during the surge, indirectly characterising the influence of water on it. We contend that the surge in this glacier was primarily driven by subglacial sliding induced by glacier surface meltwater. Significant changes in regional climate serve as external factors that perturb the glacial dynamic equilibrium. The observed characteristics of the unnamed glacier at Abi Gamin Peak indicate that its surge was controlled by a hydrological switch. Notably, our work contributes to an enhanced understanding of glacier surge mechanisms in High Mountain Asia.

Machine Learning Model Based on Prognostic Nutritional Index for Predicting Long-Term Outcomes in Patients With HCC Undergoing Ablation.

To develop multiple machine learning (ML) models based on the prognostic nutritional index (PNI) and determine the optimal model for predicting long-term survival outcomes in hepatocellular carcinoma (HCC) patients after local ablation. From January 2009 to December 2019, we analyzed data from 848 primary HCC patients who underwent local ablation. ML models were constructed and evaluated using the concordance index (C-index), concordance-discordance area under curve (C/D AUC), and Brier scores. The optimal ML model was interpreted using the partial dependence plot (PDP) and SHapley Additive exPlanations (SHAP) framework. Additionally, the prognostic performance of our model was compared with other models. Alkaline phosphatase, preoperation alpha-fetoprotein level, PNI, tumor number, and tumor size were identified as independent prognostic factors for ML model construction. Among the 19 ML algorithms tested, the Aorsf model showed superior performance in both the training cohort (C/D AUC: 0.733; C-index: 0.736; Brier score: 0.133) and validation cohort (C/D AUC: 0.713; C-index: 0.793; Brier score: 0.117). The time-dependent AUC of the Aorsf model for predicting overall survival was as follows: 1-, 3-, 5-, 7-, and 9-year were 0.828, 0.765, 0.781, 0.817, and 0.812 in the training cohort, 0.846, 0.859, 0.824, 0.845, and 0.874 in the validation cohort, respectively. The PDP and SHAP algorithms were employed for visual interpretation. Furthermore, time-AUC and decision curve analysis demonstrated that the Aorsf model provided superior clinical benefits compared to other models. The PNI-based Aorsf model effectively predicts long-term survival outcomes after ablation therapy, making a significant contribution to HCC research by improving surveillance, prevention, and treatment strategies.

Computer Vision Promising Innovations

Computer vision, an interdisciplinary field bridging artificial intelligence and image processing, seeks to bestow machines with the capability to interpret and make decisions based on visual data. As the digital age propels forward, the ubiquity of visual content underscores the importance of efficient and effective automated interpretation. This paper delves deeply into the modern advancements and methodologies of computer vision, emphasizing its transformative role in various applications ranging from medical imaging to autonomous driving. With the increasing complexity of visual data, challenges arise pertaining to real-time processing, scalability, and the ethical implications of automated decision-making. Through an exhaustive literature review and novel experimentation, this research demystifies the multifaceted domain of computer vision, elucidating its potential and constraints. The study culminates in a visionary outlook, highlighting future avenues for research, including the fusion of augmented reality with computer vision, novel deep learning architectures, and ensuring ethical AI practices in visual interpretation.