Open Dataset Research Articles

Cost-optimized probabilistic maintenance for condition monitoring of wind turbines with rare failures

We propose a method, a model, and a form of presenting model results for condition monitoring of a small set of wind turbines with rare failures. The main new ingredient of the method is to sample failure thresholds according to the profit they give to an operating company. The model is a multiple linear regression with seasonal components and external regressors, representing all sensor components except for the selected one. To overcome the scarcity of the training data, we use the median sensor values from all available turbines in their healthy state. The cumulated deviation from the normal behavior model obtained for this median turbine is calibrated for each turbine at the beginning of the test period and after known failures. The proposed form of presenting results is to set a scale for possible costs, control for random maintenance, and show a whole distribution of costs depending on the free model parameters. We make a case study on an open dataset with SCADA data from multiple sensors and show that considering the influence of turbine components is more critical than seasonality. The distribution, the average, and the standard deviation of maintenance costs can be very different for similar minimal costs. Random maintenance can be more profitable than reactive maintenance and other approaches. Our predictive maintenance model outperforms random maintenance and competitors for the whole set of considered turbines, giving substantial savings.

An open access dataset for strong-motion data (PGA, PGV, and Site VS) of 2023 M6.2 Jishishan, Gansu, China earthquake

An open access dataset for strong-motion data (PGA, PGV, and Site VS) of 2023 M6.2 Jishishan, Gansu, China earthquake

The FarmQuest Player Telemetry Dataset: Playthrough Data of a Cozy Farming Game

Open datasets are the foundation of many types of academic research. One field that requires datasets is data-driven player modeling, but there is a lack of variety in existing datasets. We introduce the FarmQuest Player Telemetry (FPT) dataset, a new playthrough dataset of a cozy farming game. We envision this dataset will be used for reproducing prior results, evaluating initial ideas, and evaluating the generalizability of new and existing algorithms.

Multimodal Data Fusion for Precise Lettuce Phenotype Estimation Using Deep Learning Algorithms

Effective lettuce cultivation requires precise monitoring of growth characteristics, quality assessment, and optimal harvest timing. In a recent study, a deep learning model based on multimodal data fusion was developed to estimate lettuce phenotypic traits accurately. A dual-modal network combining RGB and depth images was designed using an open lettuce dataset. The network incorporated both a feature correction module and a feature fusion module, significantly enhancing the performance in object detection, segmentation, and trait estimation. The model demonstrated high accuracy in estimating key traits, including fresh weight (fw), dry weight (dw), plant height (h), canopy diameter (d), and leaf area (la), achieving an R2 of 0.9732 for fresh weight. Robustness and accuracy were further validated through 5-fold cross-validation, offering a promising approach for future crop phenotyping.

Reduction of Vision-Based Models for Fall Detection

Due to the limitations that falls have on humans, early detection of these becomes essential to avoid further damage. In many applications, various technologies are used to acquire accurate information from individuals such as wearable sensors, environmental sensors or cameras, but all of these require high computational resources in many cases, delaying the response of the entire system. The complexity of the models used to process the input data and detect these activities makes them almost impossible to complete on devices with limited resources, which are the ones that could offer an immediate response avoiding unnecessary communications between sensors and centralized computing centers. In this work, we chose to reduce the models to detect falls using images as input data. We proceeded to use image sequences as video frames, using data from two open source datasets, and we applied the Sparse Low Rank Method to reduce certain layers of the Convolutional Neural Networks that were the backbone of the models. Additionally, we chose to replace a convolutional block with Long Short Term Memory to consider the latest updates of these data sequences. The results showed that performance was maintained decently while significantly reducing the parameter size of the resulting models.

Comprehensive experimental datasets of quasicrystals and their approximants

AbstractQuasicrystals are solid-state materials that typically exhibit unique symmetries, such as icosahedral or decagonal diffraction symmetry. They were first discovered in 1984. Over the past four decades of quasicrystal research, around 100 stable quasicrystals have been discovered. In recent years, machine learning has been employed to explore quasicrystals with unique properties inherent to quasiperiodic systems. However, the lack of open data on quasicrystal composition, structure, and physical properties has hindered the widespread use of machine learning in quasicrystal research. This study involves a comprehensive literature review and manual data extraction to develop open datasets consisting of composition, structure types, phase diagrams, and sample fabrication processes for a wide range of stable and metastable quasicrystals and approximant crystals, as well as the temperature-dependent thermal, electrical, and magnetic properties.

An Improved Transformer Model for Sap Flow Prediction that Efficiently Utilizes Environmental Information

AbstractAs an important reference for assessing plant water consumption and estimating plant transpiration, it is of great significance to achieve accurate prediction of plant sap flow. A number of deep learning models were established and compared using approximately 3 years of continuous eucalyptus flow time series data collected from the SAPFLUXNET open dataset and 6 environmental factors, including shortwave solar incident radiation, air temperature, air relative humidity, net radiation, vapor pressure deficit, and photosynthetic photon flux density. The experimental results show that the improved Transformer model, with the introduction of a two-step self-attention mechanism and simplified design, maintains significant predictive performance advantages compared to the original Transformer model, long short-term memory, gated recurrent unit, and temporal convolutional neural network models. In the shorter 1-h forecast, the mean squared error and coefficient of determination (R2) of the improved Transformer model are 0.0191 and 0.965, respectively. Compared to the suboptimal typical Transformer model, the MSE is reduced by 22.9%, and R2 is increased by 1.0%. Additionally, the improved model maintains stable predictive performance advantages in long-term plant flow prediction. In the longest 8-h advance prediction, the MSE is reduced by 14.9% compared to the suboptimal Transformer model, and R2 increases by 3.0% compared to the Transformer model. The comprehensive experimental results show that the improved Transformer model makes more effective use of environmental information to achieve more accurate and long-term plant flow prediction. This study emphasizes the basic principle and validity of the two-step self-attention network structure and provides a valuable basis for developing more effective methods for predicting plant sap flow.

Multiple feature selection based on an optimization strategy for causal analysis of health data.

Recent advancements in information technology and wearable devices have revolutionized healthcare through health data analysis. Identifying significant relationships in complex health data enhances healthcare and public health strategies. In health analytics, causal graphs are important for investigating the relationships among health features. However, they face challenges owing to the large number of features, complexity, and computational demands. Feature selection methods are useful for addressing these challenges. In this paper, we present a framework for multiple feature selection based on an optimization strategy for causal analysis of health data. We select multiple health features based on an optimization strategy. First, we define a Weighted Total Score (WTS) index to assess the feature importance after the combination of different feature selection methods. To explore an optimal set of weights for each method, we design a multiple feature selection algorithm integrated with the greedy algorithm. The features are then ranked according to their WTS, enabling selection of the most important ones. After that, causal graphs are constructed based on the selected features, and the statistical significance of the paths is assessed. Furthermore, evaluation experiments are conducted on an experiment dataset collected for this study and an open dataset for diabetes. The results demonstrate that our approach outperforms baseline models by reducing the number of features while improving model performance. Moreover, the statistical significance of the relationships between features uncovered through causal graphs is validated for both datasets. By using the proposed framework for multiple feature selection based on an optimization strategy for causal analysis, the number of features is reduced and the causal relationships are uncovered and validated.

Empowering Youth through Open Data: Map-Based Storytelling of Croatian vs. European Youth

Abstract. In the digital age, open data has become a critical asset for fostering transparency, accountability, and civic engagement. However, the widespread availability of data has outpaced citizens' ability to effectively utilize it, underscoring the need for data literacy skills, especially among youth. This paper addresses the gap in data literacy by proposing an innovative teaching approach that leverages map-based storytelling to engage young people and enhance their data literacy. By integrating real-world open datasets into interactive visual narratives, this approach aims to captivate young audiences, develop critical thinking skills, and foster a deeper understanding of socio-economic issues. Through a case study of a Datathon project titled “Croatian Youth vs. EU: Who has it better?”, this research demonstrates the efficacy of combining data visualization and storytelling to promote data literacy and civic engagement. The findings highlight the potential of open data initiatives and open-source technologies in empowering youth and enhancing their participation in open government initiatives and policy-making processes.

Point Cloud Registration Method Based on Improved TLBO for Landing Gear Components Measurement

When using point cloud technology to measure the dimension and geometric error of aircraft landing gear components, the point cloud data obtained after scanning may have certain differences because of the sophistication and diversity of the components that make up the landing gear. However, when using traditional point cloud registration algorithms, if the initial pose between point clouds is poor, it can lead to significant errors in the final registration results or even registration failure. Furthermore, the significant difference in registration results between point clouds can affect the final measurement results. Adopting Teaching-Learning-Based Optimization (TLBO) to solve some optimization problems has unique advantages such as high accuracy and good stability. This study integrates TLBO with point cloud registration. To increase the probability of using TLBO for point cloud registration to search for the global optimal solution, adaptive learning weights are first introduced during the learner phase of the basic TLBO. Secondly, an additional tutoring phase has been designed based on the symmetry and unimodality of the normal distribution to improve the accuracy of the solution results. In order to evaluate the performance of the proposed algorithm, it was first used to solve the CEC2017 test function. The comparison results with other metaheuristics showed that the improved TLBO has excellent comprehensive performance. Then, registration experiments were conducted using the open point cloud dataset and the landing gear point cloud dataset, respectively. The registration results showed that the point cloud registration method proposed in this paper has strong competitiveness.

Introduction to the Special Issue on Realistic Synthetic Data: Generation, Learning, Evaluation

This is the foreword of our special issue volume on Realistic Synthetic Data: Generation, Learning, Evaluation organized with the ACM Transactions on Multimedia Computing, Communications, and Applications. It presents the target of the special issue that relates to synthetic data for various modalities, e.g., signals, images, volumes, audio, etc., controllable generation for learning from synthetic data, transfer learning and generalization of models, causality in data generation, addressing bias, limitations and trustworthiness in data generation, evaluation measures/protocols and benchmarks to assess quality of synthetic content, open synthetic datasets and software tools, and ethical aspects of synthetic data. The call for papers received a record number of 40 submissions out of which 15 were finally accepted for publication. This introduction provides an overview of the topics of each of the articles.

The causal relationship between diabetes mellitus and the risk of sensorineural hearing loss: A Mendelian randomization study.

An increasing body of evidence suggests that diabetes mellitus (DM) plays a role in sensorineural hearing loss (SNHL). However, the specific causal relationship between DM and SNHL remains partially uncertain. This study aimed to investigate the causal relationship between DM and the risk of SNHL using a Mendelian randomization (MR) study. Single nucleotide polymorphisms closely related to DM were selected as instrumental variables using open genome-wide association study datasets. Three methods based on inverse variance weighted were utilized to investigate the causal relationship between DM and SNHL. Subsequently, multivariable MR (MVMR) was executed to adjust for confounding genetic associations. In addition, a range of sensitivity analyses were performed to assess the stability and reliability of the MR results. The inverse variance weighted analysis indicated a potential genetic causality between DM and SNHL (odds ratio [OR]: 2.179; 95% confidence interval [CI]: 1.123-4.231; P = .021). The sensitivity analyses showed that the included single nucleotide polymorphisms had no heterogeneity, horizontal pleiotropy, and outliers (P > .05). Moreover, the leave-one-out method further verified the robustness of the MR analysis results. Finally, the results of the MVMR study predicted that there was a genetic causal relationship between type 1 DM and SNHL (OR: 1.032; 95%CI: 1.018-1.047; P = 5.45 × 10-6), while there was no causality between type 2 DM and SNHL (OR: 1.000; 95%CI: 0.958-1.036; P = .853). Our study suggested that DM and type 1 DM may be genetically responsible for SNHL. Although our study did not detect a genetic causal relationship between type 2 DM and SNHL, this does not rule out a relationship between them at other mechanistic levels. Further studies are required to confirm the findings and look into the physiological and pathological mechanism underlying these relationships.

UAV Detection using Convolutional Neural Networks and Radio Frequency Data

Unmanned Aerial Vehicles (UAVs) are increasingly seen as significant threats to both civilian and military installations, highlighting the need for effective UAV detection systems. Among the various detection methods proposed, passive radio frequency sensing has proven particularly effective. In this study, we utilized an open radio frequency dataset to explore the use of Convolutional Neural Networks (CNNs) for UAV detection. Our comparison with traditional machine learning models, such as random forest, AdaBoost, and XGBoost, demonstrates that CNNs offer superior performance. Specifically, CNNs achieved impressive accuracy rates: 99.93% for detecting UAVs, 93.30% for classifying UAV types, and 76.43% for categorizing UAV modes. These results underscore the potential of CNNs as a powerful tool for UAV detection and classification.

An improved face attributes editing method based on DDIM

The main advantage of DDIM is that it guarantees the quality of the generated images while increasing the efficiency of the generation by modifying the sampling strategy in the diffusion process. DiffusionRig, which addresses the problem of maintaining identity consistency by learning the person-specific facial prior in a tiny personalized dataset, is a successful representation of the DDIM strategy. Based on DiffusionRig, in this article, we propose an improved face attributes editing method based on DDIM to improve naturalness and accuracy of editing results in complex face attribute editing tasks and the generalization ability. Our method combines DDIM and DECA together and use two-stage training strategy. To reduce DiffusionRig’s limitations in handling face attribute editing tasks that require nonlinear understanding and fine-tuning, our method also introduces a channel attention mechanism and a depth-separable convolution technique in the training model. In the first stage we trained our model on the open FFHQ dataset, which consists of 30,000 high-resolution face image. In the second stage, the model was refined by using a tiny personalized dataset. Face attribute editing experiments,comparative experiment with DiffusionRig, and a series of ablation experiments have been performed. Then, the validity of our improved method is verified by qualitative and quantitative analysis.

Artificial intelligence correctly classifies developmental stages of monarch caterpillars enabling better conservation through the use of community science photographs

Rapid technological advances and growing participation from amateur naturalists have made countless images of insects in their natural habitats available on global web portals. Despite advances in automated species identification, traits like developmental stage or health remain underexplored or manually annotated, with limited focus on automating these features. As a proof-of-concept, we developed a computer vision model utilizing the YOLOv5 algorithm to accurately detect monarch butterfly caterpillars in photographs and classify them into their five developmental stages (instars). The training data were obtained from the iNaturalist portal, and the photographs were first classified and annotated by experts to allow supervised training of models. Our best trained model demonstrates excellent performance on object detection, achieving a mean average precision score of 95% across all five instars. In terms of classification, the YOLOv5l version yielded the best performance, reaching 87% instar classification accuracy for all classes in the test set. Our approach and model show promise in developing detection and classification models for developmental stages for insects, a resource that can be used for large-scale mechanistic studies. These photos hold valuable untapped information, and we’ve released our annotated collection as an open dataset to support replication and expansion of our methods.

Unveiling Frequency-Specific Microstate Correlates of Anxiety and Depression Symptoms.

Electroencephalography (EEG) microstates are canonical voltage topographies that reflect the temporal dynamics of brain networks on a millisecond time scale. Abnormalities in broadband microstate parameters have been observed in subjects with psychiatric symptoms, indicating their potential as clinical biomarkers. Considering distinct information provided by specific frequency bands of EEG, we hypothesized that microstates in decomposed frequency bands could provide a more detailed depiction of the underlying neuropathological mechanism. In this study, with a large open access resting-state dataset (n = 203), we examined the properties of frequency-specific microstates and their relationship with anxiety and depression symptoms. We conducted clustering on EEG topographies in decomposed frequency bands (delta, theta, alpha and beta), and determined the number of clusters with a meta-criterion. Microstate parameters, including global explained variance (GEV), duration, coverage, occurrence and transition probability, were calculated for eyes-open and eyes-closed states, respectively. Their ability to predict the severity of depression and anxiety symptoms were systematically identified by correlation, regression and classification analyses. Distinct microstate patterns were observed across different frequency bands. Microstate parameters in the alpha band held the best predictive power for emotional symptoms. Microstates B (GEV, coverage) and parieto-central maximum microstate E (coverage, occurrence, transitions from B to E) in the alpha band exhibited significant correlations with depression and anxiety, respectively. Microstate parameters of the alpha band achieved predictive R-square of 0.100 for anxiety scores, which is much higher than those of broadband (R-square = -0.026, p < 0.01). Similar results were found in classification of participants with high and low anxiety symptom scores (68% accuracy in alpha vs. 52% in broadband). These results suggested the value of frequency-specific microstates in predicting emotional symptoms.

DanceCaps: Pseudo-Captioning for Dance Videos Using Large Language Models

In recent years, the dance field has been able to create diverse content by leveraging technical advancements such as deep learning models, generating content beyond the unique artistic creations that only humans can create. However, in terms of dance data, there are still a lack of video and label datasets or datasets that contain multiple tags for videos. To address this gap, this paper explores the feasibility of generating dance captions from tags using a pseudo-captioning approach, inspired by the significant improvements large language models (LLMs) have shown in other domains. Various tags are generated from features extracted from videos and audio, and LLMs are then instructed to produce dance captions based on these tags. Captions were generated using both the open dance dataset and Internet dance videos, followed by user evaluations of randomly sampled captions. Participants found the captions effective in describing dance movements, of expert quality, and consistent with video content. Additionally, positive feedback was received on the evaluation of the gap in image extraction and the inclusion of tag data. This paper introduces and validates a novel pseudo-captioning method for generating dance captions using predefined tags, contributing to the expansion of data available for dance research and offering a practical solution to the current lack of datasets in this field.

Diagnosing and Characterizing Chronic Kidney Disease with Machine Learning: The Value of Clinical Patient Characteristics as Evidenced from an Open Dataset

Applying artificial intelligence (AI) and machine learning for chronic kidney disease (CKD) diagnostics and characterization has the potential to improve the standard of patient care through accurate and early detection, as well as providing a more detailed understanding of the condition. This study employed reproducible validation of AI technology with public domain software applied to CKD diagnostics on a publicly available CKD dataset acquired from 400 patients. The approach presented includes patient-specific symptomatic variables and demonstrates performance improvements associated with this approach. Our best-performing AI models, which include patient symptom variables, achieve predictive accuracies ranging from 99.4 to 100% across both hold-out and 5-fold validation with the light gradient boosting machine. We demonstrate that the exclusion of patient symptom variables reduces model performance in line with the literature on the same dataset. We also provide an unsupervised learning cluster analysis to help interpret variability among, and characterize the population of, patients with CKD.

LEAVES: An Expandable Light-curve Data Set for Automatic Classification of Variable Stars

With the increasing amount of astronomical observation data, it is an inevitable trend to use artificial intelligence methods for automatic analysis and identification of light curves for full samples. However, data sets covering all known classes of variable stars that meet all research needs are not yet available. There is still a lack of standard training data sets specifically designed for any type of light-curve classification, but existing light-curve training sets or data sets cannot be directly merged into a large collection. Based on the open data sets of the All-Sky Automated Survey for SuperNovae, Gaia, and Zwicky Transient Facility, we construct a compatible light-curve data set named LEAVES for automated recognition of variable stars, which can be used for training and testing new classification algorithms. The data set contains a total of 977,953 variable and 134,592 nonvariable light curves, in which the supported variables are divided into six superclasses and nine subclasses. We validate the compatibility of the data set through experiments and employ it to train a hierarchical random forest classifier, which achieves a weighted average F1-score of 0.95 for seven-class classification and 0.93 for 10-class classification. Experimental results prove that the classifier is more compatible than the classifier established based on a single band and a single survey, and has wider applicability while ensuring classification accuracy, which means it can be directly applied to different data types with only a relatively small loss in performance compared to a dedicated model.

RanSMAP: Open dataset of Ransomware Storage and Memory Access Patterns for creating deep learning based ransomware detectors

RanSMAP: Open dataset of Ransomware Storage and Memory Access Patterns for creating deep learning based ransomware detectors