Data Setting Research Articles

Appraising eHealth Investment for Africa: Scoping Review and Development of a Framework.

As opportunities grow for resource-constrained countries to use eHealth (digital health) to strengthen health systems, a dilemma arises. Wise eHealth investments require adequate appraisal to address opportunity costs. Economic appraisal techniques conventionally utilised for this purpose require sufficient economic expertise and adequate data that are frequently in short supply in low- and middle-income countries. This paper aims to identify, and, if required, develop, a suitable framework for performing eHealth investment appraisals in settings of limited economic expertise and data. Four progressive steps were followed: (1) identify required framework attributes from published checklists; (2) select, review, and chart relevant frameworks using a scoping review; (3) analyse the frameworks using deductive and inductive iterations; and, if necessary, (4) develop a new framework using findings from the first three steps. Twenty-four candidate investment appraisal attributes were identified and seven relevant frameworks were selected for review. Analysis of these frameworks led to the refinement of the candidate attributes to 23 final attributes, and each framework was compared against them. No individual framework adequately addressed sufficient attributes. A new framework was developed that addressed all 23 final attributes. A new evidence-based investment appraisal framework has been developed that provides a practical, business case focus for use in resource-constrained African settings.

Developing a Dynamic Feature Selection System (DFSS) for Stock Market Prediction: Application to the Korean Industry Sectors

For several years, a growing interest among numerous researchers and investors in predicting stock price movements has spurred extensive exploration into employing advanced deep learning models. These models aim to develop systems capable of comprehending the stock market’s complex nature. Despite the immense challenge posed by the diverse factors influencing stock price forecasting, there remains a notable lack of research focused on identifying the essential feature set for accurate predictions. In this study, we propose a Dynamic Feature Selection System (DFSS) to predict stock prices across the 10 major industries, as classified by the FnGuide Industry Classification Standard (FICS) in South Korea. We apply 16 feature selection algorithms from filter, wrapper, embedded, and ensemble categories. Subsequently, we adjust the settings of industry-specific index data to evaluate the model’s performance and robustness over time. Our comprehensive results identify the optimal feature sets that significantly impact stock prices within each sector at specific points in time. By analyzing the inclusion ratios and significance of the optimal feature set by category, we gain insights into the proportion of feature classes and their importance. This analysis ensures the interpretability and reliability of our model. The proposed methodology complements existing methods that do not consider changes in the types of variables significantly affecting stock prices over time by dynamically adjusting the input variables used for learning. The primary goal of this study is to enhance active investment strategies by facilitating the creation of diversified portfolios for individual stocks across various sectors, offering robust models and feature sets that consistently demonstrate high performance across industries over time.

Hybrid Neural State-Space Modeling for Supervised and Unsupervised Electrocardiographic Imaging.

State-space modeling (SSM) provides a general framework for many image reconstruction tasks. Error in a priori physiological knowledge of the imaging physics, can bring incorrectness to solutions. Modern deep-learning approaches show great promise but lack interpretability and rely on large amounts of labeled data. In this paper, we present a novel hybrid SSM framework for electrocardiographic imaging (ECGI) to leverage the advantage of state-space formulations in data-driven learning. We first leverage the physics-based forward operator to supervise the learning. We then introduce neural modeling of the transition function and the associated Bayesian filtering strategy. We applied the hybrid SSM framework to reconstruct electrical activity on the heart surface from body-surface potentials. In unsupervised settings of both in-silico and in-vivo data without cardiac electrical activity as the ground truth to supervise the learning, we demonstrated improved ECGI performances of the hybrid SSM framework trained from a small number of ECG observations in comparison to the fixed SSM. We further demonstrated that, when in-silico simulation data becomes available, mixed supervised and unsupervised training of the hybrid SSM achieved a further 40.6% and 45.6% improvements, respectively, in comparison to traditional ECGI baselines and supervised data-driven ECGI baselines for localizing the origin of ventricular activations in real data.

What does the mean mean? A simple test for neuroscience.

Trial-averaged metrics, e.g. tuning curves or population response vectors, are a ubiquitous way of characterizing neuronal activity. But how relevant are such trial-averaged responses to neuronal computation itself? Here we present a simple test to estimate whether average responses reflect aspects of neuronal activity that contribute to neuronal processing. The test probes two assumptions implicitly made whenever average metrics are treated as meaningful representations of neuronal activity: Reliability: Neuronal responses repeat consistently enough across trials that they convey a recognizable reflection of the average response to downstream regions.Behavioural relevance: If a single-trial response is more similar to the average template, it is more likely to evoke correct behavioural responses. We apply this test to two data sets: (1) Two-photon recordings in primary somatosensory cortices (S1 and S2) of mice trained to detect optogenetic stimulation in S1; and (2) Electrophysiological recordings from 71 brain areas in mice performing a contrast discrimination task. Under the highly controlled settings of Data set 1, both assumptions were largely fulfilled. In contrast, the less restrictive paradigm of Data set 2 met neither assumption. Simulations predict that the larger diversity of neuronal response preferences, rather than higher cross-trial reliability, drives the better performance of Data set 1. We conclude that when behaviour is less tightly restricted, average responses do not seem particularly relevant to neuronal computation, potentially because information is encoded more dynamically. Most importantly, we encourage researchers to apply this simple test of computational relevance whenever using trial-averaged neuronal metrics, in order to gauge how representative cross-trial averages are in a given context.

Assessment of the E-value in the presence of bias amplification: a simulation study

BackgroundThe E-value, a measure that has received recent attention in the comparative effectiveness literature, reports the minimum strength of association between an unmeasured confounder and the treatment and outcome that would explain away the estimated treatment effect. This study contributes to the literature on the applications and interpretations of E-values by examining how the E-value is impacted by data with varying levels of association of unobserved covariates with the treatment and outcome measure when covariate adjustment is applied. We calculate the E-value after using regression and propensity score methods (PSMs) to adjust for differences in observed covariates. Propensity score methods are a common observational research method used to balance observed covariates between treatment groups. In practice, researchers may assume propensity score methods that balance treatment groups across observed characteristics will extend to balance of unobserved characteristics. However, that assumption is not testable and has been shown to not hold in realistic data settings. We assess the E-value when covariate adjustment affects the imbalance in unobserved covariates.MethodsOur study uses Monte Carlo simulations to evaluate the impact of unobserved confounders on the treatment effect estimates and to evaluate the performance of the E-Value sensitivity test with the application of regression and propensity score methods under varying levels of unobserved confounding. Specifically, we compare observed and unobserved confounder balance, odds ratios of treatment vs. control, and E-Value sensitivity test statistics from generalized linear model (GLM) regression models, inverse-probability weighted models, and propensity score matching models, over correlations of increasing strength between observed and unobserved confounders.ResultsWe confirm previous findings that propensity score methods – matching or weighting – may increase the imbalance in unobserved confounders. The magnitude of the effect depends on the strength of correlation between the confounder, treatment, and outcomes. We find that E-values calculated after applying propensity score methods tend to be larger when unobserved confounders result in more biased treatment effect estimates.ConclusionsThe E-Value may misrepresent the size of the unobserved effect needed to change the magnitude of the association between treatment and outcome when propensity score methods are used. Thus, caution is warranted when interpreting the E-Value in the context of propensity score methods.

Bayesian Hyperbolic Multidimensional Scaling

Multidimensional scaling (MDS) is a widely used approach for representing high-dimensional, dependent data. MDS works by assigning each observation a location on a low-dimensional geometric manifold, with distance on the manifold representing similarity. We propose a Bayesian approach to multidimensional scaling when the low-dimensional manifold is hyperbolic. Using hyperbolic space facilitates representing tree-like structures common in many settings (e.g., text or genetic data with hierarchical structure). A Bayesian approach provides regularization that minimizes the impact of measurement error in the observed data and assesses uncertainty. We also propose a case-control likelihood approximation that allows for efficient sampling from the posterior distribution in larger data settings, reducing computational complexity from approximately O ( n 2 ) to O ( n ) . We evaluate the proposed method against state-of-the-art alternatives using simulations, canonical reference datasets, Indian village network data, and human gene expression data. Code to reproduce the result in the article is available at https://github.com/peterliu599/BHMDS. Supplementary materials for this article are available online.

Local aggregator enhanced possibilities coupling energy savings and demand response activations

Energy communities and local flexibility aggregators offer new pathways for decentralization and decarbonisation of energy systems. Local flexibility aggregators blending heterogenous distributed energy sources (DER) are strengthening the role of households’ consumers in becoming active participants of the energy transition. The recent technological advances resulting in decline in price and increased performance of end-user premises communication devices enable the aggregation based on the granular contribution of DERs. These new aggregating actors have an unenviable role in terms of data collection, optimization and setting up a fair compensation program between peers. Aggregators have a quite important and responsible role in the energy transition, being key players in activating the granular contribution, however their technical and regulatory toolbox is lacking. This is particularly true if the current state-of-the-art of the data collection system is considered. This paper evaluates the opportunities for delivering a synergetic business model bringing together flexibility activations and energy savings delivered by households’ consumers, paying specific attention to robust approach in terms of low availability of the data. Besides revenue diversification opportunities for a local aggregator, such business model could offer a good opportunity to overcome both technical and motivational challenges for the activation of consumers in the energy market. One of the main challenges identified in a paper are the data collection requirements and the development of proper monitoring and verification techniques which could ease the identification of both energy savings and short-term flexibility activations. This paper proposes possible solutions for establishing a business model enabling the delivery of both energy savings and demand response activations for a local aggregator accessing the energy market, having in mind the technical, regulatory and privacy challenges regarding efficient and performant data collection.

The effect of ESG and CSR attitude on financial performance in Europe: A quantitative re-examination

Focusing on the European context, this paper re-examines the relationship between the ESG and financial performance and whether CSR attitude moderates this relationship. A panel data set with all the listed companies in STOXX Europe 600, covering the period 2012–2022 was built, with company data being sourced from the Refinitiv Eikon platform for a total of 6600 firm-year observations. Six measures of financial performance and three regression frameworks were considered for analysis. Overall, inconsistent patterns of effect are identified across ESG predictors and financial performance measures. The presence of a CSR committee was found to negatively moderate the effect of ESG score on ROA only, whereas an external auditor to the CSR report to negatively moderate it with share price. Future research should consider replicating the proposed re-examination framework in other data settings and legislative and accounting contexts to strengthen the current evidence base and therefore deepen our understanding of the mechanisms underlying the investigated relationships.

All that Glitters Is not Gold: Type-I Error Controlled Variable Selection from Clinical Trial Data.

Clinical trials are primarily conducted to estimate causal effects, but the data collected can also be invaluable for additional research, such as identifying prognostic measures of disease or biomarkers that predict treatment efficacy. However, these exploratory settings are prone to false discoveries (type-I errors) due to the multiple comparisons they entail. Unfortunately, many methods fail to address this issue, in part because the algorithms used are generally designed to optimize predictions and often only provide the measures used for variable selection, such as machine learning model importance scores, as a byproduct. To address the resulting unclear uncertainty in the selection sets, the knockoff framework offers a model-agnostic, robust approach to variable selection with guaranteed type-I error control. Here, we review the knockoff framework in the setting of clinical data, highlighting main considerations using simulation studies. We also extend the framework by introducing a novel knockoff generation method that addresses two main limitations of previously suggested methods relevant for clinical development settings. With this new method, we empirically obtain tighter bounds on type-I error control and gain an order of magnitude in computational efficiency in mixed data settings. We demonstrate comparable selections to those of the competing method for identifying prognostic biomarkers for C-reactive protein levels in patients with psoriatic arthritis in four clinical trials. Our work increases access to the knockoff framework for variable selection from clinical trial data. Hereby, this paper helps to address the current replicability crisis which can result in unnecessary research efforts, increased patient burden, and avoidable costs.

Regularized Nyström Subsampling in Covariate Shift Domain Adaptation Problems

The unsupervised domain adaptation problem with covariate shift assumption is considered. Within the framework of the Reproducing Kernel Hilbert Space concept, an algorithm is constructed that is a combination of the Nyström subsampling and the iterated Tikhonov regularization. This approach allows significantly reduce the amount of computing resources involved and at the same time achieves the minimal (by order) approximation accuracy under the big data settings.

Federated learning with hybrid differential privacy for secure and reliable cross‐IoT platform knowledge sharing

AbstractThe federated learning has gained prominent attention as a collaborative machine learning method, allowing multiple users to jointly train a shared model without directly exchanging raw data. This research addresses the fundamental challenge of balancing data privacy and utility in distributed learning by introducing an innovative hybrid methodology fusing differential privacy with federated learning (HDP‐FL). Through meticulous experimentation on EMNIST and CIFAR‐10 data sets, this hybrid approach yields substantial advancements, showcasing a noteworthy 4.22% and up to 9.39% enhancement in model accuracy for EMNIST and CIFAR‐10, respectively, compared to conventional federated learning methods. Our adjustments to parameters highlighted how noise impacts privacy, showcasing the effectiveness of our hybrid DP approach in striking a balance between privacy and accuracy. Assessments across diverse FL techniques and client counts emphasized this trade‐off, particularly in non‐IID data settings, where our hybrid method effectively countered accuracy declines. Comparative analyses against standard machine learning and state‐of‐the‐art FL approaches consistently showcased the superiority of our proposed model, achieving impressive accuracies of 96.29% for EMNIST and 82.88% for CIFAR‐10. These insights offer a strategic approach to securely collaborate and share knowledge among IoT devices without compromising data privacy, ensuring efficient and reliable learning mechanisms across decentralized networks.

A Prompt-Based Topic-Modeling Method for Depression Detection on Low-Resource Data

Depression has a large impact on one’s personal life, especially during the COVID-19 pandemic. People have been trying to develop reliable methods for the depression detection task. Recently, methods based on deep learning have attracted much attention from the research community. However, they still face the challenge that data collection and annotation are difficult and expensive. In many real-world applications, only a small number of or even no training data are available. In this context, we propose a Prompt-based Topic-modeling method for Depression Detection (PTDD) on low-resource data, aiming to establish an effective way of depression detection under the above challenging situation. Instead of learning discriminating features from a small amount of labeled data, the proposed framework turns to leverage the generalization power of pretrained language models. Specifically, based on the question-and-answer routine during the interview, we first reorganize the text data according to the predefined topics for each interviewee. Via the prompt-based framework, we then predict whether the next-sentence prompt is emotionally positive or not. Finally, the depression detection task can be achieved based on the obtained topicwise predictions through a simple voting process. In the experiments, we validate the effectiveness of our model under several low-resource data settings. The results and analysis demonstrate that our PTDD achieves acceptable performance when only a few training samples or even no training samples are available.

Development of a generative deep learning model to improve epiretinal membrane detection in fundus photography

BackgroundThe epiretinal membrane (ERM) is a common retinal disorder characterized by abnormal fibrocellular tissue at the vitreomacular interface. Most patients with ERM are asymptomatic at early stages. Therefore, screening for ERM will become increasingly important. Despite the high prevalence of ERM, few deep learning studies have investigated ERM detection in the color fundus photography (CFP) domain. In this study, we built a generative model to enhance ERM detection performance in the CFP.MethodsThis deep learning study retrospectively collected 302 ERM and 1,250 healthy CFP data points from a healthcare center. The generative model using StyleGAN2 was trained using single-center data. EfficientNetB0 with StyleGAN2-based augmentation was validated using independent internal single-center data and external datasets. We randomly assigned healthcare center data to the development (80%) and internal validation (20%) datasets. Data from two publicly accessible sources were used as external validation datasets.ResultsStyleGAN2 facilitated realistic CFP synthesis with the characteristic cellophane reflex features of the ERM. The proposed method with StyleGAN2-based augmentation outperformed the typical transfer learning without a generative adversarial network. The proposed model achieved an area under the receiver operating characteristic (AUC) curve of 0.926 for internal validation. AUCs of 0.951 and 0.914 were obtained for the two external validation datasets. Compared with the deep learning model without augmentation, StyleGAN2-based augmentation improved the detection performance and contributed to the focus on the location of the ERM.ConclusionsWe proposed an ERM detection model by synthesizing realistic CFP images with the pathological features of ERM through generative deep learning. We believe that our deep learning framework will help achieve a more accurate detection of ERM in a limited data setting.

Application of the Bayesian network theory in clinical trial data: Severity shift in spasticity numeric rating scale in patients with multiple sclerosis

BackgroundData digitization expands data collection opportunities, representing both a chance to understand interrelationships between variables and a challenge to identify the most appropriate clinical factors. Applications of causal inference techniques to clinical trial data is becoming very attractive, especially with the intent to provide insights into the relationships between baseline characteristics and outcomes. Graphical representations of model structures and conditional probabilities can be powerful tools to illustrate relationships in a high-dimensional data setting. MethodsWe review and apply Bayesian network theory to a clinical case study, presenting an analytical approach to investigating and visualizing causal relationships. We propose the use of the adherence score to compare data networks’ patterns based on different variables’ discretization. Data from adult patients with spasticity related to multiple sclerosis (MSS) from two randomized placebo-controlled clinical trials of nabiximols were used as analysis sets. The training and validation sets included 106 (53 treated, 53 placebo) and 155 (76 treated, 79 placebo) participants, respectively. The primary objective was to create a network and estimate the causal dependencies between participants’ characteristics, changes in MSS severity as reflected by shifts in the patient-reported numeric rating scale (NRS), and changes in symptoms, functional abilities, and quality of life factors. ResultsA causal network was identified between the key factors of assigned treatment, end of study spasticity NRS, and mental health/vitality subscales of the 36-Item Short Form Health Survey questionnaire (4 nodes and 3 edges; adherence score = 93%). In patients with mild spasticity, the impact of nabiximols on mental health or vitality subscales resulted in a probability ratio of 1.63. The decomposed mediation effect of spasticity NRS was observed through a mediation analysis between treatment and mental health (99.4%) or vitality (93.7%) subscales. ConclusionsThe use of innovative methods such as causal networks is highly encouraged to identify dependent relationships among key factors in clinical trial data and drive insights for additional research.

Prescription Sequence Symmetry Analysis (PSSA) to assess prescribing cascades: a step-by-step guide

Prescribing cascades occur when patients are prescribed medication to treat the adverse drug reaction of previously prescribed medication. Prescription sequence symmetry analysis (PSSA) can be used to assess the association between two medications in prescription or dispensing databases and thus the potential occurrence of prescribing cascades. In this article, a step-by-step guide is presented for conducting PSSA to assess prescribing cascades. We describe considerations for medication data collection and setting time periods for relevant parameters, including washout window, exposure window, continued exposure interval and blackout period. With two examples, we illustrate the impact of changes in these parameters on the strengths of associations observed. Given the impact seen, we recommend that researchers clearly specify and explain all considerations regarding medication included and time windows set when studying prescribing cascades with PSSA, and conduct subgroup and sensitivity analyses.

Adaptive Client Clustering for Efficient Federated Learning over Non-IID and Imbalanced Data

Federated learning (FL) is an emerging distributed and privacy-preserving machine learning framework. However, the performance of traditional FL methods is seriously impaired by the real-world data, which appear to be non-IID. The recent clustered federated learning (CFL) methods eliminate the impact of non-IID data by grouping clients with similar data distribution into the same cluster. Unfortunately, existing CFL methods heavily rely on the pre-setting of the cluster number, failing to achieve adaptive client clustering. We also experimentally observe that imbalanced data largely degrade their correctness of client clustering. In this paper, we present a novel CFL method without manual intervention, named AutoCFL, which can eliminate both effects of non-IID and imbalanced data simultaneously. To deal with imbalanced data, the local training adjustment strategy adaptively adjusts the number of local training epochs for each client. To further improve the clustering correctness and adaptability, the weighted voting-based client clustering strategy automatically groups each client into an appropriate cluster. Extensive experiments are conducted to evaluate the design of AutoCFL with three popular datasets under various data settings. Experimental results demonstrate that AutoCFL outperforms state-of-the-art methods, e.g., on average improving model accuracy by 9.24%, while reducing communication costs by 4.67 in an adaptive manner.

MH6D: Multi-Hypothesis Consistency Learning for Category-Level 6-D Object Pose Estimation.

Six-degree-of-freedom (6DoF) object pose estimation is a crucial task for virtual reality and accurate robotic manipulation. Category-level 6DoF pose estimation has recently become popular as it improves generalization to a complete category of objects. However, current methods focus on data-driven differential learning, which makes them highly dependent on the quality of the real-world labeled data and limits their ability to generalize to unseen objects. To address this problem, we propose multi-hypothesis (MH) consistency learning (MH6D) for category-level 6-D object pose estimation without using real-world training data. MH6D uses a parallel consistency learning structure, alleviating the uncertainty problem of single-shot feature extraction and promoting self-adaptation of domain to reduce the synthetic-to-real domain gap. Specifically, three randomly sampled pose transformations are first performed in parallel on the input point cloud. An attention-guided category-level 6-D pose estimation network with channel attention (CA) and global feature cross-attention (GFCA) modules is then proposed to estimate the three hypothesized 6-D object poses by extracting and fusing the global and local features effectively. Finally, we propose a novel loss function that considers both the process and the final result information allowing MH6D to perform robust consistency learning. We conduct experiments under two different training data settings (i.e., only synthetic data and synthetic and real-world data) to verify the generalization ability of MH6D. Extensive experiments on benchmark datasets demonstrate that MH6D achieves state-of-the-art (SOTA) performance, outperforming most data-driven methods even without using any real-world data. The code is available at https://github.com/CNJianLiu/MH6D.

Research on incentive mechanisms for anti-heterogeneous federated learning based on reputation and contribution

<abstract> <p>An optimization algorithm for federated learning, equipped with an incentive mechanism, is introduced to tackle the challenges of excessive iterations, prolonged training durations, and suboptimal efficiency encountered during model training within the federated learning framework. Initially, the algorithm establishes reputation values that are tied to both time and model loss metrics. This foundation enables the creation of incentive mechanisms aimed at rewarding honest nodes while penalizing malicious ones. Subsequently, a bidirectional selection mechanism anchored in blockchain technology is developed, allowing smart contracts to enroll nodes with high reputations in training sessions, thus filtering out malicious clients and enhancing local training efficiency. Furthermore, the integration of the Earth Mover's Distance (EMD) mechanism serves to lessen the impact of non-IID (non-Independent and Identically Distributed) data on the global model, leading to a reduction in the frequency of model training cycles and an improvement in model accuracy. Experimental results confirm that this approach maintains high model accuracy in non-IID data settings, outperforming traditional federated learning algorithms.</p> </abstract>

A Bayesian Federated Learning Framework With Online Laplace Approximation.

Federated learning (FL) allows multiple clients to collaboratively learn a globally shared model through cycles of model aggregation and local model training, without the need to share data. Most existing FL methods train local models separately on different clients, and then simply average their parameters to obtain a centralized model on the server side. However, these approaches generally suffer from large aggregation errors and severe local forgetting, which are particularly bad in heterogeneous data settings. To tackle these issues, in this paper, we propose a novel FL framework that uses online Laplace approximation to approximate posteriors on both the client and server side. On the server side, a multivariate Gaussian product mechanism is employed to construct and maximize a global posterior, largely reducing the aggregation errors induced by large discrepancies between local models. On the client side, a prior loss that uses the global posterior probabilistic parameters delivered from the server is designed to guide the local training. Binding such learning constraints from other clients enables our method to mitigate local forgetting. Finally, we achieve state-of-the-art results on several benchmarks, clearly demonstrating the advantages of the proposed method.

Assistance for The Use of The Microfinance Application for Managers of Bumdes Jati Unggul

Abstract. This service program aims to increase the technical capacity of managers of Jati Unggul BUMDes (Partner) Financial Service Unit in using the Microfinance Application. This microfinance application was previously called the LKM Application which was a product of the IbM service team in 2014. Due to changes in business processes from PERUMDES to BUMDES, the LKM Application underwent improvements and metamorphosed into a Microfinance Application. The methods for implementing this service program were conducting surveys and observations, preparing training and mentoring materials, training and assisting in using the Microfinance Application, and reporting on the results of the service. The results and discussion of this service program are as follows: 1) The managers of the Jati Unggul BUMDES financial services unit need to strengthen their knowledge and technical skills in using the Microfinance Application for handling customer service, recording transactions, and preparing financial reports. 2) Training materials were prepared according to the needs and data process flow which includes; data entry, settings, account mapping, services, reports, and user policies. 3) Training was carried out for 2 effective days with the concept of problem-based learning. 4) Technical assistance was carried out for 12 effective days directly in customer service practices and preparation of financial reports using the Microfinance Application. 5) After participating in training and mentoring, the managers of the Jati Unggul BUMDES financial services unit gained the technical ability to use microfinance applications in service activities, recording transactions, and preparing financial reports.