Effectiveness Of Clinical Decision Support Systems Research Articles

Machine Learning Approach to Reduce Alert Fatigue Using a Disease Medication-Related Clinical Decision Support System: Model Development and Validation.

BackgroundComputerized physician order entry (CPOE) systems are incorporated into clinical decision support systems (CDSSs) to reduce medication errors and improve patient safety. Automatic alerts generated from CDSSs can directly assist physicians in making useful clinical decisions and can help shape prescribing behavior. Multiple studies reported that approximately 90%-96% of alerts are overridden by physicians, which raises questions about the effectiveness of CDSSs. There is intense interest in developing sophisticated methods to combat alert fatigue, but there is no consensus on the optimal approaches so far.ObjectiveOur objective was to develop machine learning prediction models to predict physicians’ responses in order to reduce alert fatigue from disease medication–related CDSSs.MethodsWe collected data from a disease medication–related CDSS from a university teaching hospital in Taiwan. We considered prescriptions that triggered alerts in the CDSS between August 2018 and May 2019. Machine learning models, such as artificial neural network (ANN), random forest (RF), naïve Bayes (NB), gradient boosting (GB), and support vector machine (SVM), were used to develop prediction models. The data were randomly split into training (80%) and testing (20%) datasets.ResultsA total of 6453 prescriptions were used in our model. The ANN machine learning prediction model demonstrated excellent discrimination (area under the receiver operating characteristic curve [AUROC] 0.94; accuracy 0.85), whereas the RF, NB, GB, and SVM models had AUROCs of 0.93, 0.91, 0.91, and 0.80, respectively. The sensitivity and specificity of the ANN model were 0.87 and 0.83, respectively.ConclusionsIn this study, ANN showed substantially better performance in predicting individual physician responses to an alert from a disease medication–related CDSS, as compared to the other models. To our knowledge, this is the first study to use machine learning models to predict physician responses to alerts; furthermore, it can help to develop sophisticated CDSSs in real-world clinical settings.

E-Health Tools to Improve Antibiotic Use and Resistances: A Systematic Review.

(1) Background: e-Health tools, especially in the form of clinical decision support systems (CDSSs), have been emerging more quickly than ever before. The main objective of this systematic review is to assess the influence of these tools on antibiotic use for respiratory tract infections. (2) Methods: The scientific databases, MEDLINE-PubMed and EMBASE, were searched. The search was conducted by two independent researchers. The search strategy was mainly designed to identify relevant studies on the effectiveness of CDSSs in improving antibiotic use, as a primary outcome, and on the acceptability and usability of CDSSs, as a secondary outcome. (3) Results: After the selection, 22 articles were included. The outcomes were grouped either into antibiotics prescription practices or adherence to guidelines concerning antibiotics prescription. Overall, 15 out of the 22 studies had statistically significant outcomes related to the interventions. (4) Conclusions: Overall, the results show a positive impact on the prescription and conscientious use of antibiotics for respiratory tract infections, both with respect to patients and prescribing healthcare professionals. CDSSs have been shown to have great potential as powerful tools for improving both clinical care and patient outcomes.

Computerised clinical decision support systems to improve medication safety in long-term care homes: a systematic review

ObjectivesComputerised clinical decision support systems (CCDSS) are used to improve the quality of care in various healthcare settings. This systematic review evaluated the impact of CCDSS on improving medication safety...

Review of computerized clinical decision support in community pharmacy.

Clinical decision support software (CDSS) has been increasingly implemented to assist improved prescribing practice. Reviews and studies report generally positive results regarding prescribing changes and, to a lesser extent, patient outcomes. Little information is available, however, concerning the use of CDSS in community pharmacy practice. Given the apparent paucity of publications examining this topic, we conducted a review to determine whether CDSS in community pharmacy practice can improve medication use and patient outcomes. A literature search of articles on CDSS relevant to community pharmacy and published between 1 January 2005 and 21 October 2013 was undertaken. Articles were included if the healthcare setting was community pharmacy and the article indicated that pharmacy use of CDSS was part of the study intervention. Eight studies were found which assessed counselling, selected drug interactions, inappropriate prescribing and under-prescribing. One study was halted due to insufficient data collection. Six studies showed statistically significant improvements in the measured outcomes: increased patient counselling, 31% reduced frequency of drug-drug interactions (DDIs), reduced frequency of inappropriate medications in the elderly (2·2-1·8% patients) and in pregnant women (5·5-2·9% patients), and increased pharmacists' interventions for under-prescribed low-dose aspirin (1·74 vs. 0·91 per 100 patients with type 2 diabetes) and over-prescribed high-dose proton-pump inhibitors (PPIs) (1·67 vs. 0·17 interventions per 100 high-dose PPI prescriptions). Most studies showed improved prescribing practice, via direct communication between pharmacists and doctors or indirectly via patient education. Factors limiting the impact of improved prescribing included alert fatigue and clinical inertia. No study investigated patient outcomes and little investigation had been undertaken on how CDSS could be best implemented. Few studies have been undertaken in community pharmacy practice, and based on the positive findings reported, further research should be directed in this area, including investigation of patient outcomes.

Effect of Clinical Decision-Support Systems

Despite increasing emphasis on the role of clinical decision-support systems (CDSSs) for improving care and reducing costs, evidence to support widespread use is lacking. To evaluate the effect of CDSSs on clinical outcomes, health care processes, workload and efficiency, patient satisfaction, cost, and provider use and implementation. MEDLINE, CINAHL, PsycINFO, and Web of Science through January 2011. Investigators independently screened reports to identify randomized trials published in English of electronic CDSSs that were implemented in clinical settings; used by providers to aid decision making at the point of care; and reported clinical, health care process, workload, relationship-centered, economic, or provider use outcomes. Investigators extracted data about study design, participant characteristics, interventions, outcomes, and quality. 148 randomized, controlled trials were included. A total of 128 (86%) assessed health care process measures, 29 (20%) assessed clinical outcomes, and 22 (15%) measured costs. Both commercially and locally developed CDSSs improved health care process measures related to performing preventive services (n= 25; odds ratio [OR], 1.42 [95% CI, 1.27 to 1.58]), ordering clinical studies (n= 20; OR, 1.72 [CI, 1.47 to 2.00]), and prescribing therapies (n= 46; OR, 1.57 [CI, 1.35 to 1.82]). Few studies measured potential unintended consequences or adverse effects. Studies were heterogeneous in interventions, populations, settings, and outcomes. Publication bias and selective reporting cannot be excluded. Both commercially and locally developed CDSSs are effective at improving health care process measures across diverse settings, but evidence for clinical, economic, workload, and efficiency outcomes remains sparse. This review expands knowledge in the field by demonstrating the benefits of CDSSs outside of experienced academic centers. Agency for Healthcare Research and Quality.

Effects of clinical decision-support systems on practitioner performance and patient outcomes: a synthesis of high-quality systematic review findings

To synthesize the literature on clinical decision-support systems' (CDSS) impact on healthcare practitioner performance and patient outcomes. Literature search on Medline, Embase, Inspec, Cinahl, Cochrane/Dare and analysis of high-quality systematic reviews (SRs) on CDSS in hospital settings. Two-stage inclusion procedure: (1) selection of publications on predefined inclusion criteria; (2) independent methodological assessment of preincluded SRs by the 11-item measurement tool, AMSTAR. Inclusion of SRs with AMSTAR score 9 or above. SRs were thereafter rated on level of evidence. Each stage was performed by two independent reviewers. 17 out of 35 preincluded SRs were of high methodological quality and further analyzed. Evidence that CDSS significantly impacted practitioner performance was found in 52 out of 91 unique studies of the 16 SRs examining this effect (57%). Only 25 out of 82 unique studies of the 16 SRs reported evidence that CDSS positively impacted patient outcomes (30%). Few studies have found any benefits on patient outcomes, though many of these have been too small in sample size or too short in time to reveal clinically important effects. There is significant evidence that CDSS can positively impact healthcare providers' performance with drug ordering and preventive care reminder systems as most clear examples. These outcomes may be explained by the fact that these types of CDSS require a minimum of patient data that are largely available before the advice is (to be) generated: at the time clinicians make the decisions.