Pragmatic-Explanatory Continuum Indicator Summary Research Articles

Recommendations for monitoring adherence and fidelity in pragmatic trials based on experience in the Pain Management Collaboratory

Abstract Objective Most pragmatic trials follow the PRagmatic Explanatory Continuum Indicator Summary (PRECIS-2) criteria. The criteria specify unobtrusive measurement of participants’ protocol adherence and practitioners’ intervention fidelity but suggest no special monitoring strategies to assure trial integrity. We present experience with adherence/fidelity monitoring in the Pain Management Collaboratory (PMC) and provide recommendations for their monitoring in pragmatic trials to preserve inferences of treatment comparisons. Methods In November 2021, we surveyed 10 of 11 originally funded PMC pragmatic trials to determine the extent to which adherence and fidelity data were being monitored. Results Of the 10 PMC trials, 8 track adherence/fidelity. The electronic health record is the most frequent source for monitoring adherence (7/10) and fidelity (5/10). Most adherence data are used to monitor participant engagement with the trial intervention (4/10) and are reviewed by study teams (8/10) and often with a data and safety monitoring board (DSMB) (5/10). Half of the trials (5/10) reported using fidelity data for feedback/training; such data are not shared with a DSMB (0/10). Only 2 of 10 trials reported having prespecified guidance or rules around adherence/fidelity (eg, stopping rules or thresholds for corrective action, such as retraining). Conclusions As a best practice for pragmatic trials, we recommend early and regular adherence/fidelity monitoring to determine whether intervention delivery is as intended. We propose a 2-stage process with thresholds for intervening and triggers for conducting a formal futility analysis if adherence and fidelity are not maintained. The level of monitoring should be unobtrusive for both participants and those delivering the intervention; resulting data should be reviewed by an independent DSMB.

Are pragmatism and ethical protections in clinical trials a zero-sum game?

Randomized controlled trials with pragmatic intent aim to generate evidence that directly informs clinical decisions. Some have argued that the ethical protection of informed consent can be in tension with the goals of pragmatism. But the impact of other ethical protections on trial pragmatism has yet to be explored. In this article, we analyze the relationship between additional ethical protections for vulnerable participants and the degree of pragmatism within the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) domains of trial design. We analyze three example trials with pragmatic intent that include vulnerable participants. The relationship between ethical protections and trial pragmatism is complex. In some cases, additional ethical protections for vulnerable participants can promote the pragmatism of some of the PRECIS-2 domains of trial design. When designing trials with pragmatic intent, researchers ought to look for opportunities wherein ethical protections enhance the degree of pragmatism.

Comments, suggestions, and criticisms of the Pragmatic Explanatory Continuum Indicator Summary-2 design tool: a citation analysis

IntroductionThe pragmatic explanatory continuum indicator summary (PRECIS) tool, initially published in 2009 and revised in 2015, was created to assist trialists to align their design choices with the intended purpose of their randomised controlled trial (RCT): either to guide real-world decisions between alternative interventions (pragmatic) or to test hypotheses about intervention mechanisms by minimising sources of variation (explanatory). There have been many comments, suggestions, and criticisms of PRECIS-2. This summary will be used to facilitate the development of to the next revision, which is PRECIS-3. MethodsWe used Web of Science to identify all publication types citing PRECIS-2, published between May 2015 and July 2023. Citations were eligible if they contained ‘substantive’ suggestions, comments, or criticism of the PRECIS-2 tool. We defined ‘substantive’ as comments explicitly referencing at least one PRECIS-2 domain or a concept directly linked to an existing or newly proposed domain.Two reviewers independently extracted comments, suggestions, and criticisms, noting their implications for the update. These were discussed among authors to achieve consensus on the interpretation of each comment and its implications for PRECIS-3. ResultsThe search yielded 885 publications, and after full-text review, 89 articles met the inclusion criteria. Comments pertained to new domains, changes in existing domains, or were relevant across several or all domains. Proposed new domains included assessment of the comparator arm and a domain to describe blinding. There were concerns about scoring eligibility and recruitment domains for cluster trials. Suggested areas for improvement across domains included the need for more scoring guidance for explanatory design choices. DiscussionPublished comments recognise PRECIS-2's success in aiding trialists with pragmatic or explanatory design choices. Enhancing its implementation and widespread use will involve adding new domains, refining domain definitions, and addressing overall tool issues. This citation review offers valuable user feedback, pivotal for shaping the upcoming version of the PRECIS tool, PRECIS-3.

Benchmarking Human–AI collaboration for common evidence appraisal tools

Background and ObjectiveIt is unknown whether large language models (LLMs) may facilitate time- and resource-intensive text-related processes in evidence appraisal. The objective was to quantify the agreement of LLMs with human consensus in appraisal of scientific reporting (Preferred Reporting Items for Systematic reviews and Meta-Analyses [PRISMA]) and methodological rigor (A MeaSurement Tool to Assess systematic Reviews [AMSTAR]) of systematic reviews and design of clinical trials (PRagmatic Explanatory Continuum Indicator Summary 2 [PRECIS-2]) and to identify areas where collaboration between humans and artificial intelligence (AI) would outperform the traditional consensus process of human raters in efficiency. Study Design and SettingFive LLMs (Claude-3-Opus, Claude-2, GPT-4, GPT-3.5, Mixtral-8x22B) assessed 112 systematic reviews applying the PRISMA and AMSTAR criteria and 56 randomized controlled trials applying PRECIS-2. We quantified the agreement between human consensus and (1) individual human raters; (2) individual LLMs; (3) combined LLMs approach; (4) human–AI collaboration. Ratings were marked as deferred (undecided) in case of inconsistency between combined LLMs or between the human rater and the LLM. ResultsIndividual human rater accuracy was 89% for PRISMA and AMSTAR, and 75% for PRECIS-2. Individual LLM accuracy was ranging from 63% (GPT-3.5) to 70% (Claude-3-Opus) for PRISMA, 53% (GPT-3.5) to 74% (Claude-3-Opus) for AMSTAR, and 38% (GPT-4) to 55% (GPT-3.5) for PRECIS-2. Combined LLM ratings led to accuracies of 75%–88% for PRISMA (4%–74% deferred), 74%–89% for AMSTAR (6%–84% deferred), and 64%–79% for PRECIS-2 (29%–88% deferred). Human–AI collaboration resulted in the best accuracies from 89% to 96% for PRISMA (25/35% deferred), 91%–95% for AMSTAR (27/30% deferred), and 80%–86% for PRECIS-2 (76/71% deferred). ConclusionCurrent LLMs alone appraised evidence worse than humans. Human–AI collaboration may reduce workload for the second human rater for the assessment of reporting (PRISMA) and methodological rigor (AMSTAR) but not for complex tasks such as PRECIS-2.

Using PRECIS-2 in Chinese herbal medicine randomized controlled trials for irritable bowel syndrome: A methodological exploration based on literature

BackgroundThe pragmatism levels of randomized controlled trials (RCTs) mean how similar the interventions delivered in the trial setting match those in the setting where the results will be applied. We aimed to investigate the association between the consistency of pragmatism among the characteristics of RCT design and its effect size of results in Chinese herbal medicine (CHM) for irritable bowel syndrome (IBS). MethodsEight English and Chinese language databases were searched for RCTs on CHM for IBS. Six reviewers independently assessed the pragmatism of trials using the pragmatic-explanatory continuum indicator summary 2 (PRECIS-2) tool. The consistency of pragmatism levels among the characteristics of RCT design was calculated using the coefficient of variation. Linear regression models were adopted to explore influence factors of the pragmatism of RCTs. Results78 RCTs were included. The level of consistency in the pragmatism for RCT's design was significantly correlated with the effect size of the results (binary outcome, r = -0.413; P = 0.005; continuous outcome, r = -0.779, P < 0.001). PRECIS-2 score was higher in trials with individualized interventions than fixed interventions (3.29 [0.32] vs 2.90 [0.32]; Cohen's d relative effect size, 0.52; P < 0.001) and in standard or usual-treatment-controlled trials than placebo-controlled (3.05 [0.37] vs 2.83 [0.28]; Cohen's d relative effect size, 0.32; P = 0.048). ConclusionThe consistency of pragmatism level across the 9 domains of the PRECIS-2 tool in CHM IBS RCTs was positively correlated with the effect size of the results.

PRECIS-2 analysis of pragmatic acupuncture trials: a systematic review

BackgroundPragmatic acupuncture trials (PATs) are a research tool for assessing the effectiveness of acupuncture treatments in a real-world setting. This study aimed to provide a comprehensive methodological analysis of PATs using the PRECIS-2(PRagmatic Explanatory Continuum Indicator Summary-2) tool to determine their pragmatism.MethodsThe MEDLINE, EMBASE, Cochrane Central Register for Controlled Trials, CINAHL, Allied and Complementary Medicine Database, China National Knowledge Infrastructure, VIP, WANFANG, Taiwan Periodical Literature Database, KoreaMed, KMbase, Research Information Service System, Oriental Medicine Advanced Searching Integrated System, CiNii and ClinicalTrials.gov were searched. The search included randomised controlled trials (RCTs) and protocols of RCTs that investigated all types of acupuncture and used self-declared pragmatic design. Two authors independently collected the basic information and characteristics of the studies and assessed their pragmatism using the nine PRECIS-2 domains and the additional domain of control.ResultsA total of 93 studies were included. The means of eligibility, recruitment, organisation, primary outcome, primary analysis, and control domains were statistically larger than three and were shown to be pragmatic. The means of setting, flexibility:delivery, and follow-up domains were not greater than three and were shown to be non-pragmatic. For flexibility:adherence domain was inappropriate for assessment owing to insufficient information in the studies.ConclusionsPATs were pragmatic in the domain of eligibility, recruitment, organisation, primary outcome, primary analysis, and control and were not pragmatic in the domain of setting, flexibility:delivery, and follow-up. Future PATs need to strengthen the pragmatism in the setting, flexibility:delivery, and follow-up domains and to describe the flexibility:adherence domain in more detail.Trial registrationCRD42021236975.

The need for more pragmatic trials in glaucoma research.

There have been a number of clinical trials in glaucoma research published in the past two decades. Most of these trials were designed to evaluate very specific issues in selected populations placing them in the explanatory end of the pragmatic-explanatory continuum. The purpose of this study was to assess the level of pragmatism of published randomized controlled trials in glaucoma. A PubMed search using 'glaucoma' from 1995 to 2022 and randomized controlled trial (RCT) article type was done. Each study was assessed by three independent examiners using the Pragmatic-Explanatory Continuum Indicator Summary version 2 (PRECIS-2) toolkit. Scores were calculated for each study to determine the level of pragmatism. A summed score ≥36 was indicative of a very pragmatic study. Thirty-two different articles were included in the analysis. These papers represented 13 different landmark trials. The median PRECIS-2 score was 32 (range, 25 for the Early Manifest Glaucoma Trial (EMGT) to 34 to the Collaborative Normal Tension Glaucoma Study (CNTGS) and the Ocular Hypertension Treatment Study). The Treatment of Advanced Glaucoma Study (TAGS), was considered very pragmatic and scored 33 points. Despite the number of RCTs in glaucoma, there is still a need for more pragmatic studies.

Vaccine communication training using the Brief Motivational Interviewing for Maternal Immunization intervention: A PRISM implementation evaluation.

Improving clinician-patient communication can increase uptake of recommended vaccinations during pregnancy. To evaluate adaptations to and pragmatism of the brief Motivational Interviewing for Maternal Immunizations (MI4MI) intervention and to use the Practical Robust Implementation and Sustainability Model (PRISM) to describe context and implementation outcomes among clinician and staff participants. We incorporated data from study team members, clinicians and staff participants, pregnant patients at participating clinics, and patient medical records. Quantitative and qualitative data were collected using surveys, chart reviews, study team notes, interviews, and focus groups. Adaptations were evaluated using the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and pragmatism was measured with PRagmatic Explanatory Continuum Indicator Summary (PRECIS-2). MI4MI was effective at improving participants' vaccine communication experiences. Adoption was limited by our recruitment approach. MI4MI implementation was shaped by contextual factors and associated adaptations related to the COVID pandemic and clinic and participant characteristics. Virtual asynchronous intervention delivery had mixed effects on adoption and implementation that varied across clinics and participants. Participants expressed interest in maintaining the MI4MI intervention moving forward; however, identification of sustainability infrastructure was limited. MI4MI was evaluated to be relatively pragmatic. Contextual factors strongly shaped implementation of MI4MI. Future iterations of MI4MI should include training delivery modes and incentives that accommodate a range of participants across job roles and organizational settings. Future studies including control clinics are needed to measure effectiveness for increasing vaccination and comparing virtual versus hybrid implementation strategies.

Use of pragmatic randomized trials in multiple sclerosis: A systematic overview.

Pragmatic trials are increasingly recognized for providing real-world evidence on treatment choices. The objective of this study is to investigate the use and characteristics of pragmatic trials in multiple sclerosis (MS). Systematic literature search and analysis of pragmatic trials on any intervention published up to 2022. The assessment of pragmatism with PRECIS-2 (PRagmatic Explanatory Continuum Indicator Summary-2) is performed. We identified 48 pragmatic trials published 1967-2022 that included a median of 82 participants (interquartile range (IQR) = 42-160) to assess typically supportive care interventions (n = 41; 85%). Only seven trials assessed drugs (15%). Only three trials (6%) included >500 participants. Trials were mostly from the United Kingdom (n = 18; 38%), Italy (n = 6; 13%), the United States and Denmark (each n = 5; 10%). Primary outcomes were diverse, for example, quality-of-life, physical functioning, or disease activity. Only 1 trial (2%) used routinely collected data for outcome ascertainment. No trial was very pragmatic in all design aspects, but 14 trials (29%) were widely pragmatic (i.e. PRECIS-2 score ⩾ 4/5 in all domains). Only few and mostly small pragmatic trials exist in MS which rarely assess drugs. Despite the widely available routine data infrastructures, very few trials utilize them. There is an urgent need to leverage the potential of this pioneering study design to provide useful randomized real-world evidence.

The Case for Conducting Pragmatic Dementia Care Trials in Medicaid Home and Community-Based Service Settings

Medicaid-funded home and community-based services (HCBSs) reach large numbers of individuals living with dementia who would otherwise reside in nursing homes with Medicaid funding. Medicaid HCBSs also often augment care provided by family and other informal caregivers to individuals living with dementia. Although Medicaid-funded HCBSs are offered in most states in lieu of nursing home care, they have been largely overlooked as health care system partners for implementation and testing of evidence-based dementia care interventions using embedded pragmatic clinical trial (ePCT) designs. In this article, we make the case for the importance of Medicaid-funded HCBSs as dementia care ePCT partners because of the volume of vulnerable clients with dementia served and the potential positive impacts that evidence-based dementia care programs can have on clients and their informal caregivers. This article first characterizes the Medicaid HCBS setting in terms of populations served and organizational arrangements across states. We then characterize strengths and potential limitations presented by Medicaid HCBSs as settings within which to implement dementia care ePCTs, using as a conceptual framework the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS-2) tool and its domains. We draw on our experiences implementing the Care of Persons with Dementia in their Environments (COPE) program in a statewide Medicaid HCBS setting to highlight how these potential ePCT partners can help optimize pragmatic approaches to several PRECIS-2 domains. We found that partners are especially effective in implementing pragmatic ways to determine eligibility for evidence-based dementia care programs; assist with recruitment of eligible individuals; incorporate dementia care interventions into the range of existing HCBSs; and track outcomes relevant to persons living with dementia, caregivers, HCBS providers, and Medicaid insurance stakeholders. We conclude with recommendations for researchers, potential ePCT partners, and policymakers to help facilitate the growth of dementia care ePCTs in Medicaid HCBS settings across the United States.

Meta-research on pragmatism of randomized trials: rationale and design of the PragMeta database

BackgroundPragmatic trials provide decision-oriented, real-world evidence that is highly applicable and generalizable. The interest in real-world evidence is fueled by the assumption that effects in the “real-world” are different to effects obtained under artificial, controlled, research conditions as often used for traditional explanatory trials. However, it is unknown which features of pragmatism, generalizability, and applicability would be responsible for such differences. There is a need to provide empirical evidence and promote meta-research to answer these fundamental questions on the pragmatism of randomized trials and real-world evidence. Here, we describe the rationale and design of the PragMeta database which pursues this goal (www.PragMeta.org).MethodsPragMeta is a non-commercial, open data platform and infrastructure to facilitate research on pragmatic trials. It collects and shares data from published randomized trials that either have a specific design feature or other characteristic related to pragmatism or they form clusters of trials addressing the same research question but having different aspects of pragmatism. This lays the foundation to determine the relationship of various features of pragmatism, generalizability, and applicability with intervention effects or other trial characteristics.The database contains trial data actively collected for PragMeta but also allows to import and link existing datasets of trials collected for other purposes, forming a large-scale meta-database. PragMeta captures data on (1) trial and design characteristics (e.g., sample size, population, intervention/comparison, outcome, longitudinal structure, blinding), (2) effects estimates, and (3) various determinants of pragmatism (e.g., the use of routinely collected data) and ratings from established tools used to determine pragmatism (e.g., the PRagmatic–Explanatory Continuum Indicator Summary 2; PRECIS-2).PragMeta is continuously provided online, inviting the meta-research community to collaborate, contribute, and/or use the database. As of April 2023, PragMeta contains data from > 700 trials, mostly with assessments on pragmatism.ConclusionsPragMeta will inform a better understanding of pragmatism and the generation and interpretation of real-world evidence.

Assessing the Pragmatic Nature of Mobile Health Interventions Promoting Physical Activity: Systematic Review and Meta-analysis

Mobile health (mHealth) apps can promote physical activity; however, the pragmatic nature (ie, how well research translates into real-world settings) of these studies is unknown. The impact of study design choices, for example, intervention duration, on intervention effect sizes is also understudied. This review and meta-analysis aims to describe the pragmatic nature of recent mHealth interventions for promoting physical activity and examine the associations between study effect size and pragmatic study design choices. The PubMed, Scopus, Web of Science, and PsycINFO databases were searched until April 2020. Studies were eligible if they incorporated apps as the primary intervention, were conducted in health promotion or preventive care settings, included a device-based physical activity outcome, and used randomized study designs. Studies were assessed using the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) and Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) frameworks. Study effect sizes were summarized using random effect models, and meta-regression was used to examine treatment effect heterogeneity by study characteristics. Overall, 3555 participants were included across 22 interventions, with sample sizes ranging from 27 to 833 (mean 161.6, SD 193.9, median 93) participants. The study populations' mean age ranged from 10.6 to 61.5 (mean 39.6, SD 6.5) years, and the proportion of males included across all studies was 42.8% (1521/3555). Additionally, intervention lengths varied from 2 weeks to 6 months (mean 60.9, SD 34.9 days). The primary app- or device-based physical activity outcome differed among interventions: most interventions (17/22, 77%) used activity monitors or fitness trackers, whereas the rest (5/22, 23%) used app-based accelerometry measures. Data reporting across the RE-AIM framework was low (5.64/31, 18%) and varied within specific dimensions (Reach=44%; Effectiveness=52%; Adoption=3%; Implementation=10%; Maintenance=12.4%). PRECIS-2 results indicated that most study designs (14/22, 63%) were equally explanatory and pragmatic, with an overall PRECIS-2 score across all interventions of 2.93/5 (SD 0.54). The most pragmatic dimension was flexibility (adherence), with an average score of 3.73 (SD 0.92), whereas follow-up, organization, and flexibility (delivery) appeared more explanatory with means of 2.18 (SD 0.75), 2.36 (SD 1.07), and 2.41 (SD 0.72), respectively. An overall positive treatment effect was observed (Cohen d=0.29, 95% CI 0.13-0.46). Meta-regression analyses revealed that more pragmatic studies (-0.81, 95% CI -1.36 to -0.25) were associated with smaller increases in physical activity. Treatment effect sizes were homogenous across study duration, participants' age and gender, and RE-AIM scores. App-based mHealth physical activity studies continue to underreport several key study characteristics and have limited pragmatic use and generalizability. In addition, more pragmatic interventions observe smaller treatment effects, whereas study duration appears to be unrelated to the effect size. Future app-based studies should more comprehensively report real-world applicability, and more pragmatic approaches are needed for maximal population health impacts. PROSPERO CRD42020169102; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=169102.

Study design and baseline profile for adults with type 2 diabetes in the once-weekly subcutaneous SEmaglutide randomized PRAgmatic (SEPRA) trial

IntroductionOnce-weekly subcutaneous semaglutide, a glucagon-like peptide-1 analog, is approved in the USA as an adjunct to diet and exercise for adults with inadequately controlled type 2 diabetes (T2D) to improve...

Integrating pragmatic and implementation science randomized clinical trial approaches: a PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) analysis

BackgroundOver the past two decades, pragmatic and implementation science clinical trial research methods have advanced substantially. Pragmatic and implementation studies have natural areas of overlap, particularly relating to the goal of using clinical trial data to leverage health care system policy changes. Few investigations have addressed pragmatic and implementation science randomized trial methods development while also considering policy impact.MethodsThe investigation used the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) and PRECIS-2-Provider Strategies (PRECIS-2-PS) tools to evaluate the design of two multisite randomized clinical trials that targeted patient-level effectiveness outcomes, provider-level practice changes and health care system policy. Seven raters received PRECIS-2 training and applied the tools in the coding of the two trials. Descriptive statistics were produced for both trials, and PRECIS-2 wheel diagrams were constructed. Interrater agreement was assessed with the Intraclass Correlation (ICC) and Kappa statistics. The Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) qualitative approach was applied to understanding integrative themes derived from the PRECIS-2 ratings and an end-of-study policy summit.ResultsThe ICCs for the composite ratings across the patient and provider-focused PRECIS-2 domains ranged from 0.77 to 0.87, and the Kappa values ranged from 0.25 to 0.37, reflecting overall fair-to-good interrater agreement for both trials. All four PRECIS-2 wheels were rated more pragmatic than explanatory, with composite mean and median scores ≥ 4. Across trials, the primary intent-to-treat analysis domain was consistently rated most pragmatic (mean = 5.0, SD = 0), while the follow-up/data collection domain was rated most explanatory (mean range = 3.14–3.43, SD range = 0.49–0.69). RAPICE field notes identified themes related to potential PRECIS-2 training improvements, as well as policy themes related to using trial data to inform US trauma care system practice change; the policy themes were not captured by the PRECIS-2 ratings.ConclusionsThe investigation documents that the PRECIS-2 and PRECIS-2-PS can be simultaneously used to feasibly and reliably characterize clinical trials with patient and provider-level targets. The integration of pragmatic and implementation science clinical trial research methods can be furthered by using common metrics such as the PRECIS-2 and PRECIS-2-PS. Future study could focus on clinical trial policy research methods development.Trial registrationDO-SBIS ClinicalTrials.gov NCT00607620. registered on January 29, 2008. TSOS ClinicalTrials.gov NCT02655354, registered on July 27, 2015.

Intervention Fidelity in Pain Pragmatic Trials for Nonpharmacologic Pain Management: Nuanced Considerations for Determining PRECIS-2 Flexibility in Delivery and Adherence

Nonpharmacological treatments are considered first-line pain management strategies, but they remain clinically underused. For years, pain-focused pragmatic clinical trials (PCTs) have generated evidence for the enhanced use of nonpharmacological interventions in routine clinical settings to help overcome implementation barriers. The Pragmatic Explanatory Continuum Indicator Summary (PRECIS-2) framework describes the degree of pragmatism across 9 key domains. Among these, “flexibility in delivery” and “flexibility in adherence,” address a key goal of pragmatic research by tailoring approaches to settings in which people receive routine care. However, to maintain scientific and ethical rigor, PCTs must ensure that flexibility features do not compromise delivery of interventions as designed, such that the results are ethically and scientifically sound. Key principles of achieving this balance include clear definitions of intervention core components, intervention monitoring and documentation that is sufficient but not overly burdensome, provider training that meets the demands of delivering an intervention in real-world settings, and use of an ethical lens to recognize and avoid potential trial futility when necessary and appropriate. PerspectiveThis article presents nuances to be considered when applying the PRECIS-2 framework to describe pragmatic clinical trials. Trials must ensure that patient-centered treatment flexibility does not compromise delivery of interventions as designed, such that measurement and analysis of treatment effects is reliable.

Implementation of e-Mental Health Interventions for Informal Caregivers of Adults With Chronic Diseases: Mixed Methods Systematic Review With a Qualitative Comparative Analysis and Thematic Synthesis.

Informal caregivers commonly experience mental health difficulties related to their caregiving role. e-Mental health interventions provide mental health support in a format that may be more accessible to informal caregivers. However, e-mental health interventions are seldom implemented in real-world practice. This mixed methods systematic review aimed to examine factors associated with the effectiveness and implementation of e-mental health interventions for informal caregivers of adults with chronic diseases. To achieve this aim, two approaches were adopted: combinations of implementation and intervention characteristics sufficient for intervention effectiveness were explored using qualitative comparative analysis, and barriers to and facilitators of implementation of e-mental health interventions for informal caregivers were explored using thematic synthesis. We identified relevant studies published from January 1, 2007, to July 6, 2022, by systematically searching 6 electronic databases and various secondary search strategies. Included studies reported on the effectiveness or implementation of e-mental health interventions for informal caregivers of adults with cancer, chronic obstructive pulmonary disease, dementia, diabetes, heart disease, or stroke. Randomized controlled trials reporting on caregivers' mental health outcomes were included in a crisp-set qualitative comparative analysis. We assessed randomized controlled trials for bias using the Risk of Bias 2.0 tool, and we assessed how pragmatic or explanatory their trial design was using the Pragmatic Explanatory Continuum Indicator Summary 2 tool. Studies of any design reporting on implementation were included in a thematic synthesis using the Consolidated Framework for Implementation Research to identify barriers to and facilitators of implementation. Overall, 53 reports, representing 29 interventions, were included in the review. Most interventions (27/29, 93%) focused on informal cancer or dementia caregivers. In total, 14 reports were included in the qualitative comparative analysis, exploring conditions including the presence of peer or professional support and key persuasive design features. Low consistency and coverage prevented the determination of condition sets sufficient for intervention effectiveness. Overall, 44 reports were included in the thematic synthesis, and 152 barriers and facilitators were identified, with the majority related to the intervention and individual characteristic domains of the Consolidated Framework for Implementation Research. Implementation barriers and facilitators in the inner setting (eg, organizational culture) and outer setting (eg, external policies and resources) domains were largely unexplored. e-Mental health interventions for informal caregivers tend to be well-designed, with several barriers to and facilitators of implementation identified related to the intervention and individual user characteristics. Future work should focus on exploring the views of stakeholders involved in implementation to determine barriers to and facilitators of implementing e-mental health interventions for informal caregivers, focusing on inner and outer setting barriers and facilitators. PROSPERO (International Prospective Register of Systematic Reviews) CRD42020155727; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42020155727. RR2-10.1136/bmjopen-2019-035406.

How pragmatic are randomized trials of remdesivir and favipiravir for in-hospital treatment of COVID-19: a descriptive methodological review of trial design using the PRECIS-2 framework

ObjectivesTo review the pragmatism of published randomized trials of remdesivir and favipiravir based on the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS-2) framework. Study Design and SettingTen eligible trials were identified from an existing comprehensive living review and were evaluated across the nine PRECIS-2 domains by two independent reviewers. ResultsAll 10 trials had mostly pragmatic design characteristics. Four of the domains (i.e., recruitment, setting, organization, and primary analysis) were found to be pragmatic with most trials scoring four or five across the two interventions. In comparison scores for four other design domains (i.e., eligibility, follow-up, flexibility of delivery, and primary outcome) varied across the trials with some design choices being more explanatory. ConclusionIn our descriptive review of randomized controlled trails for two drugs for patients infected with COVID-19 early in the pandemic, we found that most trials had more pragmatic than explanatory characteristics. Some design choices for some of the trials, however, were not consistent with the urgent goal of informing clinical decision making in an epidemic. PRECIS-2 should be used as a guide by trialists, to help them match their trial design choices to the intended purpose of their trial.

Primary Decompressive Craniectomy After Traumatic Brain Injury: A Literature Review.

Traumatic brain injuries (TBIs) still put a high burden on public health worldwide. Medical and surgical treatment strategies are continuously being studied, but the role and indications of primary decompressive craniectomy (DC)remain controversial. In medically refractory intracranial hypertension after severe traumatic brain injury, secondary decompressive craniectomy is a last resort treatment option to control intracranial pressure (ICP). Randomized controlled studies have been extensively performed on secondary decompressive craniectomy and its role in the management of severe traumatic brain injuries. Indications, prognostic factors, and long-term outcomes in primary decompressive craniectomy during the evacuation of an epidural, subdural, or intracerebral hematoma in the acute phase are still a matter of ongoing research and controversy to this day. Prospective trials have been designed, but the results are yet to be published. In isolated epidural hematoma without underlying brain injury, osteoplastic craniotomy is likely to be sufficient. In acute subdural hematoma (ASDH) with relevant brain swelling and preoperative CT signs such as effaced cisterns, overly proportional midline-shift compared to a relatively small acute subdural hematoma, and accompanying brain contusions as well as pupillary abnormalities, intraventricular hemorrhage, and coagulation disorder, primary decompressive craniectomy is more likely to be of benefit for patients with traumatic brain injury. The role of intracranial pressure monitoring after primary decompressive craniectomy is recommended, but prospective trials are pending. More refined guidelines and hopefully class I evidence will be established with the ongoing trials: randomized evaluation of surgery with craniectomy for patients undergoing evacuation of acute subdural hematoma (RESCUE-ASDH), prospective randomized evaluation of decompressive ipsilateral craniectomy for traumatic acute epidural hematoma (PREDICT-AEDH), and pragmatic explanatory continuum indicator summary (PRECIS).

Generalizability of randomized controlled trials in primary health care: Applying the PRECIS-2 tool on published protocols.

Pragmatic design may facilitate the generalizability of effectiveness of randomized controlled trials (RCTs) in primary health care (PHC). The aim of this study was to investigate whether published protocols in PHC were designed pragmatically and to explore whether specific trial characteristics may be related to a pragmatic design. Using the Pragmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2), we assessed pragmatism for 123 published RCT protocols. For each domain, we calculated the mean score with the 95% confidence interval (95% CI). Interrater reliability was assessed by weighted κ-coefficient with 95% CI. We examined potential associations of published protocol characteristics with overall pragmatism by performing univariate and multivariate analyses. We observed the highest score for primary analysis (4.66, 95%CI: 4.51, 4.82). The eligibility score was intermediate (3.16, 95%CI: 3.01, 3.32). Domains with scores towards the explanatory side included organization (2.50, 95%CI: 2.36, 2.63), flexibility of delivery (2.74, 95%CI: 2.60, 2.88) and flexibility of adherence (3.00, 95%CI: 2.83, 3.17). Interrater agreement was good (κ = 0.61; 95%CI: 0.34, 0.80; p < 0.001). Higher sample sizes were correlated to a pragmatic design (odds ratio: 6.86, 95%CI: 1.64, 28.75; p = 0.04). Most RCT protocols were rated as intermediate in the pragmatic-explanatory continuum. Future research may guide all stakeholders on how best to incorporate the level of pragmatism in the interpretation of the resultsso that the trials are more likely to be applicable in real-world settings.

Applicability of Vasopressor Trials in Adult Critical Care: A Prospective Multicentre Meta-Epidemiologic Cohort Study.

ObjectiveTo assess the applicability of evidence from landmark randomized controlled trials (RCTs) of vasopressor treatment in critically ill adults.Study Design and SettingThis prospective, multi-center cohort study was conducted at five medical and surgical intensive care units at three tertiary care centers. Consecutive cases of newly initiated vasopressor treatment were included. The primary end point was the proportion of patients (≥18 years) who met the eligibility criteria of 25 RCTs of vasopressor therapy in critically ill adults included in the most recent Cochrane review. Multilevel Poisson regression was used to estimate the eligibility proportions with 95% confidence intervals for each trial. Secondary end points included the eligibility criteria that contributed most to trial ineligibility, and the relationship between eligibility proportions and (i) the Pragmatic-Explanatory Continuum Indicator Summary-2 (PRECIS-2) score, and (ii) the recruitment-to-screening ratio of each RCT. The PRECIS-2 score was used to assess the degree of pragmatism of each trial.ResultsBetween January 1, 2017, and January 1, 2019, a total of 1189 cases of newly initiated vasopressor therapy were included. The median proportion of cases meeting eligibility criteria for all 25 RCTs ranged from 1.3% to 6.0%. The eligibility criteria contributing most to trial ineligibility were the exceedance of a specific norepinephrine dose, the presence of a particular shock type, and the drop below a particular blood pressure value. Eligibility proportions increased with the PRECIS-2 score but not with the recruitment-to-screening ratio of the trials.ConclusionThe applicability of evidence from available trials on vasopressor treatment in critically ill adults to patients receiving vasopressors in daily practice is limited. Applicability increases with the degree of study pragmatism but is not reflected in a high recruitment-to-screening ratio. Our findings may help researchers design vasopressor trials and promote standardized assessment and reporting of the degree of pragmatism achieved.