Measurement-based Care Implementation Research Articles

Determinants of remote measurement-based care uptake in a safety net outpatient psychiatry department as part of learning health system transition.

Behavioral measurement-based care (MBC) can improve patient outcomes and has also been advanced as a critical learning health system (LHS) tool for identifying and mitigating potential disparities in mental health treatment. However, little is known about the uptake of remote behavioral MBC in safety net settings, or possible disparities occurring in remote MBC implementation. This study uses electronic health record data to study variation in completion rates at the clinic and patient level of a remote MBC symptom measure tool during the first 6 months of implementation at three adult outpatient psychiatry clinics in a safety net health system. Provider-reported barriers to MBC adoption were also measured using repeated surveys at one of the three sites. Out of 1219 patients who were sent an MBC measure request, uptake of completing at least one measure varied by clinic: General Adult Clinic, 38% (n = 262 of 696); Substance Use Clinic, 28% (n = 73 of 265); and Transitions Clinic, 17% (n = 44 of 258). Compared with White patients, Black and Portuguese or Brazilian patients had lower uptake. Older patients also had lower uptake. Spanish language of care was associated with much lower uptake at the patient level. Significant patient-level disparities in uptake persisted after adjusting for the clinic, mental health diagnoses, and number of measure requests sent. Providers cited time within visits and bandwidth in their workflow as the greatest consistent barriers to discussing MBC results with patients. There are significant disparities in MBC uptake at the patient and clinic level. From an LHS data infrastructure perspective, safety net health systems may need to address the need for possible ways to adapt MBC to better fit their populations and clinical needs, or identify targeted implementation strategies to close data gaps for the identified disparity populations.

Veteran Experiences With an mHealth App to Support Measurement-Based Mental Health Care: Results From a Mixed Methods Evaluation.

Mental health conditions are highly prevalent among US veterans. The Veterans Health Administration (VHA) is committed to enhancing mental health care through the integration of measurement-based care (MBC) practices, guided by its Collect-Share-Act model. Incorporating the use of remote mobile apps may further support the implementation of MBC for mental health care. This study aims to evaluate veteran experiences with Mental Health Checkup (MHC), a VHA mobile app to support remote MBC for mental health. Our mixed methods sequential explanatory evaluation encompassed mailed surveys with veterans who used MHC and follow-up semistructured interviews with a subset of survey respondents. We analyzed survey data using descriptive statistics. We then compared responses between veterans who indicated having used MHC for ≥3 versus <3 months using χ2 tests. We analyzed interview data using thematic analysis. We received 533 surveys (533/2631, for a 20% response rate) and completed 20 interviews. Findings from these data supported one another and highlighted 4 key themes. (1) The MHC app had positive impacts on care processes for veterans: a majority of MHC users overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed or strongly agreed that using MHC helped them be more engaged in their health and health care (169/262, 65%), make decisions about their treatment (157/262, 60%), and set goals related to their health and health care (156/262, 60%). Similarly, interviewees described that visualizing progress through graphs of their assessment data over time motivated them to continue therapy and increased self-awareness. (2) A majority of respondents overall, and a greater proportion who had used MHC for ≥3 months (versus <3 months), agreed/strongly agreed that using MHC enhanced their communication (112/164, 68% versus 51/98, 52%; P=.009) and rapport (95/164, 58% versus 42/98, 43%; P=.02) with their VHA providers. Likewise, interviewees described how MHC helped focus therapy time and facilitated trust. (3) However, veterans also endorsed some challenges using MHC. Among respondents overall, these included difficulty understanding graphs of their assessment data (102/245, 42%), not receiving enough training on the app (73/259, 28%), and not being able to change responses to assessment questions (72/256, 28%). (4) Interviewees offered suggestions for improving the app (eg, facilitating ease of log-in, offering additional reminder features) and for increasing adoption (eg, marketing the app and its potential advantages for veterans receiving mental health care). Although experiences with the MHC app varied, veterans were positive overall about its use. Veterans described associations between the use of MHC and engagement in their own care, self-management, and interactions with their VHA mental health providers. Findings support the potential of MHC as a technology capable of supporting the VHA's Collect-Share-Act model of MBC.

Lessons Learned from the Implementation of Youth Wellness Hubs Ontario, an Integrated Youth Services Network: Perspectives from Network Leads.

Mental health and substance use services for youth in Canada continue to be fragmented. In response, Integrated Youth Services (IYS) has been proposed to address gaps in youth mental health services that can lead to improved youth outcomes. Youth Wellness Hubs Ontario (YWHO) was launched in 2017 as Ontario's IYS Network for youth ages 12-25, prioritizing continuous improvement through evaluation. At the end of the first three years of the YWHO initiative, an evaluation was carried out to identify the barriers and facilitators to the initial implementation of YWHO and service delivery modifications resulting from the COVID-19 pandemic across ten sites. Reporting on these is the focus of this article. Key informant interviews were conducted in early 2021 with Network Leads from all ten initial YWHO sites. Reflexive thematic analysis was used to analyze all interview data. Facilitators to the implementation of the YWHO model included diversified funding models, YWHO Provincial Office implementation supports, clear hub processes, robust community partnerships, organizational support and dedicated staff. Common barriers included certain challenges related to staffing and finances, implementation of the shared data collection platform, implementation of measurement-based care, partnerships, integrated service delivery, and branding and communications. Implementation of IYS is highly collaborative and quite complex. As interest in such models increase, so does the need for knowledge related to optimal implementation. Learnings have informed developments and improvements made to the YWHO model. Insights will also inform how stakeholders support youth in their communities in designing and implementing services that improve youth mental health and overall well-being.

Implementing Measurement-Based Care in a Youth Partial Hospital Setting: Leveraging Feedback for Sustainability.

This paper describes the successful implementation of Measurement-Based Care (MBC) within a Partial Hospitalization Program (PHP) for children and adolescents. Measurement-based care (MBC), the practice of using patient-reported measures routinely to inform decision-making, is associated with improved clinical outcomes for behavioral health patients (Jong et al., Clinical Psychology Review 85, 2021; Fortney & Sladek, 2015). MBC holds great promise in partial hospital programs (PHP) to improve outcomes, yet implementation strategies are as complex as the setting itself. This paper provides a case study example of MBC implementation in a PHP for youth. Over the course of 18months, an interdisciplinary staff of approximately 20 behavioral health professionals provided partial hospitalization level of care to 633 (39% in-person, 61% telehealth) youth from ages 5 to 18years old. MBC in this setting incorporated daily patient self-report and weekly caregiver-reported measurements. This descriptive reconstruction, which includes examples of the data that were used during the implementation project, illustrates specific barriers and facilitators in a successful implementation in the local PHP setting. Implementation strategies to address workflow integration, leadership and supervision, and coaching are described, including evolution of these strategies over the course of implementation. Practical considerations for implementing MBC in youth PHP settings are discussed. Finally, the authors explore the potential relationships between the data-driven MBC model of decision making and the development of resilient organizations.

Using Measurement-Based Care as a Precision Medicine Strategy for Substance Use Disorders.

Precision medicine prioritizes characterization of individual patient parameters to optimize care and this review evaluates measurement-based care (MBC) as a strategy for doing so in the treatment of substance use disorders (SUD). Measurement-based care refers to the systematic use of validated assessments to inform diagnosis and treatment planning, with varying frequency of assessments. Despite the seemingly obvious grounds for the use of MBC in treating SUD, systematic implementation to date has been limited. Thus, the goal of this review is to evaluate efforts to date and to stimulate greater consideration of MBC models in addictions programs. Data from two published randomized controlled trials and findings from pragmatic clinical research highlight the potential utility of MBC in the SUD treatment settings. Despite these findings, the existing literature indicates the high need for larger-scale clinical trials and quality improvement programs. Potential barriers to the implementation of MBC for SUD are outlined at the patient, provider, organization, and system levels, as well as the challenges associated with the use of MBC programs for clinical research. Critical thinking considerations and risk mitigation strategies are offered toward advancing MBC for SUD beyond the current nascent state. Collectively, the existing data confirm that MBC is a suitable and promising strategy for applying a precision medicine approach in SUD treatment, warranting further implementation efforts and scientific inquiry.

Different factors identified by stakeholder group for barriers and facilitators to measurement-based care implementation in behavioral health clinics.

Despite the benefits of measurement-based care (MBC) in the behavioral health setting, there have been difficulties in implementation and low saturation. Although barriers and facilitators to MBC implementation have been identified, research has generally only included the perspective of one stakeholder group. The current study aims to examine the similarities and differences-by stakeholder group-in the identified barriers to and facilitators of implementing MBC in the behavioral health setting. A purposeful sampling approach was used to recruit and conduct interviews and focus groups with stakeholders (clinicians, clinic leaders, and administrative staff) from four behavioral health clinics at an academic medical center that is part of a larger healthcare system. The data coding process included a directed content analytic approach whereby the coding team used an iterative process to analyze deidentified transcripts starting with a codebook based on the Consolidated Framework for Implementation Research (CFIR) constructs. A total of 31 clinicians, 11 clinic leaders, and 8 administrative staff participated in the interviews and focus groups. There was convergence among all stakeholder regarding which CFIR constructs were identified as barriers and facilitators, but there were differences in the specific thematic factors identified by stakeholders as barriers and facilitators within each of these implementation constructs. The barriers and facilitators that stakeholders identified within each CFIR construct were often connected to their specific role in implementing MBC. Collecting information on barriers and facilitators to MBC implementation from the multiple stakeholders involved in the process may enhance successful implementation of MBC given the variation between groups in identified thematic factors. Administrative staff perspectives, which have not been reported in the literature, may be of particular importance in planning for successful MBC implementation.

Setting the stage for Measurement-Based Care (MBC): Practical Lessons in the Implementation and Integration of MBC within Youth Wellness Hubs Ontario

Problem and Context: Measurement-based care (MBC) involves the systematic administration of standardized measures and the use of results to drive clinical decision-making within a therapeutic relationship framework. It is an integral part of youth-centered care and a core standard of integrated youth mental health services. Despite the wealth of evidence for the benefits of MBC in supporting high quality care, the implementation of MBC into routine mental health care is rarely incorporated.&#x0D; Who is it for? Youth mental health problems are a growing concern in Canada and globally, causing significant distress, impairment, and negative adult outcomes when untreated. Despite evidence-based interventions, only a minority of youth access and receive adequate treatment, with most youth facing barriers to high quality and effective interventions. To address these gaps, integrated youth service (IYS) models are established globally for youth ages 12-25 and emphasize timely access, youth friendliness, and holistic care, integrate mental and physical health, substance use, education, employment, peer support, and navigation into ‘one-stop shops’. Youth Wellness Hubs Ontario (YWHO) is Ontario’s IYS network with 22 integrated service networks in more than 30 communities across the province. MBC is a core component of the YWHO model and is implemented in 22 sites.&#x0D; Who did you involve and engage with? A fundamental contribution of YWHO is the inclusion of meaningful youth and family engagement processes in service design, delivery, and evaluation. YWHO has youth and family advisory councils both at the provincial and local levels who contribute to planning and operations, including service planning, governance, training, evaluation, communications, and funding-related decision-making.&#x0D; What did you do? This presentation will present the strategies, challenges, solutions, and subsequent adaptations we used to implement MBC within integrated youth services. We will describe the lessons we learned as we confronted practical obstacles around implementing MBC into integrated care pathways.&#x0D; What results did you get? MBC lessons learned included: 1. Leadership, service provider, and youth engagement in MBC; selection of measures and when to use measures, integrated data platform and electronic health records, addressing data quality issues early on, preparing for a demanding process of change, establishing support and coaching mechanisms, adapting MBC to a virtual environment, and adapting MBC in non-dominant cultural contexts.&#x0D; &#x0D; What is the learning for the international audience? MBC has been shown to improve the quality of care and clinical outcomes but it also requires substantial commitment, time, resources, and change management that can make it difficult to implement well in integrated care settings. Despite these challenges, we provide some creative solutions and adaptations within our model of youth-centered care that will inform audiences of how to effectively use MBC to personalize care, and how best to use MBC to engage service providers and youth in monitoring and management of symptoms. &#x0D; What are the next steps? Future directions include continuous learning and evaluation of the implementation of MBC in integrated care settings and identifying the factors for successful implementation.

Implementing Measurement-Based Care (MBC) for Mental Health in a Paediatric Hospital Setting

Introduction: Measurement-Based Care (MBC) is the routine, systematic use of validated measures (e.g., patient-reported outcome measures [PROMs]) before or during clinical encounters to inform treatment decision-making. A large body of evidence, including randomized controlled trials, suggest that MBC outperforms usual care in response to treatment, remission rates, time to response and remission for individuals with depression, anxiety and other mental health conditions. MBC is a standard of care for most chronic conditions (e.g., diabetes, hypertension, asthma), however, it is underutilized in pediatric mental healthcare, despite well documented benefits and feasibility. As part of the hospital’s broader mandate to better integrate physical and mental healthcare, the MBC implementation team set out to develop an MBC system for evaluation of mental health concerns across the hospital with the goal to facilitate monitoring and response of mental health metrics at the patient, provider, organizational, and system levels.&#x0D; Methods: An environmental scan was conducted to understand the priority areas for health systems’ improvement. Stakeholders engaged in the process were physician leaders, clinical operational directors, clinical staff, Youth and Family Advisory Panel members across hospital departments. The environmental scan and follow-up focus groups (n=57) highlighted the need to prioritize implementation of standardized mental assessment tools hospital-wide for patients at each health system encounter as part of a vision to deliver holistic, integrated care and improve quality of patient care. Early identification of mental health needs of patients across the hospital and the importance of establishing standardized metrics for common mental health conditions were additional key priorities. Hospital surveys highlighted anxiety and depression as the top mental health concerns across the hospital. An extensive review was conducted to identify validated tools available and to understand implementation best practices.&#x0D; Learnings: Learnings from our review pointed to some key factors for successful implementation. These included the need for tools that are brief and easy to use, are validated and sensitive to change, are user friendly and visually appealing for the pediatric population and are integrated into the electronic health record with appropriate decision support tools to enable real time review. The need for extensive patient and provider education about the value of MBC and its implementation was also a key learning.&#x0D; &#x0D; Work in progress &amp; next steps: Work is underway to map out clinical workflows, including ensuring a timely response to results, addressing implementation challenges such as virtual vs. in-person tool completion, and managing accessibility of sensitive data to the patient or their proxy in the electronic health record. Workflows will take an integrated, holistic care approach, whereby, a patient’s care team will action appropriate interventions based on a standardized algorithm that engages an interdisciplinary care team. Voxe, an external, patient-friendly platform to administer the two chosen assessment tools will be trialed. Discussions are underway with Information Management and Technology teams to integrate Voxe and clinical workflows in the hospital’s electronic health record. Evaluation of implementation of MBC in clinical settings will consider both process and outcome measures such as uptake, timely receipt of services, and clinical response.

Consultation as an Implementation Strategy to Increase Fidelity of Measurement-Based Care Delivery in Community Mental Health Settings: An Observational Study.

Regularly administering outcome measures to clients to inform clinical decision making, referred to as measurement-based care (MBC), has the potential to improve mental health treatment due to its applicability across disorders and treatment settings. Given the utility of MBC, understanding predictors of high-fidelity MBC implementation is important. Training and consultation are widely used implementation strategies to increase the fidelity of evidence-based practice delivery but have rarely been studied with MBC. The current study will examine the relationship between time clinicians spent discussing a casein consultation ("dosage") and MBC fidelity. Thirty clinicians and 56 youth were in the MBC condition of a randomized controlled trial and completed baseline questionnaires. Consultation dosage was extracted from call notes. MBC fidelity was measured using the implementation index, which combines rates of administering and viewing questionnaires, using objective data from the online MBC system. Multi-level modeling was used. Greater consultation dosage significantly predicted a higher implementation index (ß = 0.27, SE = 0.06, p < .001). For every 30min spent discussing a case in consultation, the case's MBC fidelity increased by 8.1%. Greater consultation dosage significantly predicted higher rates of administration (ß = 0.07, SE = 0.03, p = 0.033) and feedback report viewing (ß = 0.24, SE = 0.06, p < .001). More consultation at the case level predicts greater MBC fidelity using objective measures. The greatest impact was increasing the clinician feedback report viewing rate. The results of this study can help inform future efforts to increase the fidelity with which MBC is delivered and to make consultation as efficient and effective as possible.

Study protocol: Novel Methods for Implementing Measurement-Based Care with youth in Low-Resource Environments (NIMBLE)

BackgroundFor youth receiving care in community mental health centers, comorbidities are the rule rather than the exception. Using measurement-based care (MBC), or the routine evaluation of symptoms to inform care decisions, as the foundation of treatment for youth with comorbid problems significantly improves the impact of psychotherapy by focusing care and building engagement and alliance. MBC increases the rate of symptom improvement, detects clients who would otherwise deteriorate, and alerts clinicians to non-responders. Despite its demonstrated utility, MBC is rarely implemented with fidelity; less than 15% of providers report using MBC per recommendations. Previous efforts to support MBC implementation have yielded suboptimal outcomes, in part, due to organizations’ challenges with identifying and prioritizing barriers and selecting and developing strategies to overcome them. New methods are needed for identifying and prioritizing barriers, and matching strategies to barriers to optimize MBC implementation and treatment quality to improve youth mental health outcomes in community settings.MethodsPragmatic implementation methods will be piloted in four diverse community mental health centers. Methods include (a) rapid evidence synthesis; (b) rapid ethnography; (c) design kits (e.g., kits with disposable cameras, journals, maps); (d) barrier prioritization, and (e) causal pathway diagramming. These activities will generate actionable barriers; subsequently, we will use facilitated group processes to prioritize barriers and develop causal pathway diagrams to match strategies to barriers to create implementation plans that optimize MBC fidelity (Aim 1). We will track strategy deployment for 6 months, then compare MBC fidelity for another 6 months post-implementation with data from 2 years of historical controls (Aim 2). Finally, we will co-design a toolkit for design kit methods with youth and the practice and scientific communities (Aim 3).DiscussionOptimizing MBC implementation in community mental health centers could transform youth mental health care by ensuring the most pressing symptoms are targeted early in treatment. The discussion section highlights expected challenges and limits to using the five methods, including recruitment and engagement given the high pressure on community mental health settings.Trial registrationClinicaltrials.gov. NCT05644756. Registered on 18 November 2022. This trial was retrospectively registered.

Using a Quality Improvement Approach to Implement Measurement-Based Care (MBC) in Outpatient General Psychiatry.

Measurement-based care (MBC) is the clinical practice of using patient-reported symptom measurement to inform treatment decisions. MBC has been shown to improve patient outcomes and quality of care in outpatient psychiatry. Despite these benefits, MBC is not routinely used in most psychiatric outpatient settings. This quality improvement (QI) project aimed to achieve 75% completion of symptom scales using an online MBC platform in a general psychiatry clinic in Toronto, Canada, by June 2022. The QI team used the Model for Improvement methodology. The main outcome measure was completion of symptom scales using an online MBC platform. Process measures included counts of invitations to join the MBC platform, counts of online MBC account creation, and counts of symptom scale assignment by clinicians. Balancing measures included administrative task completion and physician workload assessment. Stakeholder interviews explored barriers and facilitators to MBC utilization. Completion of symptom scales increased from 7/65 (10.8%) preintervention to 40/70 (57.1%) during the 26-week intervention. Clinician reminders and coaching clinicians about how to incorporate MBC into the care process facilitated uptake of MBC. Stakeholders identified several barriers to implementation, particularly physician attitudes toward MBC and perceived administrative burden. Completion of symptom scales increased over the course of this QI initiative. Successful implementation of MBC in general psychiatry outpatient settings requires the availability of a broad range of measurement scales given the diversity of mental health diagnoses. Implementation must also consider health equity, including access to technology and availability of symptom scales in multiple languages.

The Impact of Measurement-Based Care in Psychiatry: An Integrative Review.

The quality of mental health treatment has not progressed to the same extent as physical health treatment. Suboptimal mental health outcomes may be attributed to the lack of a systematic approach to tracking and measuring patient progress. In psychiatry, Measurement-Based Care (MBC) offers an objective, systematic approach to monitor clinical progress, evaluate treatment efficacy, and inform clinical decisions, yet remains seldom used in daily practice. To identify the clinical impact of using MBC in psychiatry. Using the Johns Hopkins Nursing Evidence-Based Practice Model as a guideline, this integrative review focused on the research query, "What is the clinical impact of Measurement-Based Care when treating patients with mental illness?" A total of nine articles met the inclusion criteria for this integrative review. The articles ranged from 2008 to 2021. The following themes were identified from the analysis of these articles: (1) the clinical impact of MBC, (2) provider attitudes about MBC, and (3) barriers to MBC implementation. MBC, augmenting usual standard care, provides an objective, systematic approach using quantifiable data to monitor symptom severity and treatment effectiveness. This review highlights the clinical benefits of MBC, including increased remission rates, lower risk of relapse, improved medication adherence, and strengthening the therapeutic alliance. Although this review provides an overview of the benefits of MBC in psychiatry, there remains a substantial practice gap warranting further investigation. Strategies must be developed to address barriers at the individual and organizational levels which impede the successful adoption of MBC.

The time is now to start evaluating biomarkers in the clinic.

The time is now to start evaluating biomarkers in the clinic.

The results of clinician-focused implementation strategies on uptake and outcomes of Measurement-Based Care (MBC) in general mental health care

BackgroundMeasurement-Based Care (MBC) is the routine administration of measures, clinicians’ review of the feedback and discussion of the feedback with their clients, and collaborative evaluation of the treatment plan. Although MBC is a promising way to improve outcomes in clinical practice, the implementation of MBC faces many barriers, and its uptake by clinicians is low. The purpose of this study was to investigate whether implementation strategies that were developed with clinicians and aimed at clinicians had an effect on (a) clinicians’ uptake of MBC and (b) clients’ outcomes of MBC.MethodsWe used an effectiveness-implementation hybrid design based on Grol and Wensing’s implementation framework to assess the impact of clinician-focused implementation strategies on both clinicians’ uptake of MBC and outcomes obtained with MBC for clients in general mental health care. We hereby focused on the first and second parts of MBC, i.e., the administration of measures and use of feedback. Primary outcome measures were questionnaire completion rate and discussion of the feedback with clients. Secondary outcomes were treatment outcome, treatment length, and satisfaction with treatment.ResultsThere was a significant effect of the MBC implementation strategies on questionnaire completion rate (one part of clinicians’ uptake), but no significant effect on the amount of discussion of the feedback (the other part of clinicians’ uptake). Neither was there a significant effect on clients’ outcomes (treatment outcome, treatment length, and satisfaction with treatment). Due to various study limitations, the results should be viewed as exploratory.ConclusionsEstablishing and sustaining MBC in real-world general mental health care is complex. This study helps to disentangle the effects of MBC implementation strategies on differential clinician uptake, but the effects of MBC implementation strategies on client outcomes need further examination.

The need for a measurement-based care professional practice guideline.

Professional practice guidelines (PPGs) are intended to promote a high level of professional practice and serve as an educational resource, providing pragmatic guidance in a clinical area for psychologists. Measurement-based care (MBC) is an evidence-based psychological practice with accumulating empirical support and alignment with patient-centered care. In connection with the American Psychological Association's Advisory Committee for Measurement-based Care and the Mental and Behavioral Health Registry, this article outlines various lines of support for the development and implementation of an MBC PPG. In addition to research evidence, we address the demonstrated need of this guideline across three domains: public benefit, professional guidance, and legal and regulatory issues. Consistent with the aspirational spirit of a PPG, this article proposes a draft PPG statement and highlights how an MBC PPG would improve service delivery, facilitate implementation of an evidence-based practice associated with symptom reduction, improved retention, and greater patient satisfaction, as well as create a framework that will better align changes in reimbursement models with patients' and providers' treatment goals. We also identify key future directions and critical gaps in MBC science and implementation that require attention. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Measurement-based care professional practice guideline: Don’t forget the therapists!

Boswell et al. (2022) professional practice guideline builds an excellent, evidence-driven argument in favor of the routine implementation of measurement-based care (MBC). Nonetheless, as learned from the attempted implementation of evidence-based psychotherapies, presenting empirical evidence does not affect therapist behavior. As such, we argue for an actionable and practical professional practice guideline. We review some of the most hindering barriers to the implementation of MBC, and we offer guidance introducing some of the efforts needed to overcome them. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Enhancing Implementation of Measurement-Based Mental Health Care in Primary Care: A Mixed-Methods Study.

The complex practice of measurement-based care (MBC) for mental health conditions has proven challenging to implement. This study aimed to evaluate an intensive strategy to implement MBC in U.S. Department of Veterans Affairs (VA) Primary Care Mental Health Integration clinics. Ten paired sites were randomly assigned to receive national MBC resources alone or with an intensive implementation strategy (external facilitation plus quality improvement teams) between May 2018 and June 2020. The intervention occurred over 12-18 months; two site pairs completed participation before the COVID-19 pandemic. Using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework, the authors conducted qualitative interviews and used administrative data to evaluate the implementation, adoption, reach, and effectiveness of MBC. All sites improved during the study, suggesting the effectiveness of the VA's national MBC initiative. Sites with facilitation improved more than comparison sites in implementation, adoption, and reach of MBC. The effectiveness of MBC (i.e., clinician responsiveness to high patient-reported outcome measure [PROM] scores) was demonstrated at all sites both before and after facilitation. After the COVID-19 pandemic began, facilitation sites maintained or improved on their implementation gains, whereas comparison sites uniformly reported decreased emphasis on MBC. Implementation facilitation resulted in greater gains in outcomes of interest and helped sites retain focus on MBC implementation. Regardless of study condition, clinicians were responsive to elevated PROM scores, but MBC had a larger impact on care at facilitation sites because of increased uptake. Multiple technological and contextual challenges remain, but MBC holds promise for improving routine mental health care.

Taking a Magnifying Glass to Measurement-Based Care Consultation Sessions: with What Issues Do Mental Health Clinicians Struggle?

Ongoing consultation following initial training is one of the most commonly deployed implementation strategies to facilitate uptake of evidence-based practices, such as measurement-based care (MBC). Group consultation provides an interactive experience with an expert and colleagues to get feedback on actual issues faced, yet there is little research that unpacks the questions raised in consultation and what types of issues are important to address. The current study characterized the questions and concerns raised by community mental health clinicians (N = 38 across six clinics) during group consultation sessions completed as part of an MBC implementation trial. We conducted a qualitative content analysis of consultation forms completed by clinicians before each MBC consultation session. Clinicians sought MBC consultation for clients across a range of ages and levels of depression severity. Qualitative results revealed five main questions and concerns in consultation sessions: (1) how to administer the PHQ-9, (2) how to review PHQ-9 scores, (3) how to respond to PHQ-9 score, (4) the types of clients for whom MBC would be appropriate, and (5) how MBC could impact a clinician's usual care. Findings highlight the need for ongoing consultation and limitations of workshop training alone. Practical recommendations for addressing the common questions and concerns identified are presented to support MBC use.

The Implementation of Measurement-Based Care in the Context of Telemedicine: Qualitative Study.

The Measurement Based Care in Mental Health Initiative launched by the Department of Veterans Affairs in 2016 is an example of an evidence-based practice that uses patient-reported outcome measures (PROMs) to improve patient outcomes. The acceptance of measurement-based care (MBC) among Veterans Affairs providers is relatively high. However, there are barriers to MBC for telehealth providers. Health information technologies might afford opportunities to address some of the barriers related to the uptake of MBC. This paper reports on an implementation effort to integrate MBC into mental health care telehealth practice using eHealth solutions. Qualitative data were generated from 22 semistructured interviews with psychiatrists (n=4), psychologists (n=3), social workers (n=3), nurses (n=6), a pharmacist (n=1), and administrative staff (n=5) who provide telemental health care through a community-based outpatient clinic in the rural Midwestern United States. The interviews were conducted during the pilot phase of an implementation initiative to increase the adoption of MBC by revising clinic workflows to integrate the use of eHealth technologies. Data were analyzed using thematic analysis. Time burden and workflow issues were the most common barrier to provider adoption of MBC; sharing and reviewing pencil-and-paper measures and results in the same room was no longer possible in novel telehealth workflows necessitated by the COVID-19 pandemic. Providers voiced concerns about how long it would take to collect, adequately score, interpret, share, and document the PROMs during the telehealth visit. Concerns about time might also correspond to a gap in providers' familiarity with these assessments, greater comfort in assessing symptoms through clinical interviews, and being accustomed to using the assessments as screening tools more so than longitudinal outcome measures. Capacities associated with eHealth technologies may address workflow concerns and promote providers' understanding and use of the measures as tracking tools. The need to use limited appointment time well was a top priority for telemental health providers. eHealth technologies provided operative supports that protect time in appointments by shifting when and how PROMs are collected. Bolstering providers' familiarity with how to use PROMs in the course of treatment may impact providers' buy-in by encouraging them to reconsider how sharing and acting on PROMs could be time well spent.

Measurement feedback system implementation in public youth mental health treatment services: a mixed methods analysis

BackgroundPrior studies indicate the effectiveness of measurement-based care (MBC), an evidence-based practice, in improving and accelerating positive outcomes for youth receiving behavioral health services. MBC is the routine collection and use of client-reported progress measures to inform shared decision-making and collaborative treatment adjustments and is a relatively feasible and scalable clinical practice, particularly well-suited for under-resourced community mental health settings. However, uptake of MBC remains low, so information on determinants related to MBC practice patterns is needed.MethodsQuantitative and qualitative data from N = 80 clinicians who implemented MBC using a measurement feedback system (MFS) were merged to understand and describe determinants of practice over three study phases. Quantitative, latent class analysis identified clinician groups based on participants’ ratings of MFS acceptability, appropriateness, and feasibility and describes similarities/differences between classes in clinician-level characteristics (e.g., age; perceptions of implementation climate; reported MFS use; phase I). Qualitative analyses of clinicians’ responses to open-ended questions about their MFS use and feedback about the MFS and implementation supports were conducted separately to understand multi-level barriers and facilitators to MFS implementation (phase II). Mixing occurred during interpretation, examining clinician experiences and opinions across groups to understand the needs of different classes of clinicians, describe class differences, and inform selection of implementation strategies in future research (phase III).ResultsWe identified two classes of clinicians: “Higher MFS” and “Lower MFS,” and found similarities and differences in MFS use across groups. Compared to Lower MFS participants, clinicians in the Higher MFS group reported facilitators at a higher rate. Four determinants of practice were associated with the uptake of MBC and MFS in youth-serving community mental health settings for all clinicians: clarity, appropriateness, and feasibility of the MFS and its measures; clinician knowledge and skills; client preferences and behaviors; and incentives and resources (e.g., time; continuing educational support). Findings also highlighted the need for individual-level implementation strategies to target clinician needs, skills, and perceptions for future MBC and MFS implementation efforts.ConclusionThis study has implications for the adoption of evidence-based practices, such as MBC, in the context of community-based mental health services for youth.