Normalization Measure Development Research Articles

Recommendations for implementing digital alcohol interventions in primary care: lessons learned from a Norwegian feasibility study.

Excessive alcohol consumption is a leading global risk factor for ill-health and premature death. Digital alcohol interventions can be effective at reducing alcohol consumption, but their widespread adoption is lagging behind. This study aimed to identify factors promoting or inhibiting the implementation of a digital alcohol intervention in Norwegian primary care, by using Normalization Process Theory (NPT). A mixed methods feasibility study combining quantitative and qualitative methods. A digital alcohol intervention called "Endre" was implemented across four GP practices in Stavanger and Oslo. Usage of the intervention was logged on the digital platform. General practitioners (GPs) reported their perceived uptake of the intervention via a web-based survey. The Normalization MeAsure Development (NoMAD) survey was used to measure support staff's perceived normalization of the intervention. Qualitative data were analyzed using the NPT framework, with quantitative data analyzed descriptively and using χ 2 and Wilcoxon signed-rank test for differences in current and future normalization. Thirty-seven GPs worked in the clinics and could recruit patients for the digital intervention. Thirty-six patients registered for the intervention. Nine patients dropped out early and 25 completed the intervention as intended. Low normalization scores at follow-up (n = 27) indicated that Endre did not become fully embedded in and across practices. Nonetheless, staff felt somewhat confident about their use of Endre and thought it may become a more integral part of their work in the future. Findings from six semi-structured group interviews suggested that limited implementation success may have been due to a lack of tailored implementation support, staff's lack of involvement, their diminished trust in Endre, and a lack of feedback on intervention usage. The outbreak of the Covid-19 pandemic further limited opportunities for GPs to use Endre. This study investigated the real-world challenges of implementing a digital alcohol intervention in routine clinical practice. Future research should involve support staff in both the development and implementation of digital solutions to maximize compatibility with professional workflows and needs. Integration of digital solutions may further be improved by including features such as dashboards that enable clinicians to access and monitor patient progress and self-reported outcomes.

Evaluating the implementation of the Pediatric Acute Care Education (PACE) program in northwestern Tanzania: a mixed-methods study guided by normalization process theory

BackgroundIn low- and middle-income countries (LMICs), such as Tanzania, the competency of healthcare providers critically influences the quality of pediatric care. To address this issue, we introduced Pediatric Acute Care Education (PACE), an adaptive learning program to enhance provider competency in Tanzania’s guidelines for managing seriously ill children. Adaptive learning is a promising alternative to current in-service education, yet optimal implementation strategies in LMIC settings are unknown.Objectives(1) To evaluate the initial PACE implementation in Mwanza, Tanzania, using the construct of normalization process theory (NPT); (2) To provide insights into its feasibility, acceptability, and scalability potential.MethodsMixed-methods study involving healthcare providers at three facilities. Quantitative data was collected using the Normalization MeAsure Development (NoMAD) questionnaire, while qualitative data was gathered through in-depth interviews (IDIs) and focus groups discussions (FGDs).ResultsEighty-two healthcare providers completed the NoMAD survey. Additionally, 24 senior providers participated in IDIs, and 79 junior providers participated in FGDs. Coherence and cognitive participation were high, demonstrating that PACE is well understood and resonates with existing healthcare goals. Providers expressed a willingness to integrate PACE into their practices, distinguishing it from existing educational methods. However, challenges related to resources and infrastructure, particularly those affecting collective action, were noted. Early indicators point toward the potential for long-term sustainability of the PACE, but assessment of reflexive monitoring was limited due to the study’s focus on PACE’s initial implementation.ConclusionThis study offers vital insights into the feasibility and acceptability of implementing PACE in a Tanzanian context. While PACE aligns well with healthcare objectives, addressing resource and infrastructure challenges as well as conducting a longer-term study to assess reflexive monitoring is crucial for its successful implementation. Furthermore, the study underscores the value of the NPT as a framework for guiding implementation processes, with broader implications for implementation science and pediatric acute care in LMICs.

Staff Experiences Transitioning to Digital Dermatopathology in a Tertiary Academic Medical Center: Lessons Learned From Implementation Science

Digital pathology (DP) transforms practice by replacing traditional glass slide review with digital whole slide images and workflows. Although digitization may improve accuracy and efficiency, transitioning to digital practice requires staff to learn new skills and adopt new ways of working and collaborating. In this study, we aimed to evaluate the experiences and perceptions of individuals involved in the day-to-day work of implementing DP in a tertiary academic medical center using Normalization Process Theory, a social theory that explains the processes by which innovations are operationalized and sustained in practice. Between September 2021 and June 2022, dermatopathologists, referring clinicians, and support staff at Mayo Clinic (Minnesota, Florida, and Arizona) participated in interviews (n=22) and completed surveys (n=34) concerning the transition. Normalization Process Theory informed the selection of validated survey items (Normalization Measure Development Questionnaire) and guided qualitative analysis. Participants reported high agreement with statements related to shared understanding and potential value of DP for workflow integration and working relationships. Qualitative themes reflecting the way organization and social context enable these processes were mapped onto implementation stages and related key activities. We found that earlier processes of implementation (understanding and working out participation) were better supported than later stages (doing it and reflecting on it). Our analysis helps identify targets for further intervention to hasten and help sustain implementation, including additional support in software and technological integration, workflows and work redesign, and regular monitoring and feedback systems. The use of implementation theory, such as Normalization Process Theory, may provide useful pointers to enable other similar digital system transition efforts.

Healthcare providers' perceived barriers and facilitators to screening for intimate partner violence in pregnant women attending prenatal clinics.

To examine healthcare providers' extent of and perceived barriers and facilitators to screening for intimate partner violence in pregnant women attending prenatal clinics. Cross-sectional descriptive design was used to collect data from 130 healthcare providers. Seventeen healthcare providers from 17 prenatal clinics in Kanungu district, Uganda, were recruited via convenience sampling to participate in an online survey implementing a modified Normalization Measure Development instrument. Data were collected between February 2023 and March 2023 (02/8/2023 to 03/12/2023) and analysed using descriptive and Mann-Whitney U test and chi-square tests. Slightly more than half (56%) of healthcare providers report screening pregnant women for intimate partner violence. There was a statistically significant relationship between healthcare providers screening for intimate partner violence and having previous training on intimate partner violence screening. The only barrier to screening identified was a lack of understanding of how intimate partner violence screening affects the nature of participant's own work. There were numerous potential facilitators identified for healthcare providers' intimate partner violence screening. Although higher-than-expected number of healthcare providers reported screening of pregnant women for intimate partner violence, the extent of screening is still suboptimal. The barrier to screening identified needs to be addressed and facilitators promoted. Receiving training among healthcare providers on intimate partner violence screening was associated with higher levels of screening; thus, this needs to be enhanced to optimize screening rates. Future studies should assess screening practices objectively and implement interventions to improve healthcare providers' intimate partner violence screening rates. Screening for intimate partner violence should be part of standard care provided by healthcare providers to all pregnant women during prenatal clinic visits. The study supports the need for more training for healthcare providers in aspects related to intimate partner violence screening in order to ensure prompt diagnosis and treatment of those affected, identify those at risk and increase awareness. There is a need to enhance healthcare providers' capacity for intimate partner violence screening through education by integrating intimate partner violence screening pre- and post-registration courses and preparation programs or curriculum. Intimate partner violence (IPV) in pregnancy is a global health problem. Screening for IPV by healthcare providers is suboptimal. This study found that only 56% of healthcare providers were routinely screening for IPV in Ugandan prenatal clinics. This study identified the main facilitators and one barrier to IPV screening. This study has adhered to the relevant EQUATOR guidelines for quantitative studies. No patient was involved in this study.

Geriatric Assessment in CKD Care: An Implementation Study

Rationale & ObjectiveOlder people with progressive chronic kidney disease (CKD) have complex health care needs. Geriatric evaluation preceding decision-making for kidney replacement is recommended in guidelines, but implementation is lacking in routine care. We aimed to evaluate implementation of geriatric assessment in CKD care. Study DesignMixed-methods implementation study. Setting& Participants: Dutch nephrology centers were approached for implementation of geriatric assessment in patients aged ≥70 years and with an eGFR ≤20mL/min. Quality Improvement ActivitiesWe implementated a consensus-based nephrology-tailored geriatric assessment: a patient-questionnaire and professional-administered test set comprising 16 instruments covering functional, cognitive, psycho-social and somatic domains and patient-reported outcome measures. OutcomesWe aimed for implementation in 10 centers and 200 patients. Implementation was evaluated by (i) perceived enablers and barriers of implementation, including integration in work routines (Normalization MeAsure Development tool), and (ii) relevance of the instruments to routine care for the target population. Analytical ApproachVariations in implementation practices were described based on field notes. The post-implementation survey among healthcare professionals was analyzed descriptively, using an explanatory qualitative approach for open-ended questions. ResultsGeriatric assessment was implemented in 10 centers among n=191 patients. Survey respondents (n=71, 88% response rate) identified determinants that facilitated implementation: i.e. multidisciplinary collaboration (with geriatricians) -meetings and reports, and execution of assessments by nurses. Barriers to implementation were: patient illiteracy or language barrier, time constrains, and patient burden. Professionals considered geriatric assessment sufficiently integrated into work routines (mean 6.7/10, SD2.0), but also subject to improvement. Likewise, the relevance of geriatric assessment for routine care was scored as 7.8/10, SD1.2). The Clinical Frailty Score and Montreal Cognitive Assessment were perceived most relevant instruments. LimitationsSelection bias of interventions’ early adopters may limit generalizability. ConclusionsGeriatric assessment could successfully be integrated in CKD care, and was perceived relevant to healthcare professionals.

Psychometric properties of two implementation measures: Normalization MeAsure Development questionnaire (NoMAD) and organizational readiness for implementing change (ORIC).

Effective interventions need to be implemented successfully to achieve impact. Two theory-based measures exist for measuring the effectiveness of implementation strategies and monitor implementation progress. The Normalization MeAsure Development questionnaire (NoMAD) explores the four core concepts (Coherence, Cognitive Participation, Collective Action, Reflexive Monitoring) of the Normalization Process Theory. The Organizational Readiness for Implementing Change (ORIC) is based on the theory of Organizational Readiness for Change, measuring organization members' psychological and behavioral preparedness for implementing a change. We examined the measurement properties of the NoMAD and ORIC in a multi-national implementation effectiveness study. Twelve mental health organizations in nine countries implemented Internet-based cognitive behavioral therapy (iCBT) for common mental disorders. Staff involved in iCBT service delivery (n = 318) participated in the study. Both measures were translated into eight languages using a standardized forward-backward translation procedure. Correlations between measures and subscales were estimated to examine convergent validity. The theoretical factor structures of the scales were tested using confirmatory factor analysis (CFA). Test-retest reliability was based on the correlation between scores at two time points 3 months apart. Internal consistency was assessed using Cronbach's alpha. Floor and ceiling effects were quantified using the proportion of zero and maximum scores. NoMAD and ORIC measure related but distinct latent constructs. The CFA showed that the use of a total score for each measure is appropriate. The theoretical subscales of the NoMAD had adequate internal consistency. The total scale had high internal consistency. The total ORIC scale and subscales demonstrated high internal consistency. Test-retest reliability was suboptimal for both measures and floor and ceiling effects were absent. This study confirmed the psychometric properties of the NoMAD and ORIC in multi-national mental health care settings. While measuring on different but related aspects of implementation processes, the NoMAD and ORIC prove to be valid and reliable across different language settings.

Community perceptions of a biopsychosocial model of integrated care in the health center: the case of 4 health districts in South Kivu, Democratic Republic of Congo

SummaryBackgroundBiopsychosocial care is one of the approaches recommended in the health system by the WHO. Although efforts are being made on the provider side to implement it and integrate it into the health system, the community dynamic also remains to be taken into account for its support. The objective of this study is to understand the community's perceptions of the concept of integrated health care management according to the biopsychosocial approach (BPS) at the Health Center of a Health District and its evaluation in its implementation.MethodsThis cross-sectional study was done in six Health Areas belonging to four Health Districts in South Kivu, DRC. We conducted 15 semi-directive individual interviews with 9 respondents selected by convenience, including 6 members of the Development Committees of the Health Areas, with whom we conducted 12 interviews and 3 patients met in the health centers. The adapted Normalization MeAsure Development (NoMAD) tool, derived from the Theory of the Normalization Process of Complex Interventions, allowed us to collect data from November 2017 to February 2018, and then from November 2018 to February 2019. After data extraction and synthesis, we conducted a thematic analysis using the NoMAD tool to build a thematic framework. Six themes were grouped into three categories.ResultsInitially, community reports that the BPS approach of integrated care in the Health Centre is understood differently by providers; but then, through collective coordination and integrated leadership within the health care team, the approach becomes clearer. The community encouraged some practices identified as catalysts to help the approach, notably the development of financial autonomy and mutual support, to the detriment of those identified as barriers. According to the community, the BPS model has further strengthened the performance of health workers and should be expanded and sustained. ConclusionsThe results of our study show the importance of community dynamics in the care of biopsychosocial situations by providers. The barriers and catalysts to the mechanism, both community-based and professional, identified in our study should be considered in the process of integrating the biopsychosocial model of person-centered health care.

The influence of organizational models on the implementation of internet-based cognitive behavior therapy in primary care: A mixed methods study using the RE-AIM framework

BackgroundInternet-Based Cognitive Behavioral Therapy (iCBT) holds great potential in addressing mental health issues, yet its real-world implementation poses significant challenges. While prior research has predominantly focused on centralized care models, this study explores the implementation of iCBT in the context of decentralized organizational structures within the Swedish primary care setting, where all interventions traditionally are delivered at local Primary Care Centers (PCCs). AimThis study aims to enhance our understanding of iCBT implementation in primary care and assess the impact of organizational models on the implementation's outcome using the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) framework. MethodA mixed-methods research design was employed to identify the factors influencing iCBT implementation across different levels, involving patients, therapists and managers. Data spanning two years was collected and analyzed through thematic analysis and statistical tests. The study encompassed 104 primary care centers, with patient data (n = 1979) sourced from the Swedish National Quality Register for Internet-Based Psychological Treatment (SibeR). Additionally, 53 iCBT therapists and 50 PCC managers completed the Normalization Measure Development Questionnaire, and 15 leaders participated in interviews. ResultsOur investigation identified two implementation approaches, one concentrated and one decentralized. Implementation effectiveness was evident through adherence rates suggesting that iCBT is a promising approach for treating mental ill-health in primary care, although challenges were observed concerning patient assessment and therapist drift towards unstructured treatment. Mandatory implementation, along with managerial and organizational support, positively impacted adoption. Results vary in terms of adherence to established protocols, with therapists working in concentrated model showing a significantly higher percentage of registration in the quality register SibeR (X2 (1, N = 2973) = 430.5774, p = 0.001). They also showed significantly higher means in cognitive participation (Z = −2.179, p = 0.029) and in reflective monitoring (Z = −2.548, p = 0.011). DiscussionOverall, the study results demonstrate that iCBT, as a complex and qualitatively different intervention from traditional psychological treatment, can be widely implemented in primary care settings. The study's key finding highlights the substantial advantages of the concentrated organizational model. This model has strengths in sustainability, encourages reflective monitoring among therapists, the use of quality registers, and enforces established protocols. ConclusionIn conclusion, this study significantly contributes to the understanding of the practical aspects associated with the implementation of complex internet interventions, particularly in the context of internet-based cognitive-behavioral therapy (iCBT). The study highlights that effective iCBT integration into primary care requires a multifaceted approach, taking into account organizational models, robust support structures, and a commitment to maintaining quality standards. By emphasizing these factors, our research aims to provide actionable insights that can enhance the practicability and real-world applicability of implementing iCBT in primary care settings.

Improving musculoskeletal physiotherapists’ confidence in patient-centred care informed by acceptance and commitment therapy: A descriptive study

BackgroundPatient-centred care is essential for high quality musculoskeletal care, however, few evidence-based opportunities exist that address the barriers to implementation for clinicians. ObjectiveTo develop and evaluate a simulation-based educational strategy for musculoskeletal physiotherapists to increase knowledge and confidence in patient-centred care. MethodsRepeated-measures, single-group educational interventional descriptive study. Primary outcome was participant-reported knowledge and confidence in patient-centred care. Customized survey data was collected at baseline (T1) (N = 22), immediately after a face-to-face workshop (T2) (N = 22), and six weeks after the workshop (T3) (N = 17). Secondary outcomes included sustained implementation using the Normalization Measure Development (NoMAD) tool. Repeated-measures ANOVA was used to analyse primary outcomes. ResultsOur participants were typically female (72%), early career (mean 3.3 years post-graduate) and culturally diverse (67%). Significant increases in participant confidence were noted at all time points on all five learning outcomes (repeated measures ANOVA, p < 0.001 to p = 0.009). Participants had very high baseline knowledge and no further increases were found following the intervention (p > 0.05). Normalization Measure Development data indicated high coherence, high cognitive participation, and high reflexive monitoring, with neutral results for collective action. ConclusionA novel, psychologically-informed, simulation-based educational strategy is effective in improving musculoskeletal physiotherapist confidence in patient-centred care. Participants reported implementation of skills learnt in the workshop into subsequent clinical practice.

Theory-based implementation of an enhanced recovery protocol for cranial surgery.

There is growing evidence for the use of enhanced recovery protocols (ERPs) in cranial surgery. As they become widespread, successful implementation of these complex interventions will become a challenge for neurosurgical teams owing to the need for multidisciplinary engagement. Here, the authors describe the novel use of an implementation framework (normalization process theory [NPT]) to promote the incorporation of a cranial surgery ERP into routine neuro-oncology practice. A baseline audit was conducted to determine the degree of implementation of the ERP into practice. The Normalization MeAsure Development (NoMAD) questionnaire was circulated among 6 groups of stakeholders (neurosurgeons, anesthetists, intensivists, recovery nurses, preoperative assessment nurses, and neurosurgery ward staff) to examine barriers to implementation. Based on these findings, a theory-guided implementation intervention was delivered. A repeat audit and NoMAD questionnaire were conducted to assess the impact of the intervention on the uptake of the ERP. The baseline audit (n = 24) demonstrated limited delivery of the ERP elements. The NoMAD questionnaire (n = 32) identified 4 subconstructs of the NPT as barriers to implementation: communal specification, contextual integration, skill set workability, and relational integration. These guided an implementation intervention that included the following: 1) teamwork-focused training; 2) ERP promotion; and 3) procedure simplification. The reaudit (n = 21) demonstrated significant increases in the delivery of 5 protocol elements: scalp block (12.5% of patients before intervention vs 76.2% of patients after intervention, p < 0.00001), recommended analgesia (25.0% vs 100.0%, p < 0.00001) and antiemetics (12.5% vs 100.0%, p < 0.00001), trial without catheter (13.6% vs 88.9%, p < 0.00001), and mobilization on the 1st postoperative day (45.5% vs 94.4%, p < 0.00001). There was a significant reduction in the mean hospital length of stay from 6.3 ± 3.4 to 4.2 ± 1.7 days (p = 0.022). Two months after implementation, a repeat NoMAD survey demonstrated significant improvement in communal specification. Here, the authors have demonstrated the successful implementation of a cranial surgery ERP by using a systematic theory-based approach.

Implementing shared decision making for early-stage breast cancer treatment using a coproduction learning collaborative: the SHAIR Collaborative protocol

BackgroundShared decision making (SDM) in breast cancer care improves outcomes, but it is not routinely implemented. Results from the What Matters Most trial demonstrated that early-stage breast cancer surgery conversation aids, when used by surgeons after brief training, improved SDM and patient-reported outcomes. Trial surgeons and patients both encouraged using the conversation aids in routine care. We will develop and evaluate an online learning collaborative, called the SHared decision making Adoption Implementation Resource (SHAIR) Collaborative, to promote early-stage breast cancer surgery SDM by implementing the conversation aids into routine preoperative care. Learning collaboratives are known to be effective for quality improvement in clinical care, but no breast cancer learning collaborative currently exists.Our specific aims are to (1) provide the SHAIR Collaborative resources to clinical sites to use with eligible patients, (2) examine the relationship between the use of the SHAIR Collaborative resources and patient reach, and (3) promote the emergence of a sustained learning collaborative in this clinical field, building on a partnership with the American Society of Breast Surgeons (ASBrS).MethodsWe will conduct a two-phased implementation project: phase 1 pilot at five sites and phase 2 scale up at up to an additional 32 clinical sites across North America. The SHAIR Collaborative online platform will offer free access to conversation aids, training videos, electronic health record and patient portal integration guidance, a feedback dashboard, webinars, support center, and forum. We will use RE-AIM for data collection and evaluation. Our primary outcome is patient reach. Secondary data will include (1) patient-reported data from an optional, anonymous online survey, (2) number of active sites and interviews with site champions, (3) Normalization MeAsure Development questionnaire data from phase 1 sites, adaptations data utilizing the Framework for Reporting Adaptations and Modifications-Extended/-Implementation Strategies, and tracking implementation facilitating factors, and (4) progress on sustainability strategy and plans with ASBrS.DiscussionThe SHAIR Collaborative will reach early-stage breast cancer patients across North America, evaluate patient-reported outcomes, engage up to 37 active sites, and potentially inform engagement factors affecting implementation success and may be sustained by ASBrS.

#4186 FEASIBILITY OF NEPHROLOGY-TAILORED GERIATRIC ASSESSMENT: AN IMPLEMENTATION STUDY

Abstract Background and Aims Geriatric evaluation of older patients with progressive chronic kidney disease is recommended in guidelines to enhance decision-making for kidney replacement choices. Although frailty, physical and cognitive impairments, and depression are prevalent, routine identification of geriatric impairments is lacking. Therefore, we aimed to study feasibility and determinants of successful implementation of a novel approach: nephrology-tailored geriatric assessment. Method In a mixed-methods implementation study, we investigated the feasibility of implementation of a consensus-based geriatric assessment [1] in Dutch nephrology centers. Feasibility was assessed through hospital participation and patient inclusion (among patients aged 70+ years with eGFR≤20mL/min/1.73 m2). We also evaluated determinants of successful implementation with a post-implementation survey among healthcare professionals covering (i) perceived enablers and barriers of implementation, (ii) perceived integration in work routines (Normalization MeAsure Development tool), and (iii) perceived relevance of the instruments. In addition, patients were asked if the geriatric assessment provided them with new insights for their future treatment decision for kidney failure. Results Feasibility was substantiated in implementation of geriatric assessment in 10 hospitals among 191 patients, i.e. 100% and 96% of our aimed goals. According to participating healthcare professionals (n = 71), determinants that facilitated implementation were: collaboration with the geriatric department, multidisciplinary meetings and reports, and execution of assessments by nurses. Most frequently mentioned barriers to implementation were: patient illiteracy or language barrier, lack of time, and burden for patients. Professionals considered geriatric assessment sufficiently integrated into work routines (mean 6.7 of 10, SD 2.0), but also subject to improvement (Figure 1). Implementation of geriatric assessment was considered sufficiently relevant for routine care (mean score 7.8 of 10, SD 1.2). Half of the patients (n = 42/82) stated that the geriatric assessment provided them with new insights, whereas 27% (n = 22) responded not to have gained new insights from the tests. Conclusion Multicenter implementation of nephrology-tailored geriatric assessment seems feasible and relevant. For future implementation we recommend involving the geriatric department, using multidisciplinary teams and -meetings, acknowledging the pivotal role of nurse practitioners, and using a flexible approach matching local resources.

Upscaling telemonitoring in Dutch University Medical Centres: A baseline measurement

Introduction and objectiveThe Dutch university medical centres (UMC’s) are on the forefront when it comes to validation, implementation and research of telemonitoring. To aid the UMC’s in their effort, the Dutch Government has supported the UMC’s by fostering the ‘Citrien eHealth program’. This program aims at nationwide implementation and upscaling of telemonitoring via a collaborative network. To quantify the success of this program, this study aims to provide insights into the current adoption of telemonitoring by health care professionals (HCP) within Dutch UMC’s. MethodsBased on the evaluation framework as adapted from the Normalization Process Theory (NPT) a cross-sectional study was conducted in all Dutch UMC’s. Thirty healthcare professionals (HCPs) per UMC were invited to complete the 23-item Normalization MeAsure Development (NoMAD) questionnaire, a tool to assess the degree of normalisation of telemonitoring. ResultsThe over-all response rate was 52.4% (124/240). Over 80% of respondents agreed or strongly agreed that they understand how telemonitoring affects the nature of their work, with a mean score of 1.49 (N = 117, SD 0.74). HCPs reported to believe telemonitoring will become a normal part of their work in the near future (N = 124, mean = 8.67, SD = 1.38). Using the Wilcoxon signed-rank test, the difference between current practise and future use of telemonitoring predicts to be statistically significant (Z = − 7.505, p ≤ 0.001). Mean scores for appropriate training and sufficient resources are relatively low (2.39 and 2.70 respectively), indicating a barrier for collective action. ConclusionThis is the first study to assess the implementation of telemonitoring as standard practise across Dutch UMCs. The HCPs in this study are the frontrunners, believing that telemonitoring will become standard practise in the future despite the fact that it is currently not. Based on the results of this study, both educational and implementation strategies including practical skills training are highly recommended in order to scale up telemonitoring widely.

Effectiveness of Self-guided Tailored Implementation Strategies in Integrating and Embedding Internet-Based Cognitive Behavioral Therapy in Routine Mental Health Care: Results of a Multicenter Stepped-Wedge Cluster Randomized Trial.

Internet-based cognitive behavioral therapy (iCBT) services for common mental health disorders have been found to be effective. There is a need for strategies that improve implementation in routine practice. One-size-fits-all strategies are likely to be ineffective. Tailored implementation is considered as a promising approach. The self-guided integrated theory-based Framework for intervention tailoring strategies toolkit (ItFits-toolkit) supports local implementers in developing tailored implementation strategies. Tailoring involves identifying local barriers; matching selected barriers to implementation strategies; developing an actionable work plan; and applying, monitoring, and adapting where necessary. This study aimed to compare the effectiveness of the ItFits-toolkit with implementation-as-usual (IAU) in implementing iCBT services in 12 routine mental health care organizations in 9 countries in Europe and Australia. A stepped-wedge cluster randomized trial design with repeated measures was applied. The trial period lasted 30 months. The primary outcome was the normalization of iCBT delivery by service providers (therapists, referrers, IT developers, and administrators), which was measured with the Normalization Measure Development as a proxy for implementation success. A 3-level linear mixed-effects modeling was applied to estimate the effects. iCBT service uptake (referral and treatment completion rates) and implementation effort (hours) were used as secondary outcomes. The perceived satisfaction (Client Satisfaction Questionnaire), usability (System Usability Scale), and impact of the ItFits-toolkit by implementers were used to assess the acceptability of the ItFits-toolkit. In total, 456 mental health service providers were included in this study. Compared with IAU, the ItFits-toolkit had a small positive statistically significant effect on normalization levels in service providers (mean 0.09, SD 0.04; P=.02; Cohen d=0.12). The uptake of iCBT by patients was similar to that of IAU. Implementers did not spend more time on implementation work when using the ItFits-toolkit and generally regarded the ItFits-toolkit as usable and were satisfied with it. The ItFits-toolkit performed better than the usual implementation activities in implementing iCBT services in routine practice. There is practical utility in the ItFits-toolkit for supporting implementers in developing and applying effective tailored implementation strategies. However, the effect on normalization levels among mental health service providers was small. These findings warrant modesty regarding the effectiveness of self-guided tailored implementation of iCBT services in routine practice. ClinicalTrials.gov NCT03652883; https://clinicaltrials.gov/ct2/show/NCT03652883. RR2-10.1186/s13063-020-04686-4.

Exploring readiness for implementing goal-oriented care in primary care using normalization process theory.

To use normalization process theory (NPT) to build a strategy for the implementation of goal-oriented care (GOC) in primary care in Flanders, Belgium. GOC is a possible approach to more coordinated and integrated care and tailors care to patients' personal life goals. The concept has gained interest among policy makers and researchers, but the main drivers for successful implementation are the primary healthcare professionals (PHCPs) who need to see added value of GOC in order to embed it into their daily practice. NPT, developed to understand the processes of implementing new ways of organizing care, offers a useful lens to understand adoption of GOC in primary care practice. PHCPs (n = 131) who participated in a 2-hour community meeting on GOC were asked to complete the Normalization MeAsure Development survey. This 23-item survey is based on NPT and describes participants' views about how an intervention would impact their work, their expectations about it, and whether it could become a routine part of their work. The NPT constructs coherence (sense-making work) and cognitive participation (relational work) showed positive tendency toward implementation of GOC. The participants had an initial understanding on GOC and there was much interest in supporting and start working with this approach. The other constructs collective action (operational work) and reflexive monitoring (appraisal work) will need further efforts to trigger implementation. A common ground is needed to integrate GOC as a common practice which can be achieved by intensive interprofessional collaboration.

Validity and reliability of the Chinese version of the Normalization MeAsure Development(NoMAD)

BackgroundThe Normalization MeAsure Development (NoMAD) is a brief quantitative tool based on the Normalization Process Theory (NPT), which can measure the implementation process of new technologies and complex interventions. The aim of our study was to translate and culturally adapt the NoMAD into Chinese, and to evaluate the psychometric properties of the Chinese version of NoMAD.MethodsAccording to the NoMAD translation guideline, we undertook forward translation, backward translation, and compared these translations to get a satisfactory result, then we performed cognitive interviews to achieve cross-culture adaptation. And the psychometric properties of the final version were evaluated among clinical nurses who used the pressure injuries management system via WeChat mini-program at a tertiary hospital in northwestern China.ResultsA total of 258 nurses were enrolled in our study, and the response rate was 92.1%. The Cronbach’s alpha of four dimensions were as follow: Coherence (0.768), Cognitive Participation (0.904), Collective Action (0.820), and Reflexive Monitoring (0.808). The overall internal consistency was 0.941. The confirmatory factor analysis results showed a good fit for its theoretical structure (CFI = 0.924, TLI = 0.910, RMSEA = 0.0079, SRMSR = 0.046, χ2/df = 2.61). The item-level content validity index ranged from 0.857 to 1, and the scale-level content validity index was 0.95. There were positive correlations between four constructs scores and three general normalization scores.ConclusionsThe Chinese version of NoMAD is a reliable and valid tool to evaluate the implementation process of innovations.

Evaluation of Normalization After Implementation of the Digital Dutch Obstetric Telephone Triage System: Mixed Methods Study With a Questionnaire Survey and Focus Group Discussion.

BackgroundThe Dutch Obstetric Telephone Triage System (DOTTS) was developed to improve the quality of acute obstetric care. To achieve optimal effect, the DOTTS should be adopted in the daily care process by triage staff.ObjectiveThe primary aim was to evaluate the degree of implementation (ie, normalization) of the DOTTS, and the secondary aim was to evaluate which lessons can be learned from its current implementation in Dutch hospitals.MethodsAn evaluation study with a mixed methods design was performed. All triage staff in 9 Dutch hospitals that implemented the DOTTS before September 1, 2019, were invited to complete the Normalization Measure Development (NoMAD) questionnaire between December 2019 and July 2020. The questionnaire is based on the Normalization Process Theory (NPT). This self-reported questionnaire provides insights into the work people do in order to integrate and embed new practice in routine care. The NPT is based on the following 4 constructs: coherence, cognitive participation, collective action, and reflexive monitoring. Within the questionnaire, each construct is represented by 4-7 questions. Questions are scored on a 5-point normalization process scale. Descriptive statistics were used for analysis of questionnaire scores. Subsequently, the questionnaire findings were discussed during a focus group. Template analysis following the 4 constructs was used for analyzing the results of the focus group.ResultsOverall, 173 of 294 (58.8%) triage staff members completed the NoMAD questionnaire, and 90.2% (156/173) of the participants had used the DOTTS for over 6 months. The digital application was used as much as possible or always by 137 of 173 (79.2%) participants. The overall normalization process score was 3.77 (SD 0.36). The constructs coherence, cognitive participation, collective action, and reflexive monitoring scored 4.01 (SD 0.47), 4.05 (SD 0.45), 3.5 (SD 0.45), and 3.72 (SD 0.47), respectively. Analysis of the focus group discussion showed that the added value of the DOTTS was seen as a quality improvement for the care of pregnant women. Dedication of the complete multidisciplinary implementation team was important for facilitating normalization. Support from the medical staff and proper use by all disciplines involved in the triage were seen as facilitating factors. Participants appreciated training and evaluation, and indicated a need for ongoing training and evaluation in relation to goal achievement.ConclusionsThe DOTTS has been integrated into normal care in daily practice. Evaluation by the NoMAD questionnaire provided a positive overall score. These results are in line with or, in some aspects, better than the results of other evaluation studies. Key factors in the normalization process of the DOTTS in obstetric triage are the shared added value for stakeholders, the dedication of the complete multidisciplinary implementation team, and implementation plans that are tailor made in the practical context of the hospital.

Prior to Implementation of Digital Pathology-Assessment of Expectations among Staff by Means of Normalization Process Theory.

The Region of Southern Denmark is the first in Denmark to implement digital pathology (DIPA), starting at the end of 2020. The DIPA process involves changes in workflow, and the pathologist will have to diagnose based on digital whole slide imaging instead of through the traditional use of the conventional light microscope and glass slides. In addition, in the laboratory, the employees will have to implement one more step to their workflow—scanning of tissue. The aim of our study was to assess the expectations and readiness among employees and management towards the implementation of DIPA, including their thoughts and motivations for starting to use DIPA. We used a mixed-method approach. Based on the findings derived from 18 semi-structured interviews with employees from the region’s departments of pathology, we designed a questionnaire, including questions from the normalization measure development tool. The questionnaires were e-mailed to 181 employees. Of these employees, 131 responded to the survey. Overall, they reported feeling sufficiently tech-savvy to be able to use DIPA, and they had high expectations as well as motivation and readiness for the upcoming changes. However, the employees were skeptical regarding the allocation of resources, and few were aware of reports about the effects of DIPA. Based on the findings, it seems to be important to provide not only a thorough introduction to the new intervention and the changes it will entail, but also to continue to ensure that the staff know how it works and why it is necessary to implement.

Normalizing Telemonitoring in Nurse-Led Care Models for Complex Chronic Patient Populations: Case Study.

BackgroundThe implementation of telemonitoring (TM) has been successful in terms of the overall feasibility and adoption in single disease care models. However, a lack of available research focused on nurse-led implementations of TM that targets patients with multiple and complex chronic conditions (CCC) hinders the scale and spread to these patient populations. In particular, little is known about the clinical perspective on the implementation of TM for patients with CCC in outpatient care.ObjectiveThis study aims to better understand the perspective of the clinical team (both frontline clinicians and those in administrative positions) on the implementation and normalization of TM for complex patients in a nurse-led clinic model.MethodsA pragmatic, 6-month implementation study was conducted to embed multicondition TM, including heart failure, hypertension, and diabetes, into an integrated nurse-led model of care. Throughout the study, clinical team members were observed, and a chart review was conducted of the care provided during this time. At the end of the study, clinical team members participated in qualitative interviews and completed the adapted Normalization Measure Development questionnaires. The Normalization Process Theory guided the deductive data analysis.ResultsOverall, 9 team members participated in the study as part of a larger feasibility study of the TM program, of which 26 patients were enrolled. Team members had a shared understanding of the purpose and value of TM as an intervention embedded within their practice to meet the diverse needs of their patients with CCC. TM aligned well with existing chronic care practices in several ways, yet it changed the process of care delivery (ie, interactional workability subconstruct). Effective TM normalization in nurse-led care requires rethinking of clinical workflows to incorporate TM, relationship development between the clinicians and their patients, communication with the interdisciplinary team, and frequent clinical care oversight. This was captured well through the subconstructs of skill set workability, relational integration, and contextual integration of the Normalization Process Theory.ConclusionsClinicians successfully adopted TM into their everyday practice such that some providers felt their role would be significantly and negatively affected without TM. This study demonstrated that smartphone-based TM systems complemented the routine and challenging clinical work caring for patients with CCC in an integrated nurse-led care model.

Implementation of Nationwide Evidence- and Consensus-Based Guidelines to Harmonize Neonatal Care in The Netherlands

BackgroundA Dutch committee for National Guidelines in Neonatology developed nineteen evidence- and consensus-based guidelines to be used in all Dutch neonatal intensive care units (NICUs). The primary goal was to make clinical practices more uniform and consistent.ObjectiveThis study investigated to what extent the guidelines were implemented and which factors played a role in implementation.Study designA mixed method study design was used to investigate both the level and the process of implementation. A nationwide, multicenter, cross-sectional survey was performed using a validated instrument for measuring the level of implementation (Normalization MeAsure Development questionnaire, NoMAD). The number of implemented guidelines per NICU and the frequency and content of the amendments that NICUs made to the original consensus guidelines were analyzed. Through semi-structured interviews, perceived barriers and facilitators for implementation were explored.ParticipantsFellows and neonatologists working at all ten Dutch level 3–4 NICUs were eligible.ResultsOn an average, NICUs implemented 12.6 (of 19) guidelines (range 6–17). The Normalization Process Scale was 54 (of 65). Main influencing factors impeding implementation were guideline-related (e.g., unpractical, lengthy guidelines) and personal (e.g., an active representative responsible for local implementation).ConclusionThe implementation of our guidelines appears to be successful. Ways for improvement can be distinguished in personal, guideline-related and external factors. Empowerment of local representatives was considered most essential.Electronic Supplementary MaterialSupplementary material is available in the online version of this article at 10.1007/s13312-022-2516-3.