Mixed-method Evaluation Study Research Articles

Students’ Perception of Interactive Progressive Drawing Using a Graphic Tablet in Histology Education: A Mixed-Method Evaluation Study

Abstract Background: It is important that relevant diagrams that are clear and visible are drawn by the teacher of histology for a better understanding of the subject. It is also desirable that the student see the buildup of the diagram. To achieve the same in an electronic format, a graphic tablet was used for interactive progressive drawing (IPD) in histology education. Aim and Objective: To assess students’ perception of usefulness and effectiveness of IPD, in histology education. Methodology: Students were taught histology by IPD, using a graphic tablet in a classroom setting. Their perception about the method of teaching and the quality of the diagrams was obtained by an online questionnaire having open-ended and closed-ended questions. The mean and standard deviation of ratings on the Likert scale about student perception were calculated. The percentage of students who gave a rating of 4 out of 5 or above for the questions was measured as an indicator of satisfaction of the students. The answers to the open-ended questions were categorized and analyzed by the grounded theory approach. Results: A total of 137 (54.8%) students responded to the questionnaire. Seventy-eight percent of students preferred the diagrams drawn such over textbook illustrations and perceived the innovation to be helpful in improving basic understanding on a scale of 4/5 or above. Conclusion: Teaching histology by IPD using a graphic tablet was perceived by students to be better than teaching using a Power Point presentation.

Building the capacity of rural allied health generalists through online postgraduate education: a qualitative evaluation.

Workforce development is a key strategy for building the capacity and capability of a workforce. Accordingly, rural and remote practising allied health professionals require relevant and accessible continuing professional development to enhance their knowledge and skills and improve consumer health outcomes. This study explored the impact of an online postgraduate allied health rural generalist education program, from the perspective of allied health professionals participating in the program and their supervisors and managers. A qualitative, exploratory descriptive study design was employed using semistructured interviews. This study formed the qualitative component of a larger convergent mixed-methods evaluation study aimed at evaluating the reach, quality and impact of an online rural generalist education program for allied health professionals in Australia. Allied health professionals from seven professions enrolled in an online postgraduate rural generalist education program, the rural generalist program (RGP). Their designated work-based supervisors and their managers who were responsible for the operational management of the study sites were invited to participate in the study. All participants were employed in rural and remote health services in 10 sites across four Australian states. Study participants' experience and perceptions of the impact of the RGP on themselves, the healthcare service and the broader community were explored using semistructured interviews. Data were thematically analysed site by site, then across sites using Braun and Clarke's (2012) systematic six-phase approach. Provisional codes were generated and iteratively compared, contrasted and collapsed into secondary, more advanced codes until final themes and subthemes were developed. Semistructured interviews were conducted with 23 allied health professionals enrolled in the RGP and their 27 work-based supervisors and managers across the 10 study sites. Three final themes were identified that describe the impact of the RGP: building capability as rural generalist allied health professionals; recruiting and building a rural workforce; enhancing healthcare services and consumer outcomes. Allied health professionals working in rural and remote locations valued the RGP because it provided accessible postgraduate education that aligned with their professional and clinical needs. Integrated into a supportive, well-structured development pathway, the experience potentiated learning and facilitated safe clinical practice that met the needs of consumers and organisations. The findings demonstrate that effective work-integrated learning strategies can enhance the development of essential capabilities for rural practice and support early-career allied health professionals' transition to rural and remote practice. These experiences can engage allied health professionals in a way that engenders a desire to remain working in rural and remote contexts.

Implementation of best practice goal-setting in five rehabilitation services: A mixed-methods evaluation study.

This implementation study aimed to enhance the key elements of clinical practice goal-setting across 5 rehabilitation services. This study followed a participatory action research approach guided by the Knowledge to Action framework. Medical record audits and structured client interviews were conducted prior to and following 12 weeks of implementation, in order to evaluate the success of the goal-setting implementation package. Medical record audits and interviews conducted pre-implementation (audits n = 132, interviews n = 64), post-implementation (audits n = 130, interviews n = 56) and at 3-month follow-up (audits n = 30) demonstrated varied success across sites. Following implementation 2 sites significantly improved their common goal focus (site 1 p ≤ 0.001, site 2 p = 0.005), these sites also demonstrated a significant increase in clients reporting that they received copies of their rehabilitation goals (site 1 p ≤ 0.001, site 2 p ≤ 0.001). Four sites improved client action planning, feedback and review, and 3 sites enhanced their specificity of goal-setting. At 3-month follow-up 4 sites had continued to improve their common goal focus; however, all sites decreased the specificity of their goal-setting. Elements of the implementation package were successful at enhancing the goal-setting process; however, how the package is implemented within the team may impact outcomes.

Does a public online IVF prediction tool help set patient expectations? A mixed methods evaluation study.

Does a public online IVF success prediction calculator based on real-world data help set patient expectations? The YourIVFSuccess Estimator aided consumer expectations of IVF success: one quarter (24%) of participants were unsure of their estimated IVF success before using the tool; one half changed their prediction of success after using the tool and one quarter (26%) had their expectations of IVF success confirmed. Several web-based IVF prediction tools exist worldwide but have not been evaluated for their impact on patient expectations, nor for patient perceptions of usefulness and trustworthiness. This is a pre-post evaluation of a convenience sample of 780 online users of the Australian YourIVFSuccess Estimatorhttps://yourivfsuccess.com.au/ between 1 July and 31 November 2021. Participants were eligible if they were over 18 years of age, Australian residents, and considering IVF for themselves or their partner. Participants filled in online surveys before and after using the YourIVFSuccess Estimator. The response rate of participants who completed both surveys and the YourIVFSuccess Estimator was 56% (n = 439). The YourIVFSuccess Estimator aided consumer expectations of IVF success: one quarter (24%) of participants were unsure of their estimated IVF success before using the tool; one half changed their prediction of success after using the tool (20% increased, 30% decreased), bringing their predictions in line with the YourIVFSuccess Estimator, and one quarter (26%) had their IVF success expectations confirmed. One in five participants claimed they would change the timing of IVF treatment. The majority of participants found the tool to be at least moderately trustworthy (91%), applicable (82%), and helpful (80%), and would recommend it to others (60%). The main reasons given for the positive responses were that the tool is independent (government funded, academic) and based on real-world data. Those who did not find it applicable or helpful were more likely to have had a worse-than-expected prediction, or to have experienced non-medical infertility (e.g. single women, LGBTQIA+), noting that at the time of evaluation the Estimator did not accommodate these patient groups. Those who dropped out between the pre- and post-surveys tended to have a lower education status or have been born outside of Australia or New Zealand, therefore there may be issues with generalizability. With consumers demanding increasing levels of transparency and participation in decisions around their medical care, public-facing IVF predictor tools based on real-world data are useful for aligning expectations about IVF success rates. Given differences in patient characteristics and IVF practices internationally, national data sources should be used to inform country-specific IVF prediction tools. The YourIVFSuccess website and evaluation of the YourIVFSuccess Estimator are supported by the Medical Research Future Fund (MRFF) Emerging Priorities and Consumer Driven Research initiative: EPCD000007. BKB, ND, and OF have no conflicts to declare. DM holds a clinical role at Virtus Health. His role did not influence the analysis plan or interpretation of results in this study. GMC is an employee of the UNSW Sydney, and Director of the UNSW NPESU. UNSW receives research funding on behalf of Prof Chambers from the MRFF to develop and manage the Your IVF Success website. Grant ID: MRFF Emerging Priorities and Consumer Driven Research initiative: EPCD000007. N/A.

Reducing Premature Coronary Artery Disease in Malaysia by Early Identification of Familial Hypercholesterolemia Using the Familial Hypercholesterolemia Case Ascertainment Tool (FAMCAT): Protocol for a Mixed Methods Evaluation Study.

Familial hypercholesterolemia (FH) is predominantly caused by mutations in the 4 FH candidate genes (FHCGs), namely, low-density lipoprotein receptor (LDLR), apolipoprotein B-100 (APOB-100), proprotein convertase subtilisin/kexin type 9 (PCSK9), and the LDL receptor adaptor protein 1 (LDLRAP1). It is characterized by elevated low-density lipoprotein cholesterol (LDL-c) levels leading to premature coronary artery disease. FH can be clinically diagnosed using established clinical criteria, namely, Simon Broome (SB) and Dutch Lipid Clinic Criteria (DLCC), and can be identified using the Familial Hypercholesterolemia Case Ascertainment Tool (FAMCAT), a primary care screening tool. This study aims to (1) compare the detection rate of genetically confirmed FH and diagnostic accuracy between the FAMCAT, SB, and DLCC in the Malaysian primary care setting; (2) identify the genetic mutation profiles, including novel variants, in individuals with suspected FH in primary care; (3) explore the experience, concern, and expectation of individuals with suspected FH who have undergone genetic testing in primary care; and (4) evaluate the clinical utility of a web-based FH Identification Tool that includes the FAMCAT, SB, and DLCC in the Malaysian primary care setting. This is a mixed methods evaluation study conducted in 11 Ministry of Health primary care clinics located at the central administrative region of Malaysia. In Work stream 1, the diagnostic accuracy study design is used to compare the detection rate and diagnostic accuracy of the FAMCAT, SB, and DLCC against molecular diagnosis as the gold standard. In Work stream 2, the targeted next-generation sequencing of the 4 FHCGs is used to identify the genetic mutation profiles among individuals with suspected FH. In Work stream 3a, a qualitative semistructured interview methodology is used to explore the experience, concern, and expectation of individuals with suspected FH who have undergone genetic testing. Lastly, in Work stream 3b, a qualitative real-time observation of primary care physicians using the "think-aloud" methodology is applied to evaluate the clinical utility of a web-based FH Identification Tool. The recruitment for Work stream 1, and blood sampling and genetic analysis for Work stream 2 were completed in February 2023. Data collection for Work stream 3 was completed in March 2023. Data analysis for Work streams 1, 2, 3a, and 3b is projected to be completed by June 2023, with the results of this study anticipated to be published by December 2023. This study will provide evidence on which clinical diagnostic criterion is the best to detect FH in the Malaysian primary care setting. The full spectrum of genetic mutations in the FHCGs including novel pathogenic variants will be identified. Patients' perspectives while undergoing genetic testing and the primary care physicians experience in utilizing the web-based tool will be established. These findings will have tremendous impact on the management of patients with FH in primary care and subsequently reduce their risk of premature coronary artery disease. DERR1-10.2196/47911.

Assessment of the Massachusetts Flexible Services Program to Address Food and Housing Insecurity in a Medicaid Accountable Care Organization

Health systems are increasingly addressing health-related social needs. The Massachusetts Flexible Services program (Flex) is a 3-year pilot program to address food insecurity and housing insecurity by connecting Medicaid accountable care organization (ACO) enrollees to community resources. To understand barriers and facilitators of Flex implementation in 1 Medicaid ACO during the first 17 months of the program. This mixed-methods qualitative evaluation study from March 2020 to July 2021 used the Reach, Efficacy, Adoption, Implementation, Maintenance/Practical, Robust Implementation, and Sustainability Model (RE-AIM/PRISM) framework. Two Mass General Brigham (MGB) hospitals and affiliated community health centers were included in the analysis. Quantitative data included all MGB Medicaid ACO enrollees. Qualitative interviews were conducted with 15 members of ACO staff and 17 Flex enrollees. Reach was assessed by the proportion of ACO enrollees who completed annual social needs screening (eg, food insecurity and housing insecurity) and the proportion and demographics of Flex enrollees. Qualitative interviews examined other RE-AIM/PRISM constructs (eg, implementation challenges, facilitators, and perceived effectiveness). Of 67 098 Medicaid ACO enrollees from March 2020 to July 2021 (mean [SD] age, 28.8 [18.7] years), 38 442 (57.3%) completed at least 1 social needs screening; 10 730 (16.0%) screened positive for food insecurity, and 7401 (11.0%) screened positive for housing insecurity. There were 658 (1.6%) adults (mean [SD] age, 46.6 [11.8] years) and 173 (0.7%) children (<21 years; mean [SD] age, 10.1 [5.5]) enrolled in Flex; of these 831 people, 613 (73.8%) were female, 444 (53.4%) were Hispanic/Latinx, and 172 (20.7%) were Black. Most Flex enrollees (584 [88.8%] adults; 143 [82.7%] children) received the intended nutrition or housing services. Implementation challenges identified by staff interviewed included administrative burden, coordination with community organizations, data-sharing and information-sharing, and COVID-19 factors (eg, reduced clinical visits). Implementation facilitators included administrative funding for enrollment staff, bidirectional communication with community partners, adaptive strategies to identify eligible patients, and raising clinician awareness of Flex. In Flex enrollee interviews, those receiving nutrition services reported increased healthy eating and food security; they also reported higher program satisfaction than Flex enrollees receiving housing services. Enrollees who received nutrition services that allowed for selecting food based on preferences reported higher satisfaction than those not able to select food. This mixed-methods qualitative evaluation study found that to improve implementation, Medicaid and health system programs that address social needs may benefit from providing funding for administrative costs, developing bidirectional data-sharing platforms, and tailoring support to patient preferences.

‘Tell Me! Learning from Narratives’: an evaluation of an educational programme on narrative inquiry for nursing home care students

Background: Narratives have the potential to promote person-centred practice, yet few studies have been undertaken on the impact of a narrative approach on learning for care professionals or students. With this in mind, we co-designed an educational programme on the use of older persons’ narratives for professionals in research, education and nursing. Aims: To investigate the impact of attending a narrative educational programme on the learning of nursing and healthcare assistant students, and on their person-centred practice. We also examined what factors characterised and influenced this learning. Methods: This was a mixed-methods evaluation study. We evaluated the impact of a narrative educational programme on third-year healthcare assistant students and second-year nursing students. Students were invited to complete a survey before and after the educational programme. After the programme, we performed interviews with all the educators and some of the students. Results: Students’ learning from the narratives was varied, and there were differences in the extent to which the programme raised awareness. Some students demonstrated new understandings, actions and behaviours. Students self-reported that they had experienced learning related to 12 learning outcomes and to their person-centred practice. According to educators and students, this learning was experiential and reflective, and was influenced by the students’ level of participation, personal characteristics and openness to other perspectives, as well as the educators’ guidance and the workplace conditions. Conclusion: This study shows that the educational programme ‘Tell Me! Learning From Narratives’ can contribute to the learning of healthcare assistant and nursing students in terms of their understanding of the field of narrative inquiry as well as the development of their person-centred practice. Providing support for educators is a prerequisite for the programme to work. Implications for practice: The programme has the potential to contribute to a person-centred care curriculum Self-evaluation, for example via the self-scan person-centred care survey in this study, prompts awareness in students Educators should be supported in their use of a narrative approach, person-centred care values and didactic skills Educators should reflect the values of person-centred care in their practice and in their relationships with students as role models

The Development of a UK Culturally Adapted and Modified Version of the Person Attuned Musical Interactions Manual: Protocol for a 2-Phase Mixed Methods Study

Previous research has suggested that care home interactions need significant improvements, especially those between staff and residents with dementia. Reasons for the lack of interactions are staff time pressures and residents' language impairments. Although residents may experience reduced language abilities, they can continue to communicate through other forms, including nonverbal communication and music. Person Attuned Musical Interactions (PAMI) is a staff training tool that provides staff with music therapy skill-sharing to promote high-quality interactions between staff and residents using nonverbal communication and music. The tool was originally developed in Denmark. To ensure that the tool is appropriate for UK care homes, a team of researchers in the United Kingdom have modified and culturally adapted the tool. This study aims to investigate the appropriateness of the adapted and modified manual for UK care homes and to explore the impact of PAMI on residents with dementia and care staff. The project consists of 2 phases, a qualitative field-testing study and a mixed methods evaluation study, which have been developed following the Medical Research Council's guidelines for complex interventions. Care staff and residents with dementia will be recruited from care homes in Lincolnshire, where the care staff will be trained in the PAMI intervention before implementing the intervention in their daily routines. Fortnightly reflective sessions will be provided throughout the phases to provide supervision and monitoring. The qualitative methods include interviews, reflective session transcripts, diary entries, and resident experience questionnaires. The quantitative outcome measures are residents' music engagement, staff's dementia competence, residents' quality of life, and staff burden. The resident's music engagement will be administered at 9 fortnightly time points. Staff's dementia competence, resident's quality of life, and staff burden will be administered at preintervention and postintervention time points. The study has been funded by The Music Therapy Charity as part of a PhD studentship. The study began recruiting in September 2021. The research team aims to publish the results of the first phase in July to September 2023 and those of the second phase in October to December 2023. This study will be the first to investigate the modified version of PAMI. Therefore, it will provide feedback on the appropriateness of the manual for UK care homes. The PAMI intervention has the potential to offer high-quality music intervention training to a larger population of care homes who may currently be restricted by finances, the availability of time, and a lack of training opportunities. DERR1-10.2196/43408.

Travel scenario workshops for geographical accessibility modeling of health services: A transdisciplinary evaluation study.

Limited geographical access to quality Emergency Obstetric and Newborn Care (EmONC) is a major driver of high maternal mortality. Geographic access to EmONC facilities is identified by the global community as a critical issue for reducing maternal mortality and is proposed as a global indicator by the Ending Preventable Maternal Mortality (EPMM) initiative. Geographic accessibility models can provide insight into the population that lacks adequate access and on the optimal distribution of facilities and resources. Travel scenarios (i.e., modes and speed of transport) used to compute geographical access to healthcare are a key input to these models and should approximate reality as much as possible. This study explores strategies to optimize and harmonize knowledge elicitation practices for developing travel scenarios. Knowledge elicitation practices for travel scenario workshops (TSW) were studied in 14 African and South-Asian countries where the United Nations Population Fund supported ministries of health and governments in strengthening networks of EmONC facilities. This was done through a mixed methods evaluation study following a transdisciplinary approach, applying the four phases of the Interactive Learning and Action methodology: exploration, in-depth, integration, and prioritization and action planning. Data was collected in November 2020-June 2021 and involved scoping activities, stakeholder identification, semi-structured interviews (N = 9), an evaluation survey (N = 31), and two co-creating focus group discussions (N = 8). Estimating realistic travel speeds and limited time for the workshop were considered as the largest barriers. The identified opportunities were inclusively prioritized, whereby preparation; a favorable composition of attendees; validation practices; and evaluation were anticipated to be the most promising improvement strategies, explaining their central place on the co-developed initial standard operating procedure (SOP) for future TSWs. Mostly extensive preparation-both on the side of the organization and the attendees-was anticipated to address nearly all of the identified TSW challenges. This study showed that the different identified stakeholders had contradicting, complementing and overlapping ideas about strategies to optimize and harmonize TSWs. Yet, an initial SOP was inclusively developed, emphasizing practices for before, during and after each TSW. This SOP is not only relevant in the context of the UNFPA EmONC development approach, but also for monitoring the newly launched EPMM indicator and even in the broader field of geographic accessibility modeling.

Multisite Agricultural Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) Pilot Program: Protocol for a Responsive Mixed Methods Evaluation Study

Veterans Affairs Farming and Recovery Mental Health Services (VA FARMS) is an innovative pilot program to provide supportive resources for veterans with interests in agricultural vocations. Implemented at 10 pilot sites, VA FARMS will provide mental health services and resources for veterans while supporting training in gardening and agriculture. As each pilot site project has unique goals, outreach strategies, and implementation efforts based on the local environment and veteran population, evaluating the pilot program provides a unique challenge for evaluators. This paper describes the protocol to evaluate VA FARMS, which was specifically designed to enable site variation by providing both site-specific and cross-site understanding of site implementation processes and outcomes. The objectives of this paper are to (1) describe the protocol used for evaluating VA FARMS, as an innovative Department of Veterans Affairs (VA) agriculturally based, mental health, and employment pilot program serving veterans at 10 pilot sites across the Veterans Health Administration enterprise; and (2) provide guidance to other evaluators assessing innovative programs. This evaluation uses the context, inputs, process, product (CIPP) model, which evaluates a program's content and implementation to identify strengths and areas for improvement. Data collection will use a concurrent mixed methods approach. Quantitative data collection will involve quarterly program surveys, as well as three individual veteran participant surveys administered upon the veteran's entrance and exit of the pilot program and 3 months postexit. Quantitative data will include baseline descriptive statistics and follow-up statistics on veteran health care utilization, health care status, and agriculture employment status. Qualitative data collection will include participant observation at each pilot site, and interviews with participants, staff, and community stakeholders. Qualitative data will provide insights about pilot program implementation processes, veterans' experiences, and short-term participation outcomes. Evaluation efforts began in December 2018 and are ongoing. Between October 2018 and September 2020, 494 veterans had enrolled in VA FARMS and 1326 veterans were reached through program activities such as demonstrations, informational presentations, and town-hall discussions. A total of 1623 community members and 655 VA employees were similarly reached by VA FARMS programming during that time. Data were collected between October 2018 and September 2020 in the form of 336 veteran surveys, 30 veteran interviews, 27 staff interviews, and 11 community partner interviews. Data analysis is expected to be completed by October 2022. This evaluation protocol will provide guidance to other evaluators assessing innovative programs. In its application to the VA FARMS pilot, the evaluation aims to add to existing literature on nature-based therapies and the rehabilitation outcomes of agricultural training programs for veterans. Results will provide programmatic insights on the implementation of pilot programs, along with needed improvements and modifications for the future expansion of VA FARMS and other veteran-focused agricultural programs. DERR1-10.2196/40496.

The adaptation and fidelity tool to support social service practitioners in balancing fidelity and adaptations: Longitudinal, mixed-method evaluation study.

Evidence-based interventions (EBIs) seldom fit seamlessly into a setting and are often adapted. The literature identifies practitioners' management of fidelity and adaptations as problematic but offers little guidance. This study aimed to investigate practitioners' perceptions of the feasibility and usability of an intervention aimed to support them in fidelity and adaptation management when working with EBIs. The intervention, the adaptation and fidelity tool (A-FiT), was developed based on the literature, along with input from social service practitioners and social services' Research and Development units' personnel. The intervention consisted of two workshops where the participants were guided through a five-step process to manage fidelity and adaptations. It was tested in a longitudinal mixed-method intervention study with 103 practitioners from 19 social service units in Stockholm, Sweden. A multimethod data collection was employed, which included interviews at follow-up, questionnaires at baseline and follow-up (readiness for change and self-rated knowledge), workshop evaluation questionnaires (usability and feasibility) after each workshop, and documentation (participants' notes on worksheets). To analyze the data, qualitative content analysis, Kruskal-Wallis tests, and Wilcoxon rank-sum tests were performed. Overall, the practitioners had a positive perception of the intervention and perceived it as relevant for fidelity and adaptation management (mean ratings over 7.0 on usability and feasibility). The workshops also provided new knowledge and skills to manage fidelity and adaptations. Furthermore, the intervention provided insights into the practitioners' understanding about adaptation and fidelity through a more reflective approach. Practical tools are needed to guide professionals not only to adhere to intervention core elements but also to help them to manage fidelity and adaptation. The proposed A-FiT intervention for practitioners' management of both fidelity and adaptation is a novel contribution to the implementation literature. Potentially, the next step is an evaluation of the intervention's impact in an experimental design.

Communication with patients with limited prognosis—an integrative mixed-methods evaluation study

PurposeOncological societies advocate the continuity of care, specialized communication, and early integration of palliative care. To comply with these recommendations, an interprofessional, longitudinally-structured communication concept, the Milestone Communication Approach (MCA), was previously developed, implemented, and evaluated. Our research question is: what are possible explanations from the patient perspective for prognosis and advance care planning being rarely a topic and for finding no differences between MCA and control groups concerning distress, quality of life, and mood?MethodsA pragmatic epistemological stance guided the study. A mixed-methods design was chosen including a pragmatic randomized trial (n = 171), qualitative interviews with patients (n = 13) and caregivers (n = 12), and a content analysis (133 milestone conversations, 54 follow-up calls). Data analysis involved the pillar integration process.ResultsTwo pillar themes emerged: 1 “approaching prognosis and advance care planning”; 2 “living with a life-threatening illness”. Information on prognosis seemed to be offered, but patients’ reactions were diverse. Some patients have to deal with having advanced lung cancer while nonetheless feeling healthy and seem not to be ready for prognostic information. All patients seemed to struggle to preserve their quality of life and keep distress under control.ConclusionAttending to patients’ questions, worries and needs early in a disease trajectory seems key to helping patients adjust to living with lung cancer. If necessary clinicians should name their predicament: having to inform about prognosis versus respecting the patients wish to avoid it. Research should support better understanding of patients not wishing for prognostic information to successfully improve communication strategies.Trial registrationRegistration: German Clinical Trial Register No. DRKS00013649, registration date 12/22/2017, (https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00013649) and No. DRKS00013469, registration date 12/22/2017, (https://www.drks.de/drks_web/navigate.do?navigationId=trial.HTML&TRIAL_ID=DRKS00013469).

Fostering "Reflection-On-Practice" Through a Multisource Feedback and Peer Coaching Pilot Program.

Reflective practice involves thinking about one's practice and often involves using data to effect such reflection. Multisource feedback (MSF) involves evaluation by peers, patients, and coworkers. Coaching has been identified as a key aspect of MSF with peer coaching involving two or more colleagues working together to reflect on current practices and share ideas. We introduced a pilot MSF and peer coaching program with a goal to evaluate its effect on fostering reflective practice. Physician participants completed a 360-degree assessment of their practices, followed by peer coaching sessions. Peer coaches were oriented to an evidence-based theory-driven feedback model (R2C2) to support coaching skills development. A mixed-methods evaluation study was undertaken, including pre to post surveys of readiness for self-directed learning, a postevaluation survey of participant satisfaction, and semistructured participant interviews. Thirty four (N = 34) participants completed the 360-degree assessment, and 22 participants took part in two coaching meetings. Respondents reported significant improvement to aspects of their readiness for self-directed learning ( P <.05), including knowing about learning strategies to achieve key learning goals, knowing about resources to support one's own learning, and being able to evaluate one's learning outcomes. Overall, respondents felt empowered to "reflect" on their practices, affirm what they were doing well, and, for some, identify opportunities for further and ongoing professional development. MSF and peer coaching emerged as key elements in enabling reflective practice by facilitating reflection on one's practice and conversations with one's peers to affirm strengths and opportunities for strengthening practice through self-directed professional development.

Health care professionals’ perspectives on the utilisation of a remote surveillance and care tool for patients with COVID-19 in general practice: a qualitative study

BackgroundMost COVID-19 patients with severe symptoms are treated in hospitals. General practices are responsible for assessing most ambulatory patients. However, they face several challenges managing COVID-19 patients, and those with non-COVID-19 conditions. In April of 2020, we designed a software tool for the structured surveillance of high-risk home-quarantined COVID-19 patients in general practice (CovidCare) including several telephone monitorings, in order to support general practices and early identification of severe courses. This study presents the qualitative results of a mixed-methods process evaluation study on CovidCare.MethodsIn a qualitative process evaluation study conducted between March and May 2021, we explored the perspectives of seven general practitioners (GPs) and twelve VERAHs (medical care assistants with special training) on CovidCare using semi-structured interviews based on the RE-AIM framework (reach, effectiveness, adoption, implementation, maintenance). We used deductive qualitative content analysis employing the RE-AIM framework to assess the utilisation and implementation of CovidCare.ResultsOverall, most health care professionals were satisfied with CovidCare. They highlighted 1) a good orientation for the management of COVID-19 patients, especially due to a high level of uncertainty at the beginning of the pandemic, 2) the possibility to gain new knowledge, and 3) the structured data collection as facilitators for the implementation of CovidCare. Moreover, CovidCare reduced the workload for GPs while some VERAHs perceived a higher workload as they were responsible for large parts of the CovidCare management. However, CovidCare positively affected the VERAHs’ job satisfaction as most patients provided positive feedback and felt less anxious about coping with their disease. Previous experience with the software and an easy integration into daily practice were considered to be crucial utilisation drivers. Time and personnel resources were identified as major barriers. To further improve CovidCare, participants suggested a less comprehensive version of CovidCare, the expansion of inclusion criteria as well as an app for the patients’ self-management.ConclusionThe COVID-19 surveillance and care tool for COVID-19 patients with increased risk was perceived as useful by GPs and VERAHs. Supportive remote health care tools such as CovidCare are a viable means to maintain comprehensive and continuous health care during a pandemic and may strengthen the primary care system.Trial registrationGerman Clinical Trials Register DRKS00022054; date of registration: 02/06/2020.

‘Listening from a Personal Perspective’: Does Co-Designed Mental Health Education Shift Stigma? A Mixed Method Evaluation Study

AbstractMental health stigma by health care practitioners is well established with few education interventions implemented in Australia. Depth of field is a growing body of health humanities research that draws on healthcare consumers as legitimate experts (by experience) to co-design health professions education.This research aimed to explore whether a co-designed (with mental health consumers) education intervention shifts knowledge, attitudes and behavioural intentions of current and future health care practitioners towards caring for people who have experienced mental health issues.A convergent parallel mixed method design was used to collect data utilising a validated anti-stigma assessment tool at two time points pre- and post-intervention (n = 80) followed by qualitative data from semi-structured interviews (n = 10). Descriptive analysis, Wilcoxon Sign-Rank test to compare pre-post responses and interview data were thematically analysed.Collectively, data showed positive shifts in knowledge, attitudes and behavioural intentions towards people who have experienced mental health issues. Three main themes: Making connections: The power of storytelling; Knowledge and attitudes towards Borderline Personality Disorder: Shape, strengthen, challenge; and Inspiring change in health care practice.Co-designed education can positively impact health care practitioners’ knowledge, attitudes and behavioural intentions and has the potential to reframe mental health education toward recovery-oriented practice.

A mixed-methods evaluation of a health-promoting café located in a small health service in rural Victoria, Australia.

Residents of rural areas internationally typically experience chronic disease risk profiles worse than city dwellers. Poor diet, a key driver of chronic disease, has been associated with unhealthy food environments, and rural areas often experience limited access to healthy, fresh and affordable food. This study aimed to evaluate the first three years of a health promoting social enterprise café established in a small rural health service. A mixed-methods evaluation study. Quantitative sales data, surveys and key informant interviews that included both quantitative and qualitative responses. Three years of sales data were included; 111customer surveys and five key informant interviews were conducted. Food and beverages on displayed and sold consistently met or exceeded the healthy criteria set by policy. Stakeholders supported the traffic light system, the social enterprise model and rated the likelihood of sustainability of the café as high. Customers used the 'traffic light' system to inform food choices, placed value on the warmth of the staff and on the welcoming environment created through the social enterprise model. Resources remain tight although all stakeholders are committed to the sustainability of the YarriYak café. The study shows the acceptability, feasibility and sustainability of a health promoting social enterprise café in a rural area.

Behaviourally informed, patient-led interventions to reduce missed appointments in general practice: a 12-month implementation study.

Scalable, positive, behaviourally informed interventions may help people remember to attend their primary care appointment or cancel in good time, but have not yet been implemented long term. To examine effects of social norms and making active commitments on missed and cancelled appointments in primary care over 12 months and explore implementation factors. A mixed-methods design evaluation and implementation study led by a Patient Participation Group (PPG) member in a large GP practice in the West Midlands. Following a 6-month baseline, waiting room notices were redesigned to emphasise positive social norms for desired behaviours. When booking appointments, receptionists were trained to invite patients to (i) verbally actively commit to cancelling if needed; (ii) write down their own appointment details. Monthly missed appointments (MAs) and cancellations were statistically compared with baseline averages and seasonally equivalent months. To explore implementation, reception staff completed a knowledge, attitude, and behaviour questionnaire at 9 months, analysed descriptively. Study team field notes were thematically analysed. Across 12 intervention months there was a mean of 37.67 fewer MAs per month (20% reduction) and 102.66 more cancellations (21.07% increase) compared with 6-month baseline means [MAs t(11) = -6.15, P < 0.001; cancellations t(11) = 3.637, P = 0.004] with statistically significant differences in seasonally equivalent months [MAs t(5) = -4.65, P = 0.006; cancellations t(5) = 3.263, P = 0.022]. Receptionists (n = 12) reported implementing the strategies except when facing pressures; knowledge and attitudes varied. Behaviourally informed interventions reduced primary care MAs longer term; PPGs and practice teams can work together on quality improvement projects with support from leaders to prioritise and embed new practices.

Evaluating the perceived added value of a threefold intervention to improve palliative care for persons experiencing homelessness: a mixed-method study among social service and palliative care professionals

BackgroundPalliative care for persons experiencing homelessness who reside in social service facilities is often late or lacking. A threefold intervention was implemented to improve palliative care for this population by increasing knowledge and collaboration between social service and palliative care professionals. This consultation service comprised: 1) consultations between social service professionals and palliative care professionals; 2) multidisciplinary meetings involving these professionals; and 3) training of these professionals. This study aims to evaluate the perceived added value of this threefold consultation service in three regions in the Netherlands.MethodsA mixed-methods evaluation study using structured questionnaires for consultants, requesting consultants, and attendees of multidisciplinary meetings, semi-structured group and individual interviews with social service and palliative care professionals involved, weekly diaries filled out by consultants, and an implementation diary. Qualitative data were analyzed following the principles of thematic analysis. Quantitative data were analyzed descriptively.ResultsThirty-four consultations, 22 multidisciplinary meetings and 9 training sessions were studied during the implementation period of 21 months. Social service professionals made up the majority of all professionals reached by the intervention. In all regions the intervention was perceived to have added value for collaboration and networks of social service and palliative care professionals (connecting disciplines reciprocally and strengthening collaborations), the competences of especially social service professionals involved (competency in palliative care provision, feeling emotionally supported in complex situations), and the quality and timing of palliative care (more focus on quality of life and dying, advance care planning and looking ahead, and greater awareness of death and palliative care).ConclusionsThe threefold consultation service particularly helps social service professionals connect with palliative care professionals. It helps them to identify palliative care needs in good time and to provide qualitatively better palliative care to persons experiencing homelessness.

The Impact of an After-School Physical Activity Program on Children’s Physical Activity and Well-Being during the COVID-19 Pandemic: A Mixed-Methods Evaluation Study

Introduction: This study evaluated the impact of the Build Our Kids’ Success (BOKS) after-school program on children’s physical activity (PA) and well-being during the COVID-19 pandemic. Methods: Program leaders, children, and their parents were recruited from after-school programs in Nova Scotia, Canada, that delivered BOKS programming in Fall 2020. After participating, Grade 4–6 children (n = 14) completed the Physical Literacy Assessment for Youth Self (PLAYself), Physical Activity Questionnaire for Older Children (PAQ-C), the Physical Activity Enjoyment Scale (PACES), and 5 National Institutes of Health (NIH) Patient-Reported Outcomes Measures Information System (PROMIS) scales. Children (n = 7), parents (n = 5), and program leaders (n = 3) completed interviews, which were analyzed for themes inductively. Results: The average PAQ-C score was 2.70 ± 0.48, PLAYself was 68.23 ± 13.12, and PACES was 4.22 ± 0.59 (mean ± SD). NIH PROMIS scores were below standard means (cognitive function, family relationships) or within normal limits (peer relationships, positive affect, and life satisfaction). A thematic analysis of interviews revealed that children’s PA levels were impacted by the pandemic and that BOKS positively impacted children’s physical well-being and integrated well with school-based activities. Conclusions: Participation in BOKS provided an overall positive experience and may have mitigated COVID-19-related declines in PA in well-being. The results of this evaluation can inform future physically-active after-school programming.

Teaching Undergraduate Medical Students Non-Technical Skills: An Evaluation Study of a Simulated Ward Experience.

PurposeResearch suggests that medical students in the UK report a need to be better prepared for the non-technical skills required for the role of a junior doctor. A Simulated Ward Experience was developed in an attempt to address this need. The purpose of this study was (1) to evaluate the effectiveness of the Simulated Ward Experiences by examining students’ reactions regarding the quality of teaching and (2) to examine the main drivers of learning and the extent to which students felt it helped them prepare for their future training.MethodsA mixed method evaluation study was conducted using a questionnaire and focus groups. Final year students who participated in the Simulated Ward Experience were invited to contribute to the evaluation, out of which 25 completed the questionnaire and 13 took part in focus group interviews. Data analysis were conducted by means of descriptive statistics for questionnaire data and thematic analysis of focus group transcripts.ResultsThe median Likert scores for quality of teaching Non-Technical Skills were either very good or excellent, demonstrating that students were highly satisfied with the way in which these were taught. Qualitative data provided further insights into the aspects of the intervention that promoted learning, and these were categorised into four themes, including realism of the simulation; relevance for the role and responsibilities of the Foundation Year 1 Doctor (including Non-Technical Skills); learning from and with others; and supportive learning environment.ConclusionThis evaluation study provides further evidence of the value of learning in a simulated setting, particularly when it is closely aligned to the real clinical context and creates opportunities to practice skills that are perceived to be relevant by the learner. Study limitations are recognised and suggestions for further studies are provided.