Participatory Research Evaluation Research Articles

Advanced practice nursing in the field of pelvic floor disorder – Lessons learned 5 years after role implementation

AbstractIntroductionPelvic floor disorder is a widespread chronic disease that confronts patients with a variety of physical and psychosocial challenges. An interprofessional team from a hospital region of eastern Switzerland created a specialized health service for this patient population and expressed the need for support by an APN to further develop interprofessional care. A retrospective look, 5 years after the role was implemented, reveals success factors, challenges and insights that can be utilized for similar and future projects.Method and AnalysisIn 2018 and 2019, a stakeholder‐oriented, participatory evaluation research was conducted to shape the role of the APN in the field of pelvic floor disorders. Ten interviews with internal and external experts in the field of pelvic floor disorder were analysed by thematic qualitative text analysis according to Kuckartz. A comparison between the original and the current profile illustrates its further development. Internal controlling shows the workload and number of patient contacts over the years 2018 to 2023. From a management perspective, the organizational and professional policy challenges are highlighted.ResultsIn 2018, the APN's scope of practice was described in eight areas, which were assigned to four APN competencies: direct clinical practice, collaboration, counselling, and evidence‐based practice. In 2022, 1211 different patient cases were treated in 1956 APN consultations. 64% of patients were women with interstitial cystitis. The focus was on direct clinical practice along the entire treatment pathway. The APN is predominantly the first and ongoing point of contact and coordinator of interprofessional treatment. The APN focuses on counselling and educating patients and their relatives, in particular on self‐management, for example, on the use of aids and the importance of self‐care. The number and complexity of the diagnostic and treatment interventions carried out by the APN have increased and are supported by expanding and extending competencies. The difficulty of recruiting nurses with a Master's degree, the legally unclear competence profile of APNs and the lack of cost coverage for APN services posed challenges in the development of this patient‐centred care model and required innovative solutions.DiscussionThe initially assumed scope of practice of the APN is still evident 5 years after implementation but is constantly evolving. Although delegated medical activities are carried out by the APN, the focus remains on the original nursing competences. The increase in the number of patients indicates the need for and successful establishment of the care model presented. Professional policy changes are urgently needed to enable the development of patient‐centred, innovative APN roles, both financially and legally.

Test, evidence, transition projects in Scotland: developing the evidence needed for transition of effective interventions in cancer care from innovation into mainstream practice

BackgroundA robust evidence base is required to assist healthcare commissioners and providers in selecting effective and sustainable approaches to improve cancer diagnosis and treatment. Such evidence can be difficult to build, given the fast-paced and highly pressured nature of healthcare delivery, the absence of incentives, and the presence of barriers in conducting pragmatic yet robust research evaluations. Cancer Research UK (CRUK) has played an active part in building the evidence base through its funding of programmes to identify, evaluate and scale-up innovative approaches across the UK. The aim of this paper is to describe and explain the research design and intended approach and activities for two cancer services improvement projects in Scotland funded by CRUK.MethodsA hybrid effectiveness-implementation study design will assess both the efficiency of the new pathways and their implementation strategies, with the aim of generating knowledge for scale-up. A range of implementation, service and clinical outcomes will be assessed as determined by the projects’ Theories of Change (ToCs). A naturalistic case study approach will enable in-depth exploration of context and process, and the collection and synthesis of data from multiple sources including routine datasets, patient and staff surveys, in-depth interviews and observational and other data. The evaluations are informed throughout by a patient/public representatives’ group, and by small group discussions with volunteer cancer patients.DiscussionOur approach has been designed to provide a holistic understanding of how (well) the improvement projects work (in relation to their anticipated outcomes), and how they interact with their wider contexts. The evaluations will help identify barriers, facilitators, and unanticipated consequences that can impact scalability, sustainability and spread. By opting for a pragmatic, participatory evaluation research design, we hope to inform strategies for scaling up successful innovations while addressing challenges in a targeted manner.

Evaluation of The Social Care Program of Regional Leadership Council Partai Amanat Nasional (PAN) of Batu City in Spraying Disinfectants

This study aims to produce an Evaluation of Care Program in spraying Disinfectant to Prevent the Spread of Corona Virus by the Regional Leadership Council (DPD) Partai Amanat Nasional (PAN) of the Batu City. The method used in this study is a qualitative research method. Data collection techniques by observation, interview and documentation. The model used is non participatory evaluation research. The results of this study are programs run by the Regional Representative Council (DPD) of the partai Amanat Nasional (PAN) of Batu City in the form of a social care program for spraying disinfectants to prevent the spread of the corona virus through inanimate objects in the Batu City area. because of their initial goal of doing this program for the hurricane and foundations in the Batu City area, when residents heard that spraying was being done by the Regional Representative Council (DPD) of Partai Amanat Nasional (PAN) of Batu City, enthusiastic attitudes of the community immediately arose to ask for spraying in the village they were so Regional Representative Council (DPD) Partai amanat Nasional (PAN) of Batu city experienced constraints in the volunteer workforce.

Managing Diversity: The Challenges of Inter-University Cooperation in Sustainability Education

One of the main challenges in sustainability discourse is its multifaceted nature often requiring that many different disciplines must cooperate in order to achieve progress. This issue also concerns sustainability education. In the article, we highlighted the experiences from the international cooperation of university teachers and researchers with highly diverse professional backgrounds who worked together on developing educational materials for university students in sustainability-oriented courses. The study is based on qualitative, participatory evaluation research, applying two rounds of open-ended questionnaires distributed to the same respondents (n = 18). For the analysis, we used the open-coding procedure for identifying the main categories. The results show some of the opportunities and barriers that emerged in the process of this cooperation. In particular, we discuss the issues related to the high heterogeneity of the group, such as the clashes of the different perspectives on the topics covered, group dynamics issues, trust, facilitation challenges, and also opportunities that such heterogeneity offers. We highlight the importance of open reflectivity in sustainability-oriented educational projects as the key to their successful implementation. Finally, we believe that results of this participatory study are useful in designing new projects aiming at further improvement of academic education in sustainability and sustainable development.

Il ruolo della soddisfazione degli utenti nella valutazione partecipata: l'esperienza del Piano di Zona "Anglona-Coros-Figulinas" in Sardegna

In recent years, the question about the role of evaluation research concerning the local social policies planning has gained more and more centrality into the national debate. This paper intends to give an account of the results obtained from a survey on social-health service users satisfaction (realized within a participatory evaluation research) provided in an Area Plan in northern Sardinia. The author argues that the detection of the user satisfaction of social-health services can be understood as the first step of a participatory evaluation procedure that helps and supports the analysis of the planning process of the Area Plan. The main aim of the user satisfaction survey within the participatory evaluation research is to provide useful information to the drafting of the next three-year planning document of the Area Plan.

Programa de refuerzo educativo en centros socioeducativos para niños y adolescentes en riesgo de exclusión social

Objetivos. Valorar el nivel de impacto del programa en los niños y adolescentes que participan y ofrecer propuestas de mejora y herramientas de carácter pedagógico. Metodología. La metodología utilizada en el estudio ha sido la investigación evaluativa de carácter participativo. Han participado 12 centros socioeducativos. Se han realizado 19 entrevistas (a profesionales, familias y otros agentes implicados en el proceso), 20 observaciones y 58 cuestionarios (a profesionales y voluntarios). Resultados. Los resultados del proceso de investigación se han ordenado en 4 apartados: a) Características que poseen los centros y los programas, según los agentes entrevistados; b) Causas del fracaso escolar; c) Potencialidades y dificultades que presentan los programas de refuerzo educativo y d) Impactos del programa en los niños, adolescentes y familias.Conclusiones. A) Los PRE permiten llevar a cabo actuaciones especializadas que posibilitan diagnosticar, implementar y evaluar procesos de desarrollo escolar; B) La incorporación de metodologías y acciones adaptadas a las necesidades de los participantes y favorecer la creación de climas positivos para el aprendizaje, son factores clave para el éxito de los procesos; C) El trabajo integral permite a los participantes configurar habilidades orientadas a dominar las materias académicas, y también habilidades y herramientas que les permitirán superar retos y aprovechar las oportunidades que se les presenten en sus trayectorias vitales; D) El trabajo conjunto y colaborativo entre el centro socioeducativo, la escuela, la familia y otros agentes de la comunidad permite ofrecer respuestas de carácter integral en relación al fracaso escolar; E) Necesidad de ofrecer a los profesionales propuestas formativas orientadas al aprendizaje de didácticas especializadas, dirigidas a niños y adolescentes que presentan especiales dificultades de carácter cognitivo y conductual; F) Necesidad de contar con un modelo pedagógico que oriente el trabajo educativo integral de los educadores a nivel conceptual y procedimental.

Participación infantil y construcción de la identidad del sujeto

Objetivos. Estudiar cómo el paso por experiencias intensas y genuinas de participación vividas en escuelas participativas, en centros de tiempo libre educativo y en consejos escolares, durante la infancia, pueden favorecer la construcción de la identidad individual y social de los niños y adolescentes, así como sus posteriores trayectorias participativas. Metodología. La metodología utilizada ha sido la investigación evaluativa de carácter participativo, con una muestra de 677 individuos, mediante técnicas cuantitativas (cuestionario) y 29 individuos mediante técnicas cualitativas (entrevistas en profundidad y grupos de discusión). Resultados. Se presentan los principales resultados obtenidos en relación con la influencia en la construcción de identidades que dichas experiencias han tenido, especialmente en aspectos como: la configuración del carácter y la personalidad, las relaciones con los amigos y con otras personas, en la conducta ciudadana, la vida asociativa y el compromiso social de los sujetos analizados. Conclusiones. Los contextos socioeducativos donde viven los niños/as y adolescentes su vida cotidiana, como son la escuela, los centros de tiempo libre educativo y ocio y los consejos infantiles, se configuran como espacios y estructuras educativas que pueden favorecer intensamente o no la vivencia y el aprendizaje de la participación, constituyéndose la experiencia participativa infantil en un eje clave para la construcción de la identidad, especialmente en lo referente a aspectos relacionados con: 1) la configuración del carácter y la personalidad: en su manera de ser y pensar, en sus relaciones de amistad y con otras personas y 2) la construcción de su identidad ciudadana, en cuanto a su influencia en la conducta ciudadana y cívica, en la vida asociativa y en el compromiso en cuestiones sociales.

Evaluation criteria for participatory research: insights from coastal Uruguay.

Participatory research in which experts and non-experts are co-researchers in addressing local concerns (also known as participatory action research or community-based research) can be a valuable approach for dealing with the uncertainty of social-ecological systems because it fosters learning among stakeholders and co-production of knowledge. Despite its increased application in the context of natural resources and environmental management, evaluation of participatory research has received little attention. The objectives of this research were to define criteria to evaluate participatory research processes and outcomes, from the literature on participation evaluation, and to apply them in a case study in an artisanal fishery in coastal Uruguay. Process evaluation criteria (e.g., problem to be addressed of key interest to local and additional stakeholders; involvement of interested stakeholder groups in every research stage; collective decision making through deliberation; and adaptability through iterative cycles) should be considered as conditions to promote empowering participatory research. Our research contributes to knowledge on evaluation of participatory research, while also providing evidence of the positive outcomes of this approach, such as co-production of knowledge, learning, strengthened social networks, and conflict resolution.

Investigación-acción participativa: el cambio cultural con la implicación de los participantes

Conducting research from a community perspective, using a participatory, committed approach open to change with all those involved from the outset, implies having to relocate research beyond the traditional boundaries of academia.However, if we really want research to be of service to society, to another kind of society based on principles of solidarity, democracy, justice and the common good, we must construct a form of research which is consistent with the model of society we are aiming for.Hence, in this article we report the results of participatory evaluation research conducted over four years in a school, which was aimed at changing and improving its organisation and operation in an endeavour that involved the entire school community.

Testing the reliability and efficiency of the pilot Mixed Methods Appraisal Tool (MMAT) for systematic mixed studies review

Background Systematic literature reviews identify, select, appraise, and synthesize relevant literature on a particular topic. Typically, these reviews examine primary studies based on similar methods, e.g., experimental trials. In contrast, interest in a new form of review, known as mixed studies review (MSR), which includes qualitative, quantitative, and mixed methods studies, is growing. In MSRs, reviewers appraise studies that use different methods allowing them to obtain in-depth answers to complex research questions. However, appraising the quality of studies with different methods remains challenging. To facilitate systematic MSRs, a pilot Mixed Methods Appraisal Tool (MMAT) has been developed at McGill University (a checklist and a tutorial), which can be used to concurrently appraise the methodological quality of qualitative, quantitative, and mixed methods studies. Objectives The purpose of the present study is to test the reliability and efficiency of a pilot version of the MMAT. Methods The Center for Participatory Research at McGill conducted a systematic MSR on the benefits of Participatory Research (PR). Thirty-two PR evaluation studies were appraised by two independent reviewers using the pilot MMAT. Among these, 11 (34%) involved nurses as researchers or research partners. Appraisal time was measured to assess efficiency. Inter-rater reliability was assessed by calculating a kappa statistic based on dichotomized responses for each criterion. An appraisal score was determined for each study, which allowed the calculation of an overall intra-class correlation. Results On average, it took 14 min to appraise a study (excluding the initial reading of articles). Agreement between reviewers was moderate to perfect with regards to MMAT criteria, and substantial with respect to the overall quality score of appraised studies. Conclusion The MMAT is unique, thus the reliability of the pilot MMAT is promising, and encourages further development.

Youth Voices: Evaluation of Participatory Action Research

Abstract: When conducted with sensitivity and reflexivity, participatory action research (PAR) can be an empowering process that is particularly relevant for engaging young people in reflection and dialogue for social change. As the theory and practice of PAR evolve, researchers have evaluated the experiences of community participants, using both qualitative and quantitative approaches. However, only a limited number of evaluations have focused on PAR processes undertaken with youth, and few published papers have reported on involving youth in the evaluation. This article addresses the process of enabling youth to participate to their fullest ability in an evaluation of a PAR project called Youth Voices. The analysis draws on feedback questionnaires from community evaluators, minutes and notes from team meetings, and the researchers’ experiences and observations. The authors reflect on lessons learned that can be helpful to others considering participatory evaluation research with youth. The study revealed limitations in employing participatory evaluation with at-risk youth, including challenges posed by their psychosocial development and maintaining participants’ engagement throughout the processes of participatory evaluation. These lessons shed light on key tensions in using participatory evaluation and challenge the implicit assumption that a higher level of participation is necessarily better when working with youth. A central question is posed: What level of participation is optimal to ensure authentic community decision-making in a PAR project without overwhelming youth participants?

Parents’ Perceptions of Motor Interventions for Infants and Toddlers with Down Syndrome

The purpose of the study was to analyze parents' perceptions of their participation in a university-directed, parent-implemented, home-based pediatric strength intervention program as (a) one approach to evaluating the effectiveness of a program conducted over a 4-year period with families of infants and toddlers with Down syndrome and (b) a means of deriving guidelines for future early intervention programs. Participants were 22 parents from 11 families of children with Down syndrome; the children ranged in age from 6 to 42 months. Participatory evaluation research, semistructured audio recorded home interviews, and qualitative content analysis were used. The results indicated that the parents (a) perceived themselves as being empowered to implement the program, (b) perceived their expectations about improved motor development of their children had been met, and (c) perceived the program was worthwhile. The parents' perceptions provided meaningful evaluation data that enabled the development of guidelines for future pediatric strength intervention programs.

Participatory evaluation research: an introduction for family therapists.

Participatory evaluation research empowers the consumers of services to become leaders in evaluation and change. Participatory research methods have been used widely in developing countries and are consistent with family therapy's recent emphasis on non-hierarchical, empowering, collaborative therapies. In this paper, the authors present several examples of participatory evaluation methods and discuss their applicability to the work of family therapists.