Qualitative Evaluation Of Impact Research Articles

“The Problem’s Too Big for Us”: The Promises and Perils of Community-Corrections Partnerships

ABSTRACT The present study uses the results of semi-structured interviews and participant observation with non-uniformed correctional staff and administrators in eight U.S. state prison systems to examine community-corrections partnerships in the areas of education, vocational training, reentry preparation, and psychosocial wellbeing. Through analysis derived from literature on the “what works” movement in corrections, volunteerism in prison, and correctional outsourcing, our findings suggest that community-corrections partnerships can provide a sense of purpose and hope for incarcerated individuals, support reentry preparedness, and reestablish community connections. However, such partnerships also generate challenges related to institutional capacity, security, and conflicting interests. Our findings suggest that correctional staff and administrators should incorporate qualitative impact evaluation methods describing how and why programs work, adopt LEAN methods of volunteer management, and support a human services lens regarding staff roles.

Nature documentaries as catalysts for change: Mapping out the ‘Blackfish Effect’

Abstract It is essential for us to understand what drives human behaviour if we want to tackle anthropogenic damage to the environment. Popular media can play an important role in shaping public attitudes, behaviours and norms towards wildlife, and documentaries in particular have become an increasingly prominent tool for social change. There is, however, a need for robust impact evaluation both in documentary‐making and in conservation, to refine future interventions. The 2013 documentary Blackfish portrayed human–orca interactions at the US‐based marine park, SeaWorld. Following its release, SeaWorld suffered financial difficulties and the company underwent structural changes, including a cessation of its orca breeding programme. These impacts have often been attributed to the Blackfish documentary, but little evidence has been provided to justify these claims. We combined an analysis of stock market data and semi‐structured interviews with 26 key informants to build an in‐depth contribution analysis. We used General Elimination Methodology, a qualitative impact evaluation methodology to build an understanding of the impact of Blackfish. We found a consensus among stakeholder groups that Blackfish induced negative publicity for SeaWorld and a change in people's perceptions of captivity. As a result, attendance at the park decreased and the market value of the company dropped. Blackfish catalysed a whole movement against marine mammal captivity. There were three key factors that led to its impact: the support from major distribution channels which allowed it to reach major audiences, emotional impact of the content and timing of its release. Blackfish benefitted from a perfect storm, building upon decades of activism to create an appropriate cultural climate for its release in 2013. A free Plain Language Summary can be found within the Supporting Information of this article.

The effect of medical social and social economic factors on development of disability in children

The trends in economic situation requires periodic repetition of studies concerning qualitative evaluation of impact of medical, social and economic factors on population health at the regional level. The purpose of the study is to establish the relationship between the disability of children and the main medical, social and socioeconomic indices in the Russian Federation. The materials and methods. The official data on prevalence of disability in children of 0-17 years and the level of basic medical, social and socioeconomic indices were analyzed in the context of 83 subjects of the Russian Federation in 2017-2019. The demographic and epidemiological data and data on medical care support of children population were used as medical and social indices. The socioeconomic indices (unemployment rate, cash income, housing conditions and consumption of basic food products were used as the socioeconomic indices. The Spearman rank correlation method was used to determine the particular relationships. The results. It was established that the significant inter-regional variability of disability of children both in the Federal Okrugs and the subjects of The Russian Federation persists. The relationship of various degrees of intensity between the prevalence of disability of children in the subjects of the Russian Federation and many medical, social and socioeconomic factors such as demographic indices (fertility, mortality); level of primary and total morbidity of children of all age groups; medical care support (medical personnel, pediatric beds); unemployment level; average per capita cash income; percentage of population with cash incomes below cost of living; total area of residential premises that is on average per inhabitant; share of young families registered as needing housing from total number of families with children aged under 18 years; consumption of cheaper food. The conclusion. The obtained results are to be taken into account in the development of programs of preventing disability of children avoiding to place full responsibility on the health care system only.

Patient involvement in cardiovascular research: a qualitative impact evaluation

Background & ObjectiveInvolving patients in scientific research has been shown to improve the relevance of the research, as well as its quality and applicability. Harteraad, the Dutch patient organization for people with cardiovascular diseases, has a Committee of Experienced Experts (patients) advising researchers on the content of grant proposals prior to submission. Until now, the impact of the committee’s advice was unknown. This study, initiated by Harteraad, aimed to evaluate the impact of the provided advice on the content of grant proposals and investigate how to strengthen this impact.MethodsFourteen grant proposals both prior to and after receiving the committee’s advice were compared in order to analyse how the advice had been incorporated into the final proposal. Subsequently, 10 researchers who received the committee’s advice were interviewed. Moreover, a focus group discussion was conducted with five committee members.ResultsDocument analysis showed that almost 40% of the advice was incorporated in the final grant proposals. Researchers made several changes to their proposals, such as increasing the extent of patient involvement throughout the research, use of simpler language, and/or adding information on the consequences of an intervention for patients. Advice requiring fundamental changes in the research design was most often not incorporated. This finding was confirmed by the interviewees, although some stressed to use the committee’s advice later on during the execution of the research. According to the interviewees and members of the committee, the impact of the committee’s advice could be strengthened in several ways, including 1) improving training/education for researchers and the committee, 2) organizing dialogues between patients and researchers, 3) aligning perspectives between funding bodies and patient organizations on what is expected from researchers, 4) making it obligatory for the researchers to clarify how the patient’s advice was incorporated, and 5) fostering researchers’ internal motivation for involvement. Committee members have contributed to implementing these recommendations.ConclusionThe committee’s advice has considerable impact on the content of grant proposals. However, effort is required to increase the value that is currently attributed to patient involvement, and to support researchers in the required organizational and cultural changes to meaningfully involve patients in research.

A Qualitative Evaluation of Impact and Implementation of a Theater-Based Sexual Health Intervention in Los Angeles High Schools

Although theater-based interventions have emerged as an innovative health education platform, more research is needed to understand how these interventions work and to identify factors that make them successful and replicable in adolescent populations. This paper discusses the first research project conducted on High School Sex Squads (HSSS), which use monologues, skits, songs, dance, spoken word, and other forms of performance art to approach broad topics related to sex, sexuality, and gender. Using focus groups with students and key informant interviews with adult stakeholders, this pilot study explores HSSS with a dual focus on program implementation and impact on High School Sex Squad members. These findings will be translated to real-life program improvement to ensure optimal implementation as the program continues to expand.

¿Qué hay tras la permanencia universitaria? Los cambios más significativos en el acompañamiento académico

Resumen El artículo presenta los resultados de una evaluación de impacto cualitativa de los servicios de apoyo académico que brinda la Universidad de Santiago de Chile a través del Programa de Acceso Inclusivo, Equidad y Permanencia (PAIEP). Este programa surge en el 2012 como una política de acción afirmativa que articula y fortalece las iniciativas orientadas al acceso, permanencia y titulación de la Universidad, teniendo dentro de sus funciones brindar apoyo académico a todos los estudiantes de primer año, con un foco especial en los que ingresan mediante vías de acceso inclusivo. El apoyo académico fue evaluado a través de una técnica de evaluación cualitativa denominada el cambio más significativo , que se basa en la recolección de historias sobre los cambios que han experimentado las personas cuando participan de una intervención social. Se llevaron a cabo cuatro talleres evaluativos con estudiantes que tuvieron una alta participación en los servicios de acompañamiento de PAIEP. Los resultados del estudio consisten en los cinco cambios principales que relataron los estudiantes: a) la generación de hábitos de estudio; b) la mejor comprensión de los contenidos de las asignaturas; c) la generación de confianza en sí mismo; d) el mejoramiento del desempeño académico y, por último, e) la contribución a la integración social y universitaria. Finalmente, en la discusión se aborda la contribución de la evaluación al estudio de los servicios de apoyo académico en la educación superior, así como las ventajas y limitaciones de la metodología utilizada.

Qualitative impact evaluation of a social marketing campaign for conservation.

Social marketing campaigns use marketing techniques to influence human behavior for the greater social good. In the conservation sector, social marketing campaigns have been used to influence behavior for the benefit of biodiversity as well as society. However, there are few evaluations of their effectiveness. We devised an approach for evaluating the influences of social marketing campaigns on human behavior and conservation outcomes. We used general elimination methodology, a theory-driven qualitative evaluation method, to assess the long-term impacts of a 1998 Rare Pride campaign on the island of Bonaire that was designed to increase the population of the Lora (Amazona barbadensis), a threatened parrot. We interviewed stakeholder groups to determine their perceptions of the drivers of the changes in the Lora population over time. We used these data to develop an overall theory of change to explain changes in the Lora population by looking at the overlap in hypotheses within and between stakeholder groups. We then triangulated that theory of change with evidence from government reports, peer-reviewed literature, and newspapers. The increase in the Lora population was largely attributed to a decrease in illegal poaching of Loras and an associated decrease in local demand for pet Loras. Decreases in poaching and demand were likely driven by a combination of law enforcement, social marketing (including the Rare campaign), and environmental education in schools. General elimination methodology helped show how multiple interventions influenced a conservation outcome over time. There is a need for evidence-based evaluations of social marketing interventions to ensure that limited resources are spent wisely.

Managing relationships in qualitative impact evaluation of international development: QuIP choreography as a case study

Who does what and when during an impact evaluation has an important influence on the credibility and usefulness of the evidence generated. We explore such choreography from technical, political and ethical perspectives by reflecting on a case study that entailed collaborative design of a qualitative impact evaluation protocol (‘the QuIP’) and its pilot use in Ethiopia and Malawi. Double blind interviewing was employed to reduce project-specific confirmation bias, followed by staged ‘unblindfolding’ as a form of triangulation. We argue that these steps can enhance credibility of evidence, and that ethical concerns associated with them can be addressed by being open with stakeholders about the process. The case study illustrates scope for better use of qualitative impact evaluation methods in complex international development contexts.

A modified household economic portfolio model for assessing impact of microfinance using diaries

PurposeMicrofinance impact evaluation studies help in discovering client needs which are diverse, special and different from the needs of the conventional bankable clients. Thus, such area of market research is becoming essential for microfinance institutions for designing better client-centred products. In this research, the authors discuss the specific model of household economic portfolio (HEP) for qualitative impact evaluation in microfinance. The paper aims to discuss the complexity limitations of the HEP. Solutions are provided for overcoming these limitations. The modified household economic portfolio (M-HEP) model is simplified and detailed, and two types of diaries are suggested for implementing it.Design/methodology/approachFirst, the authors briefly review the literature on impact assessment methods in microfinance and on the HEP model. In the second part of the paper, the M-HEP is suggested and discussed in detail. In the third part, the authors present a case study to illustrate the additional information that can be generated by using our suggested research tool and model. Finally, the authors wrap up with a summary of the findings.FindingsSolutions are provided for overcoming the limitations of the HEP model. The suggested model (M-HEP) is simplified and detailed, and two types of diaries are suggested for implementing it. The case study shows that, certainly, time and money are related. While time may mean money for a rich person, for a poor person, if money is not forthcoming, she may spend time on non-income generating work that adds to her social esteem. She may also consume inexpensive assets because spending time at low cost is important. Finally, she spends time in conducting activities for which she cannot afford to pay.Originality/valueThe paper offers two novelties. First, it details the interactions between the elements of the HEP model of Chen and Dunn. This improvement to the original model is highly important for defining the measures that are required for redrawing the economic portfolio of an individual. The second novelty is in suggesting the collection of time-use and financial daily data. To the best of our knowledge, this is the first time a combined diary is used in microfinance research. These two novelties allow the application of a modified version of the highly interesting HEP model in spite of its complexity.

Bridging the climate information gap: a framework for engaging knowledge brokers and decision makers in state climate assessments

Large-scale analyses like the National Climate Assessment (NCA) contain a wealth of information critical to national and regional responses to climate change but tend to be insufficiently detailed for action at state or local levels. Many states now engage in assessment processes to meet information needs for local authorities. The goals of state climate assessments (SCAs) should be to provide relevant, actionable information to state and local authorities, and to generate primary sources, build networks and inform stakeholders. To communicate local climate impacts to decision makers, SCAs should express credibility, salience and legitimacy. They can provide information (e.g., case studies, data sets) and connect stakeholders to the NCA and its process. Based on our experience in the Vermont Climate Assessment (VCA), we present a framework to engage decision makers in SCAs using a fluid network of scientific experts and knowledge brokers to conduct subject area prioritization, data analysis and writing. The VCA addressed economic, environmental and social impacts of climate change at local scales to increase resiliency and manage risk. Knowledge brokers communicated VCA findings through their own stakeholder networks. We include a qualitative impact evaluation, and believe our framework for interaction among scientists, knowledge brokers and stakeholders to be an effective structure for SCAs and a transformative experience for students.

A Qualitative Impact Evaluation of the First Love Yourself (FLY) Women’s Support Group

Research has shown that social support groups not only have significant effects on the physical and mental health of individuals, but can also be used as predictors of health outcomes. It is, therefore, important that social workers and other public health professionals are aware of the social support groups that exist in communities so as to find ways to utilize these to meet health needs. The study aims to explore the First Love Yourself (FLY) group, an empowerment-based support group specifically designed to meet the needs of Healthy Start consumers, parents and consortium members. A qualitative analysis of the data gathered from this focus group study yielded several key themes. While participants described finding other community resources helpful, they reported having no other outlet for confidential self-expression and connection to peers other than the FLY group. Group members also reported having improved self-esteem, relationships with their children, partners, and family, and ability to cope as a result of participation in the group. Participants further described gaining knowledge and learning skills that were helpful. This included learning parenting, communication, stress and anger management, budgeting, goal-setting and coping skills and techniques. Finally, qualitative analysis of the data gained from the focus group with participants and the group leader revealed the presence of all 11 curative factors described by Yalom (2005). The primary areas for improvement noted by the group and its leader were related to the frequency of group meetings. Both audiences indicated that additional sessions would be beneficial.

Impact evaluation of a health promotion-focused organisational development strategy on a health service's capacity to deliver comprehensive primary health care.

A comprehensive primary health care approach is required to address complex health issues and reduce inequities. However, there has been limited uptake of this approach by health services nationally or internationally. Reorienting health services towards becoming more health promoting provides a mechanism to support the delivery of comprehensive primary health care. The aim of this study was to determine the impact of a health promotion-focused organisational development strategy on the capacity of a primary health care service to deliver comprehensive primary health care. A questionnaire and semistructured individual interviews were used to collect quantitative and qualitative impact evaluation data, respectively, from 13 health service staff across three time points with regard to 37 indicators of organisational capacity. There were significant increases in mean scores for 31 indicators, with effect sizes ranging from moderate to nearly perfect. A range of key enablers and barriers to support the delivery of comprehensive primary health care was identified. In conclusion, an organisational development strategy to reorient health services towards becoming more health promoting may increase the capacity to deliver comprehensive primary health care.

Patient involvement in clinical research: a qualitative evaluation of impact

Context The RESTORE programme comprises a randomised controlled trial, three pilot trials, a cohort study, qualitative studies and systematic reviews. Since 2010, the patient panel (PEP-R), has inputted into RESTORE. Seventeen patients have been involved in total, 8 were recruited at the time of the evaluation. Through facilitated group sessions, PEP-R provides input into refinement of patient recruitment materials, intervention development, readability of outcome assessment tools, and dissemination of findings. Patients also sit on steering groups and receive training.