Project Evaluation Research Articles

Impact of Project Planning, Monitoring And Evaluation on the Sustainability of the Millennium Village Project in Pampaida, Ikara Local Government Area of Kaduna State Nigeria

The sustainability of a project refers to the capability of a project to retain its usage over the long term. The Millennium Village Project (MVP) in Pampaida was purposely initiated to alleviate over 70% of the populace from poverty. The study examined how project planning, monitoring and evaluation influenced its sustainability, adopting the participatory and the stakeholders’ theory with the involvement of donors, government, and the community people in achieving the set goals and objectives of the Project – poverty reduction. The study applied the mixed method research technique –qualitative leading and corroborated by quantitative. We selected 368 people from the community as respondents from the 28 settlements of Pampaida to provide us with the data through structured questionnaires, interviews, focused group discussions and systematic observations. The statistical tools used in the analysis were; simple percentages, frequency tables, mean, standard deviation, and the application of the SPSS version 26 for inferential statistics while using Linear Regression Technique to test the hypothesis. In the research, hypotheses were framed in null forms to address the objectives of the study and were tested statistically, which corroborated the use of thematic analysis of interviews and observations of the research. The study found that project planning, monitoring and evaluation were significant factors that positively affect the sustainability of MVP projects. Therefore, the study recommends that; the government prioritize effective, structured and comprehensive project planning to guide the project objectives. In terms of Project execution maintenance and support, feedback mechanism and capacity-building initiative, the community needs to establish committees to implement a robust and rigorous monitoring and evaluation system.

Measurements of the absolute gamma-ray emission intensities from the decay of 166Ho

166Ho (T1/2≈ 26.8 h) is an emerging theragnostic radionuclide of interest in nuclear medicine due to its peculiar decay scheme, featuring high-energy β− emission (≈ 1.8 MeV) coupled with the main gamma-ray emission (≈ 80.6 keV). Using the new 166Ho activity standard and the well-calibrated, high-energy resolution HPGe detector, both available at ENEA-INMRI, a new determination of several 166Ho gamma-ray emission intensities, Iγ, was performed with low uncertainty. The new Iγ values contributed to the Decay Data Evaluation Project.

Oxford Spine Buddies: an acceptability and feasibility project for peer-to-peer support in a spine sarcoma service.

Primary bone and soft tissue sarcoma of the spine are rare and account for less than 0.2% of all neoplasm incidences. Following a patient and public involvement event, the need to explore patient support pathways was identified, which initiated this service evaluation project. To determine the acceptability and feasibility of a peer-to-peer support project among people using the spine sarcoma service. Users were paired and introduced via Microsoft Teams. Quantitative and qualitative data both pre- and post-introduction of a buddy were collected. Service users felt that, although they would have preferred having a buddy at the time of their diagnosis, being allocated a buddy made them feel reassured and better supported. The project was well received and preliminary data are encouraging. Therefore, due to early findings from the first participants, the service is continuing to roll out the buddy programme.

Основные подходы в информационном обеспечении проектов на получение государственной поддержки компаниями несырьевого сектора

The relevance of the chosen topic is justified by the need to research and develop measures aimed at reducing the negative impact of the unpredictable environment of the Russian economy in the face of overcoming economic sanctions. One of such measures of state support could be an information system for participants in foreign economic activity, taking into account the main approaches in information support of projects funded from the federal budget. The development of the system is based on marketing research of participants in foreign economic activity. As part of the development of measures of state support, market research includes expert assessment, methods of comparison and grouping, index method, and matrix algebra, i.e., it is based on methods of comprehensive analysis of economic activities. The tools under consideration allow forecasting practical results of project evaluation and analysis receiving state support. In conclusion, by integrating theoretical insights with practical methodologies, stakeholders can navigate complex economic environments and capitalize on emerging opportunities. Moving forward, continued research and innovation in information support systems will be essential for promoting sustainable development and resilience in the face of economic challenges.

Voice Typing to Enhance English Intermediate Level Learners’ Speaking Proficiency: A Case Study

This mixed-methods case study explores the effectiveness of Google Docs’ voice typing feature in enhancing the English oral skills of nine university students at the intermediate level. These university students were selected to utilize voice typing for their end-of-term oral presentations, engaging in two practice sessions each week for six weeks period. Training was provided to ensure proficiency in the use of voice typing. To gauge progress, a qualitative analysis of the data was performed, focusing on any advancements in speaking capabilities, with the students’ final speaking project scores serving as the primary metric for evaluation. Evaluation of the final speaking project was conducted by two teachers, and to validate the assessment process, inter-rater reliability tests were implemented. In addition to the quantitative assessment, qualitative data were gathered through interviews, wherein students conveyed their initial challenges with the voice typing feature, particularly concerning speech recognition inaccuracies. Despite these initial hurdles, participants reported a smoother experience as they became more accustomed to the tool. The study underscores the educational benefits of voice typing and advocates for continued investigation into this promising field, particularly given the rise of Artificial Intelligence technologies adept at accommodating diverse accents and proficiency levels.

Enhancing citizen science impact in environmental monitoring: Targeted engagement strategies with stakeholder groups

Understanding the motivations and benefits of citizen science (CS) participants is critical to the success of environmental science projects that rely on data collection from engaged citizens. Tailored communication with citizen scientists is essential, leading to the need to target specific societal groups for extensive and high-quality data sets. The purpose of the study was to apply marketing concepts such as stakeholder analysis, value proposition canvas (VPC), and key performance indicators (KPIs) to CS projects. The study examined the extent to which these strategies can be applied to CS projects and add value, resulting in improved recruitment and retention of participants, as well as improved project management. The dynamic landscape of CS projects requires adapted business-oriented approaches supporting ongoing participation with high motivation, acknowledging community needs, and recognizing institutional scientists, akin to targeting potential customers. The case study focuses on the CityCLIM initiative, an EU-funded project collecting urban climate data, especially air temperature, using mobile weather stations. The CityCLIM VPC, analyzing stakeholder groups, facilitated tailored communication strategies by analyzing stakeholder groups and highlighting the effectiveness of the CS cycling initiative within the “Stadtradeln” program. Impact KPIs served as a roadmap for strategic refinement, while data quality KPIs identified deficiencies, guiding adjustments to the campaign. Applied marketing tools improved project planning, engagement, and evaluation, demonstrating the potential of this concept. Adapting marketing tools to recruitment and communication strategies benefits CS projects by targeting specific groups. The holistic integration of stakeholder analysis, VPC, and KPIs streamlines project management and creates a framework for sustainable success. This adaptation forms a robust toolkit for CS project coordinators, contributing to effective communication, engagement, and impact assessment. Applying marketing tools significantly increases CS projects’ reach and impact, ensuring long-term success and meaningful scientific contributions.

PUBLIC SPACES: DIFFERENT SCALES AND EMPHASES IN YURI SEROGIN'S PROJECTS

In today's world, public projects are becoming not only an important component of the architectural landscape, but also a key factor in shaping living spaces and communities. They play a significant role in promoting social interaction, cultural exchange, and stimulate the development of social ties. Thoughtful design of public spaces involves not only ensuring functionality and aesthetic appeal, but also an in-depth analysis of the needs of local communities, taking into account historical and cultural features and unique requirements. Ukraine, as a country with a rich cultural heritage and diverse communities, has great potential for the development of public projects. Their existence is reflected in a variety of forms: from city squares and parks to culture and sports centers. The grateful synergy between architects, local authorities, and the public contributes to the creation of innovative and socially significant projects that contribute to the rapprochement and development of communities. This article explores the public projects of the architect Yuri Seryogin, which reflect his contribution to the development of the architectural scene and public space. Using the analysis and evaluation of projects, the article offers coverage of key aspects of the architect's work, his approaches to solving architectural problems, and his impact on society.

Long-Term Adherence to Continuous Positive Airway Pressure in Patients with Obstructive Sleep Apnoea Set Up in a Complete Remote Pathway: A Single-Centre Service Evaluation Project.

Background: Continuous positive airway pressure (CPAP) is the first-line treatment for obstructive sleep apnoea (OSA). Maintaining adherence to CPAP in the long term is a clinical problem, and numerous factors have been identified that impact adherence. Although fully remote diagnostic and CPAP services were frequently utilised during the COVID-19 pandemic for patients with OSA, long-term adherence data have not been published. The aim of this service evaluation project was to describe the long-term adherence to CPAP. We also analysed factors that are associated with it. Methods: two-hundred and eighty patients diagnosed with OSA and set up on CPAP remotely during the first wave of the COVID-19 pandemic as part of routine clinical practice were analysed. Results: One-hundred and seven patients (38%) were fully adherent to CPAP at 24 months, determined by at least 4 h of usage on at least 70% of the days. Of the factors analysed, body mass index, disease severity, driving status and the presence of depression were related to long-term adherence (all p < 0.05). Conclusions: with the likelihood of future pandemics similar to COVID-19, our data provide evidence that fully remote pathways for management of patients with OSA can be designed and be sustainable with good long-term adherence.

An assessment of federal alcohol policies in Canada and priority recommendations: Results from the 3rd Canadian Alcohol Policy Evaluation Project

ObjectiveTo systematically assess the Canadian federal government’s current alcohol policies in relation to public health best practices.MethodsThe 2022 Canadian Alcohol Policy Evaluation (CAPE) Project assessed federal alcohol policies across 10 domains. Policy domains were weighted according to evidence for their relative impact, including effectiveness and scope. A detailed scoring rubric of best practices was developed and externally reviewed by international experts. Policy data were collected between June and December 2022, using official legislation, government websites, and data sources identified from previous iterations of CAPE as sources. Contacts within relevant government departments provided any additional data sources, reviewed the accuracy and completeness of the data, and provided amendments as needed. Data were scored independently by members of the research team. Final policy scores were tabulated and presented as a weighted overall average score and as unweighted domain-specific scores.ResultsCompared to public health best practices, the federal government of Canada scored 37% overall. The three most impactful domains—(1) pricing and taxation, (2) marketing and advertising controls, and (3) impaired driving countermeasures—received some of the lowest scores (39%, 10%, and 40%, respectively). Domain-specific scores varied considerably from 0% for minimum legal age policies to 100% for controls on physical availability of alcohol.ConclusionMany evidence-informed alcohol policies have not been adopted, or been adopted only partially, by the Canadian federal government. Urgent adoption of the recommended policies is needed to prevent and reduce the enormous health, social, and economic costs of alcohol use in Canada.

Evaluating the Environmental Impact of Anthropogenic Activities on Human Health: A Systematic Review

Evaluating the Environmental Impact of Anthropogenic Activities on Human Health: A Systematic Review

Effect of Monitoring and Evaluation Practices and Urban Water Sustainability Project in Rwanda: A Case of WASAC Project in Kigali City

In Rwanda, projects failure is caused by lack of Monitoring and Evaluation staff trainings, technical expertise, design/approach, low level stakeholder involvement, lack of proper planning, lack of supportive supervision, insufficient financial management and poor leadership on feasibility and sustainability project. The general objective of the study is to assess monitoring and evaluation practices and urban water sustainability project in Rwanda. A case of WASAC project in Kigali city and the specific objectives of the study were to assess the influence of project monitoring and evaluation planning on urban water sustainability project in Rwanda, to assess the influence of monitoring and evaluation stakeholders involvement on urban water sustainability project in Rwanda and to determine the effect of monitoring and evaluation trainings on urban water sustainability project in Rwanda. The study was based on two theories such as theory of change and theory of constraints. In this study, a descriptive research design was used and the targeted population includes project management team, project monitoring and evaluation officials, project analysts and engineers. In total they were184 from whom a sample size of 126 was selected as representative of total population. Therefore, a simple sampling technique will be used and data will be collected using questionnaire, interview and documentation. The analysis of data will be done through SPSS version 21. The study findings showed that stakeholders’ involvement is essential in achieving urban water sustainability in the way that M&amp;E planning contribution is at the mean of 3.908 and standard deviation of 0.755, stakeholders involvement contributed to urban water sustainability at the mean of 3.275 and standard deviation of 0.642 while M&amp;E trainings has contributed to urban water sustainability at the mean of4.505 and standard deviation of 0.720 The study found that there are continuous M&amp;E trainings and development of the project staff to acquire skills to implement the project. The study recommended that effective project planning need to be put in place by the project team and managers. Project team should ensure their monitoring and evaluation control plan align with M&amp;E plan. The study recommends a sound stakeholders’ involvement at each phase of the project from initial phase to execution. Keywords: Monitoring and Evaluation, Urban Water Sustainability, WASAC, Project Management, Kigali City Infrastructure

A Cloud- and Game Model-Based Approach to Project Evaluations of Sustainable Power Supply Investments

In light of electrical energy’s increasing role in economic systems worldwide, prioritizing investments in sustainable power supplies has become paramount. This study proposes a model based on cloud theory and game theory to evaluate sustainable power supply investment projects. It establishes a foundation for assessing the merits of power supply investments, which are crucial for continuous electricity provision and economic advancement. By integrating an enhanced analytic hierarchy process and the entropy method, the study develops a dual-weighted evaluative index system. This hybrid approach addresses ambiguities and enhances the weight determination accuracy, which, when applied to the Liaojiawan Transformer Substation, verifies the project’s high benefit level, corroborated by empirical data. This innovative methodology offers a strategic framework for future power supply investments.

Co-creating with students to promote science of learning in higher education: An international pioneer collaborative effort for asynchronous teaching

Recent insights from Science of Learning (SoL) are informing instruction, training, and curriculum. Here, we present a project on promoting SoL-related content through co-creating online asynchronous learning resources. By building a 7-person cross-institution team, we strategically harnessed (1) student-faculty partnerships as a mechanism to promote training and professional development, (2) co-creation as a model to curricula development, (3) blended asynchronous learning as a modality for content delivery, and (4) internationalization as a strategy to embrace globalization. This co-creation of curricula project included three stages—literature review, design and production, and evaluation. The project evaluation deployed a mixed methods approach with 6 student evaluators across both participating institutions, who explored the effectiveness of the learning resources. In addition, student partners contributed reflective statements on their co-creation experience. This paper reports on the procedural pipeline to co-creation and the project evaluation, as well as on new insights emerging for curriculum development. We conclude that project's co-created learning resources may enhance effectiveness of instructional design and students’ learning experience. Further, we demonstrate that student partners acquire new knowledge and research, design and delivery skills, futureproofing their academic progression.

Impact of Nutritional Education Intervention on Food Choice Motivations and Eating Behaviors Among Latin American University Students

ABSTRACT Background Nutritional interventions can help to develop healthy eating patterns during the transition to university, which is a critical transition for all college students. Purpose This research aims to analyze eating behaviors and food choices through sustainable nutritional education interventions with college students from a multinational university in Latin-America. Methods The nutritional intervention had eight sessions emphasizing lifestyle nutrition patterns. There was an intervention group (n = 85), and a control group (n = 80). This research evaluated the eating behaviors and food choice motivators before and after the intervention. Results The nutrition education interventions showed that the group under intervention improved, changing from unhealthy to moderately healthy habits, whereas the control groups remained in unhealthy eating behaviors. Food choice motivations slightly differ from the two groups after the intervention. Discussion The control group students reflected on their lack of awareness of good eating habits so that current trends could influence their food choices in social networks associated with the pandemic, economic factors, and supply. Translation to Health Education Practice The findings from this research highlight opportunities for Certified Health Education Specialists focused on project development and evaluation.

COST-EFFECTIVENESS ANALYSIS (CEA) OF A TOBACCO INITIATION INTERVENTION FOR COLLEGE STUDENTS IN TÜRKİYE

Economic evaluation is essential for the efficient use of public resources and, especially, for the scale-up Economic evaluation is essential for the efficient use of public resources and, especially, for the scale-up decisions of the new programs. This study provides a full economic evaluation of a 27-month tobacco control project for college students in Ankara, Türkiye. Tobacco use is costly due to disease/disability, premature death, and associated economic burden. Tobacco use among young adults is of particular concern in Türkiye because of rising prevalence in recent years. The study calculates the sample and population level relative cost-effectiveness ratio (CER) using recall for the interventions implemented in the project. Study found that while the sample-level CER for recall was ₺680,91 and for prevented initiation was ₺2,138.05, the extrapolated CERs were ₺34,96 and ₺105.44, respectively. Reponse to a direct cross-check project effectiveness question in the questionnaire indicated that the project prevented the initiation of 571 never-smoked students. Given this, prevented initiation CER is ₺2,289.18, which is quite similar to survey aggregate CER of ₺2,138.05 for preveneted initiation. Study also found that booth administered during special day was the most cost-effective intervention item while short videos were the least cost-effective ones. The findings of the study will better guide resource allocation and will be instrumental in policy decisions for scaling up the project to all higher education institutions in Türkiye.

Uranium-zirconium hydride nuclear fuel performance in the NaK-cooled MARVEL microreactor

The Microreactor Applications Research Validation and EvaLuation (MARVEL) Project is producing a high temperature NaK-cooled nuclear reactor test bed at the Idaho National Laboratory to ultimately improve integration of microreactors to end-user applications. This ambitious effort seeks to design, authorize, construct, test, and operate the reactor within five years. The computational software package chosen for high fidelity fuel performance modeling, BISON, has been upgraded to model the performance of the MARVEL reactor's selected fuel system: 304 stainless steel-clad U-ZrHx. In this manuscript, we begin by describing the MARVEL fuel element. The known properties and relationships of the fuel element constituents are recapitulated from data available in the literature. These historical relationships assume a particular U-ZrH microstructure which previously was not well-understood; therefore, the fuel's microstructure is experimentally confirmed using electron microscopy and X-ray diffraction. This information is then used to analyze the thermomechanical performance of the MARVEL fuel element during a hypothetical extreme accident scenario (a loss of flow accident during a loss of coolant pressure accident) using the nuclear fuel performance code BISON. The analysis shows that the primary phenomenon which could compromise the structural integrity of the MARVEL fuel element is the same as for TRIGA reactors: high temperature internal gas overpressurization-induced rupture of the cladding arising from excessive hoop stresses. Despite modeling the most severe MARVEL accident scenario, the highest anticipated temperature in the fuel, about 718 °C, results in hoop stresses of less than 10 MPa. Based on this analysis, a conservative steady state fuel meat temperature limit of 900 °C precludes cladding damage. The newly incorporated fuel performance simulation capabilities developed in this work may also be extended to model this fuel system under other conditions or reactors.

A Web-Based Assessment and Evaluation System for Architectural Design Studio Modules

Architectural design studio modules are known to be difficult to teach and/or assess. To acquire design skills, typically, students have several design modules during their program and several projects for each module. However, traditional project assessment and evaluation lacks consistency, objectivity and fairness. Furthermore, monitoring student progress over the different projects and over the different modules and different semesters is very difficult and needs much time and effort. This work presents a web-based system developed to support fair rubrics-based assessment and evaluation of design projects and to provide in-depth analysis of students' results. It also links between the results over the different projects and the different modules and provides feedback about students' skills and weaknesses in a simple form thus allowing progressive learning. The system has been tested and evaluated and the results show its simplicity, reliability and effectiveness.

Practical Applications of a Participatory Science Project Evaluation Tool: Perspectives from Across Earth and Space Science

While traditional science often focuses on peer-reviewed scientific publications and citations to gauge efficacy, citizen science projects, also called participatory science projects, span a broader range of goals, methods, and products than are capturable by such means. The Science Products Inventory (SPI) is one tool to assist with participatory science evaluation that extends beyond scientific outputs such as publications. Its use cases were limited to a cohort of projects during its initial development, so here we explored its utility and flexibility for use cases across multiple US federally-funded participatory science projects. We examined the tool’s formative and longitudinal utility, accessibility, and adaptability with contributory projects spanning different sizes, scopes, and goals. We found that the tool was easily customizable, making it suitable for individual project needs, including meeting the needs of funders for evaluation. It was easy to use, making it suitable for data gathering by non-expert evaluators, and it enabled practitioners to reflect on ways to enhance a project’s impact. We also found it useful for comparing evaluation data over time and between projects. Ultimately, citizen science includes elements across various dimensions that can be examined using quantitative indicators—like those in the SPI—and qualitative means. A combination of evaluation approaches could be appropriate for individual project goals and stakeholders, but we show how the simplicity and customizability of the SPI can provide benefits across a range of projects and programs.

What is an appropriate investment hurdle rate for commercial space resource development projects?

This article sets out to identify an appropriate hurdle rate range for commercial space resource development projects, should such an industry eventuate. There has been little consistency in the use of hurdle rates and discount rates in the evaluation of space resource projects proposed to date. The article uses two approaches to determine an appropriate hurdle rate for the economic evaluation of such projects. Firstly, the article reviews hurdle rate usage in three industries with parallels to a potential space resource industry – the mining industry, the oil & gas industry, and the aerospace industry. The venture capital sector is also considered. The article finds that there is limited direct reference to the hurdle rates used in these industries and therefore uses expected project IRR and corporate Cashflow Return on Investment (CFROI) as proxies to quantify hurdle rates in each industry. Secondly, the article develops a Risk Build Up Method (RBUM) to determine appropriate hurdle rates for hypothetical commercial space resource development projects by quantifying the potential commercial risk to which such projects could be exposed. The RBUM process correlates a commercial risk score quantified on a project by project basis with a hurdle rate risk premium scale to determine an appropriate hurdle rate for such projects. Finally, the article discusses discount rate treatment in the analogue industries, with a view to proposing a consistent approach to the use of discount rates in a potential space resources industry. The article finds that hurdle rates in the range of 25% could be appropriate for potential commercial space resource development projects, depending on the perceived risk of the project, and assuming a suitable legal/regulatory regime is in place. This hurdle rate range and the RBUM process could evolve over time should such an industry eventuate and ultimately mature. The article also proposes that a ‘standard’ industry discount rate of 10% be utilised in order to facilitate the comparison of project to project valuations, based on the discount rate convention for reporting requirements in the US oil & gas industry.

Enhancing agency and empowerment in agricultural development projects: A synthesis of mixed methods impact evaluations from the Gender, Agriculture, and Assets Project, Phase 2 (GAAP2)

Development interventions increasingly include women’s empowerment and gender equality among their objectives, but evaluating their impact has been stymied by the lack of measures that are comparable across interventions. This paper synthesizes the findings of 11 mixed-methods impact evaluations of agricultural development projects from South Asia and sub-Saharan Africa that were part of the Gender, Agriculture, and Assets Project, Phase 2 (GAAP2). As part of GAAP2, qualitative and quantitative data were used to develop and validate the multidimensional project-level Women’s Empowerment in Agriculture Index (pro-WEAI), which was used to assess the impact of GAAP2 projects on women’s empowerment. This paper assesses the extent to which: (1) a two- to three-year agricultural development project can contribute to women’s empowerment; and (2) a suite of methods comprising a standardized quantitative measure of women’s empowerment and a set of qualitative protocols, can evaluate such impacts. Our synthesis finds that the most common positive significant impacts were on the instrumental and collective agency indicators that comprise pro-WEAI, owing to the group-based approaches used. We found few projects significantly improved intrinsic agency, even among those with explicitly stated objectives to change gender norms. Unsurprisingly, we find mixed, and mostly null impacts on aggregate pro-WEAI, with positive impacts more likely in the South Asian, rather than African, cases. Our results highlight the need for projects to design their strategies specifically for empowerment, rather than assume that projects aiming to reach and benefit women automatically empower them. Our study also shows the value of a suite of methods containing a common metric to compare empowerment impacts and qualitative protocols to understand and contextualize these impacts.