Policy Assessment Research Articles

Silence is Also a Voice, Right? Reflections on Silence as Resistant Teacher Voice in the Context of Curriculum Change in South Africa

This article reports on findings from a qualitative case study that explored teacher voice in the context of educational change in implementing the Curriculum and Assessment Policy reform in South Africa. The study uses the meta-theoretical paradigm of social constructivism and the conceptual framework of “resistance as good sense” to explore how silence as a form of resistance can be viewed as a strategy for learner advocacy. Data were collected using semi-structured interviews and classroom observations captured over a school year. The findings revealed that teacher knowledge jars in educational environments where compliance is the custom and teachers’ decisions in consideration of contextual congruence are viewed as resistance to the fidelity of the reform. Some teachers see passive resistance as the only alternative to empowerment in these environments. Thus, the scope of teacher voice lies in subservience to the policy where curriculum enforcers ignore teacher intuition which could influence the success of reform and contribute to the goals of learning. The study concludes that teacher silence as a form of resistance can be viewed as “good sense” and should not always be seen as emblematic of negative resistance.

Assessing national medicines policies: a protocol for systematic review of access to medicine assessment metrics and indicators

IntroductionEfforts to improve access to essential medicines globally include the implementation and assessment of national medicine policies. Although existing assessment tools may identify gaps, they do not link these to...

Unveiling Experiential Skills' Impact on Life Sciences: Leveraging Bloom's Taxonomy for Proficiency

This article delves into the impact of experiential skills development on the proficiency of Life Sciences (Biology) learners, specifically focusing on integrating Bloom's Taxonomy in formulating assessment questions. Within the framework of South Africa's educational system guided by the Curriculum Assessment Policy Statement (CAPS), this mixed-method approach underscores the importance of aligning assessment questions with Bloom's Taxonomy to enhance experiential skills development and improve learner proficiency. The research, using a dual study methodology (PhD and MEd), emphasises the significance of question complexity and difficulty in driving experiential skills development despite varying perspectives among teachers on question sequencing. It argues that while standardised assessments may dictate question formats, teachers' inherent questioning styles are crucial in facilitating authentic learning experiences. Moreover, the article unveils a notable enhancement in learner proficiency resulting from effective planning and execution of experiential skills lessons, corroborating existing literature. In conclusion, valuable light is shed on the pivotal role of experiential skills development in enhancing learner proficiency in Life Sciences education, particularly within the South African context. By leveraging Bloom's Taxonomy in questioning and lesson planning, teachers can effectively cultivate critical thinking and problem-solving skills in learners. The findings advocate for tailored approaches to address proficiency gaps and stimulate learner achievement, thereby fostering engaged learning and real-life skill application in Life Sciences classrooms.

Recent Crises and the Evolution of European Policies. An Introduction

This introduction briefly presents the contents of the six contributions that compose the special issue of The Forum for Social Economics titled ‘Recent crises and the evolution of European policies’. We discuss the papers by proposing a reflection on the evolution of the European institutional structure, the assessment of policies that have marked especially the last 15 years characterized by the continuous succession of crises, and the future of Europe. At the end of our argument, we make room for two main reflections: 1) In the face of external shocks affecting European Union, the endogenous stabilization attempts provided for an incomplete institutional system have amplified the instability present in the system itself; 2) the analysis of structural and institutional change is crucial to propose alternative policy perspectives focused on quality of life and to bring them back into the public debate, which seems to be increasingly urgent in Europe.

Investigating the quality of a high-stakes EFL writing assessment procedure in the Turkish higher education context

Employing G-theory and rater interviews, the study investigated how a high-stakes writing assessment procedure (i.e., a single-task, single-rater, and holistic scoring procedure) impacted the variability and reliability of its scores within the Turkish higher education context. Thirty-two essays written on two different writing tasks (i.e., narrative and opinion) by 16 EFL students studying at a Turkish state university were scored by 10 instructor raters both holistically and analytically. After the raters completed the scoring procedure, semi-structured individual interviews were held with them to gain insight into their views regarding the quality of the current scoring procedure. The G-theory results showed that the reliability coefficients obtained from the current scoring procedure would not be sufficient to draw sound conclusions. The quantitative results were partly supported by the qualitative data. Important implications were discussed to improve the quality of the current high-stakes EFL writing assessment policy.

Exploring Edible Insects: From Sustainable Nutrition to Pasta and Noodle Applications-A Critical Review.

Edible insects provide an alternative source of high-quality proteins, essential lipids, minerals, and vitamins. However, they lack the acceptability and consumption rates of more common staple foods. In contrast, pasta and noodles are globally appreciated foods that are consumed across various cultures. These products contribute greatly to the population's energy intake but generally lack essential nutrients. Recently, edible insects have gained in popularity due to their numerous benefits, both environmental and nutritional. Current research indicates that incorporating edible insect ingredients into pasta and noodle formulations enhances their nutritional quality by increasing protein and fiber content and reducing carbohydrates. However, adding new ingredients to enrich common foods often carries technological and sensory challenges, such as changes in processing parameters, texture, flavor, and appearance. Technology assessment, scientific research, information campaigns, and public policies can help overcome these issues. This review aims to summarize the benefits of entomophagy (the consumption of insects as food) for sustainability, nutrition, and health; highlight the potential of pasta and noodles as carriers of nutritious and bioactive ingredients, including insects; and critically address the advancements in insect-enriched pasta and noodle technology, identifying current challenges, knowledge gaps, and opportunities.

The Mediating Impact of Service Quality Towards Improving Sustainable Organizational Performance Private University in Indonesia

This study aims to determine the challenges of dynamics in the turmoil of sustainable transitions in the context of Organizational Performance at LLDIKTI 3 Jakarta Private University The independent variables used in this research are Organizational Change, Risk Management, Good University Governance, and ICT Competencies while the dependent variable used is Organizational Performance and also the mediating variable used is Service Quality. The methodology used in this study uses quantitative methods, implementation questionnaires via Google form, then the output data is collected for further protection. The population in this study is Private University with a total of 283 institutions, in the context of the University cluster there are 68 institutions. The sample in this study were 376 respondents. Instrument analysis applied to SmartPLS 3.0 with stratified random sampling method technique. .In order for higher education institutions to be managed effectively, openly, accountably, and able to implement their learning and research objectives, good university governance is very important. Here are some suggestions for effective Good University Governance such as continuous improvement is necessary for good governance, and this requires regular assessment of policies, practices, and procedures to ensure they remain relevant, efficient, and aligned with the agency's mission and goals.

Climate-Driven Sustainable Energy Investments: Key Decision Factors for a Low-Carbon Transition Using a Multi-Criteria Approach

Currently, the need for a clean transition has made the upscaling of sustainable energy investment projects imperative. This paper addresses the increasing importance of sustainable energy investment projects in the context of climate change and the urgent need for a global energy transition. Given the complexity of decision-making in this field, a multi-criteria decision-making (MCDM) approach is employed to assess the main criteria considered by project developers and financial institutions. Using the Analytic Hierarchy Process (AHP) method, eight criteria are identified and evaluated. Results highlight differing priorities between project developers and investors, emphasizing the need for adaptable approaches to accelerate sustainable energy investments. The study underscores the importance of understanding diverse stakeholder preferences and priorities in formulating effective strategies and managing associated risks to effectively promote sustainable energy projects. Future research should focus on real-life case studies and policy assessments to further enhance the understanding of sustainable energy investment dynamics.

Beamtimes and knowledge production times: how big-science research infrastructures shape nations’ domestic and international science production

Frontier scientific discoveries increasingly rely on big-science research infrastructures, such as supercolliders, synchrotron light sources, and space telescopes, whose construction and operation involve intensive international collaboration. This collaborative nature, however, presents a challenge in balancing national interests with the common good, particularly given the substantial fiscal investments involved. This study investigates the effects of one of China’s prominent big-science infrastructures, the Shanghai Synchrotron Radiation Facility (SSRF), on the country’s production of science, differentiating between national and international scientific endeavors. Employing a rigorous difference-in-differences (DID) methodology, it evaluates SSRF’s effects on discipline-level production of publications by domestic researchers and those involving international collaboration. The empirical findings reveal compelling evidence that SSRF has significantly enhanced the production of high-impact national and international publications for disciplines reliant on the facility for experiments, particularly increasing the percentage of high-impact national publications. The findings also underscore the dual role of big-science infrastructures in fostering international research collaboration while simultaneously enhancing nations’ domestic scientific development and competitiveness. Additionally, the study provides valuable insights for research assessment and science policy discussions.

Allomilk: An Anthropogeny-Based Framework for Human Milk as a Climate Solution.

Climate change is an urgent threat to perinatal and infant health, with the greatest effects of climate change exposures being felt disproportionately by global majority communities who have been most harmed by systems of oppression. Human milk feeding is one recognized solution to bolster climate resilience. Yet, policies and practices to support human milk as a climate solution are inconsistent and under-prioritized, which is unsurprising given the lack of alignment between human history and current cultural context with regard to lactation and human milk access. This paper presents a new framework on lactation as a climate solution, which is unique in its incorporation of the critical history of cooperative breastfeeding in our species. Rooted in anthropogeny, or the study of human origins, and antiracist principles of lactation, the Allomilk Framework highlights five concepts of the ideal application of human milk as a climate solution, bridging ancient allonursing with present-day lactation and human milk access. These ideal applications-and the proposed development of measures to operationalize them-will advance the field through a shared understanding of the qualities that should be prioritized in the assessment of policies and practices at the intersection of climate resilience and human milk access. Application of the Allomilk Framework to assess and design future policies and practices will advance the field by increasing the potential for climate resilience and climate mitigation while working with-rather than against-the importance of cooperative breastfeeding in human history.

Towards greener freight transport networks: An integrated model for location planning and carbon regulation policy evaluation

This paper proposes a mathematical model to assist governmental planning in the transport sector by suggesting optimal locations for logistics integration centers considering intermodality, logistics costs, and carbon costs. Seven scenarios were evaluated considering the assessment of carbon-tax and carbon-cap policies. The findings showed that logistic costs are more significant than carbon costs across the network investigated. Only non-competitive conditions such as considering carbon costs alone or adopting outrageous values for the carbon tax could change this situation. If no facility were opened, the total cost would be 2.8 times higher than the baseline scenario, while intermodality would reduce the baseline emissions by up to 3.753%. Therefore, the government should prioritize greener strategies and modal shifts in addition to implementing carbon policies to ensure a more sustainable and cost-effective transportation sector.

A high-stakes reading test as the White listening subject: Applying an antiracist validation lens

ABSTRACT In this paper, the White listening subject takes the form of a standardized high-stakes reading test, the State of Texas Assessment of Academic Readiness (STAAR). Although the test does not actually listen, it ‘hears’ and evaluates children’s responses to its questions. I present the results of the 2017 Grade 8 reading exams, from the March, May, and June administrations, with a focus on results for students who are learning English as an additional language, who are racially minoritized, and who are economically disadvantaged. The analysis looks at factors predicting test completion, passing rates, and test resitting: language proficiency status, race/racism, and economic disadvantage. In the discussion, I question these results’ validity by examining the STAAR validity arguments including the construct definition, development and scoring of the assessment, retake administration policies, and consequences for language minoritized and racialized students. I hope this study may spur changes in policy and practice, and the institution of a re-humanizing lens in assessment policies in Texas and beyond.

Robustness assessment of climate policies towards carbon neutrality: A DRO-IAMS approach

There are plenty of uncertainties in the integrated climate-economic system including parameter uncertainty and model uncertainty, which significantly challenges the assessment of climate goals committed in the Paris Agreement pledges. In this study, we develop a robustness assessment framework of climate policy by effectively coupling the distributionally robust optimization (DRO) methodology with integrated assessment models (IAMs), termed DRO-IAMS framework, where “S” emphasizes the multiple IAMs being incorporated. Our approach determines a safeguarding probability for the achievement of carbon-neutrality target through the worst-case Conditional Value-at-Risk (CVaR) criterion by effectively capturing the fat-tail effect and exploiting its tractability. Leveraging a discrete support of uncertain parameters over which the objective value of global temperature increase (GTI) can be readily accessible using the IAMs, our developed DRO-IAMS framework effectively circumvents the difficulty in utilizing analytically the black-box-featured IAMs, and achieves a comprehensive and more flexible fashion in integrating the DRO (e.g, moment, ϕ-divergence, and Wasserstein ambiguity sets) and IAMs (e.g., DICE, FUND, and E3METL) to cope with parameter- and model uncertainties in climate policy assessment. Our results suggest that parameter uncertainty and model uncertainty — as critical issues that can have significant impacts on the warming and economic performance of policies — could incur biased assessment for the realization of climate targets. Our proposed DRO-IAMS approach — by its design — is shown to be able to effectively mitigate such issues by pursuing stricter mitigation efforts, and can produce more reliable assessments for typical climate policies than the common sampling-based approaches.

Influence of Supply Chain Diversification on the Performance of Large Food and Beverage Processing Companies in Nairobi City County, Kenya

The performance of food and beverage manufacturing companies has become a pressing concern due to the rising incidence of supply chain disruptions, which pose significant threats to achieving operational goals. This study investigates the influence of supply chain diversification on the performance of large food and beverage processing companies in Nairobi City County. Supply chain disruptions have been linked to severe financial repercussions, including lower stock returns and increased failure rates, necessitating innovative management strategies. Utilizing a quantitative correlational research design, the study surveyed all 46 major food and beverage companies in the region, targeting procurement, financial, operations, and supply chain managers. Data collection was conducted via questionnaires, achieving an impressive response rate of 81%, underscoring the representativeness of the findings. Statistical analysis revealed a strong positive correlation between supply chain diversification and organizational performance, with an R-squared value of 0.650, indicating that approximately 65% of performance variability could be attributed to diversification practices. Regression analysis confirmed that each unit increase in diversification significantly enhanced performance metrics. These results align with existing literature, emphasizing the need for proactive diversification strategies to mitigate risks and enhance operational efficiency. Recommendations include continuous investment in diversifying supplier bases, adopting advanced technologies such as artificial intelligence, and implementing regular training programs for staff. Furthermore, strategic partnerships with suppliers and routine assessments of risk management policies are vital for maintaining competitive advantages. This research highlights the critical role of supply chain diversification in enhancing performance in the food and beverage sector, providing insights that are essential for navigating the complexities of modern supply chains. Future research should explore comparative studies across different sectors, longitudinal impacts of diversification, and qualitative insights from industry leaders to further enrich understanding in this area. By addressing these recommendations and research avenues, food and beverage manufacturing companies can enhance their resilience and ensure sustained performance in an ever-evolving market landscape..

Public views on open data health research in Switzerland: Implications for research and policy

Abstract Background The increasing volume of publicly available data offers health researchers opportunities to explore public sentiment through open data research on issues such as vaccination hesitancy and fake news propagation. To ensure ethical conduct and maintain public trust, assessing public perceptions of open data research in healthcare is crucial. Methods We conducted 10 focus groups across the German, French, and Italian-speaking regions of Switzerland. We presented participants with real-world examples of open data research in healthcare and guided discussions using a semi-structured format. The topic areas were: (1) using Twitter data to assess public opinion on gene-editing technology, (2) assessment of health policy documents, (3) using Twitter data to predict individual health status and (4) using YouTube data to assess public sentiment on health policies. We assessed our findings using a thematic analysis approach. Results Gathering insights from 75 citizens, four major themes emerged: (1) Expectations towards actors and open data research, such as using research findings for societal benefit, and ensuring transparency in data use through informed consent; (2) Supportive measures including communication strategies to raise awareness and inform the public about the use of publicly available data for health research; (3) Concerns about data reuse for purposes beyond the study’s objectives, especially for financial gain, and about data validity and privacy, particularly for sensitive health data; and (4) Mitigative measures to minimize harm, such as through the involvement of external oversight committees. Conclusions Our findings indicate public support for open data research in healthcare, provided that specific expectations are met. Developing a guiding framework for legitimate open data research in healthcare is a valuable next step, with a focus on enhancing public awareness through communication campaigns and providing oversight measures to foster public trust. Key messages • Open data research in healthcare relies on public data use without explicit consent, which can disconnect the research community from society. • We found that public support for open data research in healthcare is generally present, however it is also conditional on communication and policy efforts addressing their concerns.

Populating HIA of tobacco policies with empirical evidence on behavioral response to price increases

Abstract Performing Health Impact Assessment of tobacco policies requires to have insights into how smokers will react to policy measures such as price increases. In the Netherlands, a series of 3 substantial price increases has been implemented in 2020 (10% increase), 2023 (10% increase) and 2024 (24% increase). We performed three consecutive studies comparing the ex-ante stated preferences about behavioural response to actual and hypothetical future price increases, and compared these stated preferences with actual behaviour changes 6 months after the increase in excise tax. Two of these possible behavioural reactions actually will impact smoking prevalence or smoking intensity, e.g. stopping altogether and decreasing the number of cigarettes smoked. Other behavioural responses are less favourable and will not impact health, such as buying more and cheaper tobacco abroad and smoking less expensive brands or transferring from cigarettes to roll-your-own or e-cigarettes. For the price increases of 2020 and 2023, we have observed a substantial number of about 10% of smokers quitting successfully and about one third attempting to quit smoking. (Attempting to) quit smoking was much more prevalent among those with a more pronounced intention to stop smoking at the ex-ante measurements. At the same time, cross-border shopping increased significantly as well, with a 10 percent-point growth in the absolute amount of all tobacco consumed originating from abroad following the 10 percent price increase of April 2023. This big increase in cross-border shopping appeared to be independent of distance to the border. We conclude that every significant price increase stimulates smokers to consider to stop smoking. However, unilateral price increases in one country will eventually also stimulate smokers to buy cross-border. Behavioural data as presented should inform HIA to make them more realistic with regard to actual behaviour changes and health impacts of smoking policies.

Assessing Equity and Emotional Wellbeing: A Critical Look at NAPLAN in Australian Schools

The National Assessment Program - Literacy and Numeracy (NAPLAN) is a pivotal educational reform in Australia that aims to assess students' literacy and numeracy skills. Since its introduction in 2008, NAPLAN has sparked significant debate regarding its effectiveness and equity. This paper critically examines the promises and pitfalls of NAPLAN, focusing on its impact on educational equity, the socio-emotional well-being of students, and school management practices. While NAPLAN is designed to address inequalities and improve educational outcomes, research suggests that it may inadvertently exacerbate disparities between schools, particularly affecting students from disadvantaged backgrounds. Furthermore, the high-stakes nature of the test can induce anxiety among students and educators, particularly in low-performing schools. This paper also includes a case study of Croydon Community School, an alternative secondary school in Melbourne, to illustrate the diverse impacts of NAPLAN on student performance, socio-educational advantage, and cultural diversity. In conclusion, while NAPLAN provides valuable data on student performance, it must be complemented by broader assessment practices and policies that prioritize diversity and inclusion to fully address its limitations.

Mapping the Policy Alternatives for Rare Cancer

Abstract Issue This policy research addresses the issue of rare cancers in the European Union (EU). Rare cancers have an annual incidence rate of less than 6/100 000 and face challenges in diagnosis, clinical care, and research investment. Survival rates for rare cancers are lower compared to common cancer types, with significant variations among EU Member States. Description of the problem Policy frameworks for rare cancers are often fragmented and greatly vary across the EU. This study aims to develop a tool for assessing policy alternatives by reviewing existing national rare cancer policies, conducting interviews with experts, and analysing core stakeholders at the EU level. Results The main policy alternatives covered five domains: definition, registration, organisation of care, access to innovative therapies, and funding. Interviews revealed four policy options for each domain. Six core stakeholders were determined: patient organisations, healthcare professionals, researchers, industry, health legislators, and health authorities. A pilot policy assessment tool was developed on this basis. Lessons The pilot study coherently explored policy alternatives for rare cancers in the EU. Using these findings, policymakers and researchers can assess the impact of different policy options at a national level and contribute to the development of a unified EU policy framework for rare cancers. The pilot survey was also useful to collect input from the core stakeholders. Key messages • This study identifies key policy domains and feasible alternatives. A pilot preference assessment study based on these options can aid in EU policy development. • Navigating rare cancer policy complexities demands collaboration and innovation. Engaging stakeholders and exploring alternatives can forge a more effective EU framework for addressing rare cancers.

An overview and comparison of approaches used for health policy analysis: What to use and when?

Abstract Background Public health challenges are complex and analyzing them requires advanced approaches such as, societal cost-benefit analysis (SCBA), health impact assessment (HIA), and strategic foresight. Analyzing health policy is a multifaceted process, and depends on, among others, the scope, approach, and policy goals. Given this complex and multifaceted nature, it is not always clear which approach to use, and how the approaches can complement each other. Therefore, health policy analysis could benefit from practical and explicit guidance regarding clear identification of cases and types of analysis. Hence in this paper we aim to develop a framework that can provide this guidance. Methods In this paper we describe the differences and similarities of three distinct health policy assessment approaches, SCBA (an economic evaluation approach that takes into account the impact on society as a whole), HIA (is a combination of tools that focus on evaluating the potential health effects of a given policy) and strategic foresight (a systematic and participatory approach used to anticipate and plan for future trends and uncertainties that may impact policy), their application, and how they can complement each other within the field of public health. A framework that can be used when deciding which health policy approach to use for a given case will be developed, based on existing literature, frameworks, and a case study. Discussion This paper contributes to knowledge on health policy analysis and towards efficiency and clarity in analyses conducted in this field. Key messages • There is little guidance regarding how to conduct health policy analysis. • Clear guidance on which approaches to use and how they complement each other will contribute towards efficiency and clarity in health policy analysis.

Subject Advisors’ Understanding of their Curriculum Leadership Roles for Mathematics Improvement in South African Schools

The study aimed to investigate the curriculum leadership role of Mathematics subject advisors in enhancing Mathematics education in South Africa. Using a case study design, seven Mathematics subject advisors and ten Mathematics educators were sampled from all seven districts of the Free State province. Data collection methods included in-depth semi-structured interviews, observations, and document analysis. Data analysis followed Tesch’s (1990) eight-step coding technique. The field study revealed that Mathematics subject advisors’ leadership roles encompassed providing support and guidance to educators, conducting educator appraisals, monitoring and overseeing educators’ and learners’ workbooks, mentoring, and professional development. They also handled administrative tasks findings like resource provision and paperwork using monitoring tools. While all subject advisors aimed to improve Mathematics achievement, their approaches varied. Some reviewed past strategies while others adapted based on resource availability. Individual educational philosophies also influenced their strategies. Moreover, subject advisors operate within a network that includes principals, educators, learners, and the broader context. Effective curriculum leadership depends on these interactions. Interestingly, none of the subject advisors claimed comprehensive knowledge of their subject area. Some lacked specialization in Mathematics or related fields in which they were operating. Many expressed a need for training, particularly in managing and supporting progressed learners. These findings suggest the need for a standardized model to guide leadership training for Mathematics subject advisors. Such a model could enhance curriculum leadership, thereby improving teaching practices and student performance. Future research could use these insights to develop this model. Keywords: Curriculum Leadership, Subject Advisors, Mathematics, Curriculum, Assessment Policy Statement (CAPS), Cognitive Theory