Policy Evaluation Research Articles

The Effect of Turnover and E-SPTPD Services on Restaurant Taxpayer Compliance with Taxpayer Awareness as a Moderating Variable (Case Study on Restaurant Taxpayers in Sidoarjo Regency)

The Covid-19 pandemic that has occurred over the past four years has had an impact on several aspects, one of which is tax revenue. More specifically, restaurant tax revenue in Sidoarjo Regency also decreased during the period 2020 to 2022. This study examines the influence of turnover, and e-SPTPD services, on the level of taxpayer compliance with tax awareness as a moderation variable. The data used in this study is primary data through the purposive sampling method on certain criteria. The research population is restaurant taxpayers in Sidoarjo Regency. Data collection uses a questionnaire that is distributed door-to-door to the respondents. Based on the results of the path coefficient test, the results of the hypothesis test, namely turnover, and e-SPTPD services have a positive effect on taxpayer compliance. Meanwhile, tax awareness cannot strengthen the influence of turnover, as well as e-SPTPD services on taxpayer compliance. This research can be an evaluation of government policies on tax compliance which has implications for optimizing tax revenue, especially in restaurant businesses in Sidoarjo Regency. Namely by considering turnover, and e-SPTPD services.

A Robust Framework for Renewable Energy Policy Evaluation Using MCDA and Compromise Ranking with Stochastic Weight Identification

A Robust Framework for Renewable Energy Policy Evaluation Using MCDA and Compromise Ranking with Stochastic Weight Identification

Policy Gaps and Diverging Perceptions of Effectiveness: An Assessment of Sustainable Permanent Grassland Management in Switzerland

This article focuses on the effectiveness of the Swiss policy mix promoting sustainable permanent grassland (PG) management in the country. We used the Cascade Framework and stakeholder’s sentiment analysis to qualitatively assess propagation pathways for generating policy effectiveness in terms of PGs’ deliverance of ecosystem services (ESs), to ultimately enable sustainable PG management. We employed a mixed-method approach combining a review of governmental documents, formal policies and policy evaluations with semi-structured interviews with Swiss stakeholders. Through this analysis, we identified 16 policy instruments influencing PG management, including 3 regulatory instruments, 11 incentive instruments, and 2 informational instruments. Results showed that these instruments primarily aim to promote sustainable PG management by employing measures targeting the very structure and composition of the landscape. As such, we found gaps in the types of instruments employed, particularly in terms of demand-side policies, which can explain the poor policy outcomes in relation to a number of environmental quality objectives. In parallel, we found that most of the interviewed stakeholders considered Swiss grassland policy as generally effective, mainly because it was perceived as democratic. While this study focuses on Switzerland, its novel conceptual and methodological approach of using the cascade-framework for policy analysis can be applied to other biogeographical regions and socio-economic contexts. Our findings can improve the calibration of future policy instruments to enable land managers and grassland landscape users to restore or maintain PGs in good ecological condition, by targeting mechanisms that can ensure achieving environmental quality objectives while remaining democratically legitimate.

Role of Report Analysis on Asset Management and Policy Evaluation: A Case Study of Bank of Kigali (2017-2023)

Role of Report Analysis on Asset Management and Policy Evaluation: A Case Study of Bank of Kigali (2017-2023)

Evaluation of green development of energy consumption in the Pearl River Delta urban agglomeration based on radial basis function neural network

AbstractThe study utilizes the RBF neural network model to evaluate the green development of the Pearl River Delta urban agglomeration, revealing a consistent increase in development levels from 2005 to 2020 despite notable inter‐city variations. The model adeptly handles complex interactions within urban green development, offering insights into comprehensive impacts and aiding in policy evaluation and optimization. It provides urban planners and decision‐makers with data‐driven support, enhancing the scientific basis and stability of policy‐making.

Topic modelling as a method for framing analysis of news coverage of the Russia-Ukraine war in 2022–2023

This study critically analyses the representation of the Russia-Ukraine war in Western (the Euronews) and Eastern (the Kyiv Post) media discourses. It examines how media organisations shape narratives through strategic framing. Employing the Natural Language Processing technique – Topic Modelling – with a generative probabilistic model LDA and a transformer-based language model BERT, the study reveals generic frames elaborated by more specific extensions, shedding light on media portrayal of economy, public opinion, security & defence, external regulations, policy evaluation, and health & safety sectors. Through Named Entity Recognition with roBERTa, Sentiment Analysis with distilBERT, and Corpus Linguistics methods with LancsBox X, interpretation of these overarching frames provides a comprehensive analysis of the nuances in narratives, societal perceptions and policy decisions amidst the ongoing war.

Policy evaluation and the causal analysis of public support.

Support for initially unpopular policies may grow over time.

Light-duty gasoline vehicle emission deterioration insights from large-scale inspection/maintenance data: The synergistic impact of usage characteristics

Accurately estimating vehicle emissions is crucial for effective air quality management. As key data for emission inventory construction, emission factors (EFs) are influenced by vehicle usage characteristics and experience deterioration. Current deterioration models often employ single-factor approaches based on vehicle age or accumulated mileage, which fail to capture the effects of varying usage intensities within the same mileage or age intervals. This study addressed this limitation by developing a novel emission deterioration model that incorporates multi-dimensional usage characteristics and that utilizes a large-scale inspection and maintenance (I/M) dataset for light-duty gasoline vehicles (LDGVs). The modeling results reveal distinct deterioration patterns for different pollutants and highlight the synergistic effects of the usage duration and intensity: natural aging significantly impacts HC and NOx emissions, while CO emissions are more strongly affected by intensive use. Specifically, China V LDGVs that were driven 4 × 104 km/yr exhibited HC, CO, and NOx deterioration rates per mile that were approximately 4.1 % lower, 10.3 % higher, and 1.1 % higher, respectively, than those of vehicles driven 2 × 104 km/yr as the mileage increased from 5 × 104 km to 10 × 104 km. By leveraging timely emission data and explicitly accounting for usage intensity, this study corrected biases in local emission estimates by 5–85 % with respect to estimates from commonly used models. This framework enables the development of more effective control strategies and refinements to policy evaluations in megacities with I/M programs.

Compliance with WHO Standards in Monitoring and Evaluating the COVID- 19 Pandemic in the Philippines and Vietnam

This research is concerned with the compliance of the Philippines and Vietnam with World Health Organization (WHO) standards in the monitoring and evaluation (M&E) of COVID-19 policies. Document analysis helps to explore the M&E plan for implementing the set of standards from WHO for COVID-19 prevention in the Philippines and Vietnam while surveys define the perception of the local health authorities on the compliance of the Philippines and Vietnam authorities with the WHO standards. Comparing the situation report shared with WHO by those countries would clarify the valuable information. As a result, compliance levels in the Philippines are perceived to be moderately high to high. Respondents in Vietnam rated compliance at a very high level. However, the two countries still have gaps in their COVID-19 M&E systems. Therefore, recommendations are then proposed for the enhancement of the M&E of COVID-19 policies and compliance with WHO.

Evaluation of crop structure optimization policy quantitatively and future directions in China: a PMC-Index model approach

Developing policies to optimize the planting structure is essential to ensure an adequate supply of agricultural products and guarantee food security. However, the rationality and comprehensiveness of China’s cropping structure optimization policies require scientific evaluation. Therefore, this research established an evaluation index system for China’s planting structure optimization policies using text mining and the PMC-Index model to evaluate eight agricultural cropping structure optimization policies in China since 2003. The results showed that: (1) The PMC-Index showed a general upward trend across the eight policies, with scores ranging from 4.88 to 6.61. (2) Seven of the eight policies were deemed acceptable, while one was classified as low. (3) The Chinese government has long focused on optimizing the structure of agricultural cultivation, and relevant policies have made significant progress in terms of logical connotation and long-term feasibility. However, there is still room for improvement in enhancing regulatory effectiveness and strengthening interdepartmental collaboration. It is recommended that the government develop more flexible and diverse incentive mechanisms, strengthen interdepartmental coordination, expand policy coverage, enhance the comprehensiveness of policy functions, and elevate support for agricultural technology.

A strategic IT policy implementation model for enhancing customer satisfaction in digital markets

In the increasingly competitive landscape of digital markets, customer satisfaction is paramount for sustained business success. This paper proposes a Strategic IT Policy Implementation Model aimed at enhancing customer satisfaction by aligning IT policy development with customer-centric strategies. The model serves as a framework that integrates technological advancements with customer expectations, ensuring that IT policies effectively support business objectives and improve operational reliability. The proposed model emphasizes a holistic approach to IT policy formulation, incorporating stakeholder input, market analysis, and performance metrics. It identifies key areas where IT policies can directly influence customer experiences, including data management, service delivery, and communication channels. By focusing on these elements, organizations can develop IT policies that not only comply with regulatory standards but also enhance user engagement and satisfaction. Central to the model is the concept of continuous feedback loops, which facilitate the ongoing evaluation and refinement of IT policies based on customer insights. This adaptive mechanism enables businesses to remain responsive to changing customer needs and technological advancements, fostering a culture of innovation and customer-centricity. Moreover, the model advocates for cross-departmental collaboration, ensuring that IT policies are harmonized with marketing, sales, and customer service strategies. Implementation of the model is illustrated through case studies of leading technology firms that have successfully aligned their IT policies with customer-centric approaches. These examples highlight the tangible benefits of improved customer satisfaction, increased loyalty, and enhanced operational reliability. Furthermore, the model addresses common challenges faced during implementation, such as resistance to change and resource constraints, offering practical solutions to overcome these obstacles. In conclusion, the Strategic IT Policy Implementation Model provides a structured approach for organizations aiming to enhance customer satisfaction in digital markets. By aligning IT policies with customer-centric strategies, businesses can achieve greater operational efficiency and foster long-term relationships with their customers.

A policy framework on AI usage in developing countries and its impact

The rapid growth of Artificial Intelligence (AI) presents both significant opportunities and challenges for developing countries. A well-structured policy framework is crucial to maximize the benefits of AI while mitigating its risks. This review proposes a comprehensive AI policy framework tailored to developing countries, emphasizing the need for robust infrastructure, capacity building, ethical governance, and economic incentives. Key elements include the development of digital infrastructure, education and training programs to enhance AI literacy, and ethical guidelines to ensure fairness and transparency in AI applications. Data governance and privacy protections are critical, particularly in countries where regulatory frameworks are underdeveloped. Furthermore, international cooperation is highlighted as a necessity for aligning local policies with global AI standards, facilitating cross-border data sharing, and ensuring equitable access to AI innovations. The potential impact of AI on economic growth, job creation, healthcare, education, and public service delivery is profound, yet challenges such as workforce displacement, increased inequality, and the digital divide must be carefully managed. The proposed framework addresses these challenges, providing strategies to overcome barriers to AI adoption, including financial constraints, governance issues, and unequal access to technology. Moreover, it stresses the importance of fostering public-private partnerships and ensuring that AI development is inclusive, benefiting all segments of society. By implementing a comprehensive AI policy framework, developing countries can harness AI’s transformative power to drive sustainable development, improve social outcomes, and strengthen their economic standing in the global landscape. This review concludes by recommending continuous policy evaluation and adaptation to keep pace with AI's rapid evolution.

Evaluating Ecosystem Services Incorporation in River Policy: A Multidimensional Framework Applied to China's River Chief System

ABSTRACTThis study develops a comprehensive evaluation framework to assess the incorporation of river ecosystem services (ESs) into policy content, focusing on China's River Chief System (RCS) policy. The framework introduces a quantitative tool that bridges the gap between policy formulation evaluation and policy effect evaluation by integrating a hierarchical indicator system, reference values, and a method for quantifying ES incorporation. Key findings from 32 province‐level RCS policy documents revealed selective incorporation of certain ES indicators, significant mismatches between policy focus and the typical structure of river ESs, and notable regional disparities. Provisioning services (i.e., water supply) and regulating services (i.e., pollution mitigation) are prioritized, while critical regulating services (e.g., flood mitigation and habitat maintenance) and cultural services (e.g., education and science) are underrepresented. Stakeholder and relationship indicators are limited, primarily focusing on managers and spatial relationships, while the value of river ESs is largely ignored. Policy optimization should emphasize expanding the coverage of ESs, incorporating broader stakeholder involvement, and integrating financial incentives. Drawing on international river policies, policymakers could create a more flexible and adaptive river governance structure. While the study offers a quantitative framework for policy evaluation, it acknowledges limitations, including reliance on textual data and potential biases in the reference values. Future research should include stakeholder perspectives and dynamically adjust reference values as new data become available.

Rethinking Local Government Asset Management in Indonesia: Governance, Planning, and Policy Evaluation

Effective asset management is essential for enhancing operational efficiency and achieving sustainable development within local governments in Indonesia. This study explores key challenges in asset management, focusing on governance, planning, and policy evaluation. Several critical issues are identified: fragmented governance, insufficient transparency and coordination, outdated asset inventories, and misalignment between asset management practices and broader development goals. Policy evaluation mechanisms are also inadequate, failing to measure asset utilisation effectively. These challenges lead to inefficiencies in resource allocation, underutilisation of assets, and missed opportunities for local economic growth. The findings align with Sustainable Development Goals (SDGs), particularly SDG 11 (Sustainable Cities and Communities), which promotes efficient resource use, and SDG 9 (Industry, Innovation, and Infrastructure), which supports enhanced infrastructure management. Addressing these goals enables local governments to align asset management strategies with broader sustainability objectives, fostering equitable growth and long-term development. Through a qualitative literature review, this study analyses data from government reports and prior research to highlight these challenges and propose solutions. An integrated approach—aligning governance frameworks, improving asset management planning, and strengthening policy evaluation—can overcome the identified barriers. By adopting this model, local governments can optimise asset management, leading to improved efficiency, better resource utilisation, and sustainable development. Future research should explore applying this framework across regions in Indonesia to validate its effectiveness.

Accounting for health equity in policy evaluation: a content analysis of primary research

Abstract Background Public Health researchers increasingly make use of sophisticated study designs and methods to evaluate the effects of policies on health and social outcomes. Natural experiment evaluation (NEE) conceptualises policies as ‘natural’ experiments that occur outside of the control of researchers. Often, NEE employs quasi-experimental methods (QEM) which enable researchers to rigorously evaluate the effect of population-level interventions. As for other health-related research, it is unclear to what extent such public health evaluations can and do consider the (health) equity implications of policies. We sought to investigate how health equity is addressed in NEEs and other policy evaluations that employ QEM. Methods We identified a random sample of primary research as part of a pre-registered scoping review (https://osf.io/3h6cb/). Studies that employed methods labelled as interrupted time series, difference-in-differences, controlled before and after, regression discontinuity, and synthetic control were included. Through content analysis, we examined how health equity was considered in data analysis and discussion sections. Results We analysed 59 studies, of which 25 were stratified for one or more socially-stratifying factors. Results were mainly stratified by sex (n = 15, 25.4%), age (n = 13, 22%), and diverse measures of socioeconomic status (n = 14, 23.7%), i.e. income, employment, education, or other factors. Of these, 21 studies included a discussion of health equity-related results, ranging from a few sentences to a holistic discussion including recommendations for decision-makers. Most commonly, researchers recommended monitoring of policy effects in different sub-populations, and careful policy design that conceptualises complex policy effects, including unintended and unequitable effects. Conclusions Policy evaluations have great potential for informing public health decision-making but health equity aspects were under-examined in these studies. Key messages • Health equity is assessed by evaluating policy effects in relevant sub-populations. Only 25 of 59 studies included results that were stratified for one or more socially stratifying factors. • Studies that were focused on disadvantaged populations commonly included recommendations for policymakers, calling for better policy design and improved monitoring of policy effects.

Health Impact Assessment in Personalized Prevention: three applications on pharmacogenomic testing

Abstract Background In recent years, literature on the efficacy of genetic and genomic tests has expanded, yet the impact of personalized prevention programs that include such tests remains understudied. Our study aims to test the use of the Health Impact Assessment (HIA) framework, traditionally applied in non-health policy evaluation, to assess the impacts of personalized prevention policies. Methods We selected a policy mandating dihydropyrimidine dehydrogenase (DPYD) genetic test use before prescribing fluoropyrimidine for colorectal cancer (CRC) patients. Three HIAs are being conducted in Italy, Portugal, and Finland to assess the applicability across different contexts. The assessment involves literature review, comparative risk modeling, and stakeholder interviews. Three national steering committees, comprising representatives from key interest groups and experts, will evaluate evidence to gauge policy impacts and offer recommendations. Results The potential impacts identified include CRC patients’ outcomes, economic, organizational, patient experience, clinician workload, and equity. Preliminary results show a consensus in literature and national guidelines on the ability of the DPYD test to reduce adverse events and enhance the quality of life of CRC patients. However, the assessment reveals context-specific effects regarding equity, influenced by the prevalence of ethnic groups and variations in access to health services across regions. Differences also emerged on organizational aspects like the availability of resources such as laboratories and personnel. A lack of literature was observed on patient acceptability and clinician attitudes towards the test. Conclusions The use of HIA in personalized prevention might assist in identifying policy impacts often overlooked through the involvement of key interest groups in the assessment process. Such effort can further emphasize the significance of evaluating these programs while considering the geographical context. Key messages • Our study innovatively applies the Health Impact Assessment framework to evaluate personalized prevention programs in pharmacogenomic, addressing a critical research gap. • Preliminary findings underscore the importance of considering geographical factors in public health policy evaluation, highlighting nuanced context-specific effects.

CONSERVAÇÃO DA GEODIVERSIDADE EM GEOSSISTEMAS FERRUGINOSOS

This study examines the evolution of areas surrounding the bat caves in the Ferruginous Geosystem of Carajás from 1985 to 2022, emphasising the significance of geodiversity conservation in this unique context. The land use and cover transformations analysis reveals critical insights into spatio-temporal changes and escalating environmental degradation risks. The findings enhance the literature on geodiversity conservation and speleology, providing a solid foundation for future research. Monitoring mined areas and their ecological impacts is essential for refining management strategies for these sensitive ecosystems. Furthermore, recent attempts to amend cave protection legislation, particularly Decree 10.935, pose significant conservation challenges, necessitating a critical evaluation of environmental policies and fostering dialogue among researchers, policymakers, and the mining industry. This study highlights the urgent need for a balanced approach between resource extraction and environmental conservation to mitigate adverse impacts on biodiversity and ecological processes. Integrated and evidence-based environmental management is crucial for addressing the challenges of mining activities and regulatory changes, ensuring the protection of caves and their ecosystems for a sustainable future.

Advancing Dementia Care in Austria: developing a Dementia Registry using a multimethod approach

Abstract Background Austria faces an increasing demand for dementia care in an ageing population. However, a lack of representative data hampers evidence-based policy development and evaluation of care. To address this gap, the Austrian National Institute of Public Health is undertaking the task of developing the Austrian Dementia Quality Registry (ÖDQR). Methods Based on the AIHTA Good Practice Framework for Dementia Registries, the development and testing of the ÖDQR has unfolded in 4 distinct phases: 1) planning; 2) registry design (including definition of quality indicators and minimum data set, recruitment, and governance); 3) definition of data collection, sources, and management; 4) pilot testing. A steering committee of government representatives and dementia care experts was convened to oversee the project. A scientific committee provided oversight and ensured methodological rigor. Working groups of national and international dementia care experts focused on standards for diagnosis and therapy, activities of daily living and quality of life, legal aspects, and technical implementation, thus contributing to the content development of the ÖDQR. Results An initial systematic literature review informed the selection of quality indicators in the working groups. A conceptual framework of 15 descriptive and 30 quality indicators was developed. Preliminary results of pilot testing indicate feasibility and content validity. As a result, the ÖDQR will be established as a longitudinal survey-based registry, based on an instrument comprising 163 variables and emphasizing data collection across care settings. Legal and technical frameworks are being developed. Conclusions The öDQR holds the promise of informing evidence-based policy and improving the quality of dementia care in Austria. Careful planning and collaboration have laid the foundation for a data repository that will inform policy and improve care for people with dementia and their caregivers. Key messages • Dementia registries require a complex development to assure validity and adherence. • The Austrian Dementia Registry aims to establish best practice by focusing on the life situation of those affected by this condition.

The Norwegian Counties Public Health Survey (NCPHS)

Abstract Effective public health initiatives should be based upon a thorough understanding of important health-related factors. The purpose of The Norwegian Counties Public Health Survey (NCPHS) is to gain insights from the adult population on topics relevant for planning of public health policy, interventions, and action at the county and municipality levels. The survey includes a core questionnaire on public health-related topics such as health behaviour, subjective quality of life, distress, subjective health, social support, social capital, community contexts, and demographics, including indicators of socio-economy, with additional optional questions and scales varying across data collections. Samples are drawn from the Norwegian National Population Register. NCPHS was piloted in three counties in 2015 and in one county in 2018. After some revision of instruments and sampling procedures, surveys have been carried out in most Norwegian counties since 2019. The total number of participants has now passed 400 000. Expedient data analysis and reporting has enabled the Norwegian Institute of Public Health to present comprehensive reports within six weeks after completed data collections. In these, outcome variables are analysed against district (within counties), gender, age, educational attainment, and assessment of household economy. Tables are also made available at the municipality level. The NCPHS represent a valuable addition to existing health registries and regional health surveys, providing critical information for planning purposes for local and regional public health authorities, for assessing trends over time, comparisons across counties and regions, and for evaluation of policies and interventions. The value of such a system during times of crises was demonstrated during the COVID-19 pandemic. At the Lisbon 2024 European Public Health conference, a few selected examples of use of data from the NCPHS system will be presented. Key messages • Large-scale community surveys provide important insights for planning of public health policies and action. • Strong involvement and collaboration with regional and local public health personnell as well as with media and local people is a prerequisite for succeeding.

An Evaluation of Education Policy in England since 2010 and the Policy Consequences for Small Primary Schools

The fate of small primary schools (pupils aged five–eleven years old) in England is linked to education policy reforms. This paper presents an evaluation of selected education policy reforms in England since 2010 with suggested consequences for small primary schools. The research was undertaken using a qualitative research methodology that employed a document analysis method to create a Policy Document Analysis Frame (PDAF) for the policy evaluation. The implications of the policy reforms for small primary schools were examined through the conceptual lens of Educational Isolation. Educational Isolation identifies the limiting factors of place for a school’s access to the resources required for school improvement. Education policy reform is focused on school improvement. Small primary schools in England are typically located in rural neighbourhoods with sparse populations, resulting in an average of just over 100 pupils per school. The findings suggest that the contextual factors of place and size for small primary schools in England present disadvantages in relation to the selected national education policy reforms. The national funding formula, Multi Academy Trusts (groups of schools independently regulated but centrally funded by the state), and National Standards are the key policy reforms, driven by a neo-liberal ideology, that are suggested to have implications for the future of small schools. Recommendations are offered to the new 2024 Labour government that would support the re-instatement of small primary schools as an integral part of the education landscape in England.