Quasi-experimental Analysis Research Articles

Development of E-learning Teaching Materials Graphic Media Development Course for Students’ Educational Curriculum and Technology

This study aims at identifying the feasibility and efficacy of e-learning material for graphic media development subject by using the e-learning material provided by Universitas Negeri Surabaya. The study takes place in The Department of Technology of Education, Universitas Negeri Surabaya. The subject involves students who have participated in media graphic course. The samples are selected through simple random sampling with the amount of samples in experiment and control class is 30 students each. This development research is carried out using the development model of Four-D Model with the stages of Define, Design, Develop, Disseminate. The validation test on each unit of test proved that all of them are considered valid at Sig. 5%, while the reliability coefficient of the test is = 0.83. Feasibility test on the material and media each gains 88.5% and 87.7%, which means very feasible to apply. The effectiveness test on the e-learning material is conducted using quasi experimental group analysis technique. Based on the Independent sample t test, it was gained that (p < 0.05). N-Gain from the experiment class is 0.6 which categorized as fairly effective, while the N-Gain of the control class is 0.45 and perceived as less effective. The findings presented that e-learning material is deemed feasible and fairly effective to be used during the teaching and learning activity and could improve the students’ learning outcome.

The responsive public: How European Union decisions shape public opinion on salient policies

This study argues that the adoption of a policy by the European Union increases popular support for that policy. Elite cue theory implies that this effect only materializes among those members of the public who trust European Union institutions. Moreover, European Union member states’ unanimous policy support conveys a stronger cue than the Union’s policy endorsement despite vocal dissent. The argument is tested through original survey experiments and the quasi-experimental analysis of a survey that was fielded while the European Council endorsed a salient policy proposal. Support of the policy surged immediately after this decision—but only among Europeans who trust the Union. Experiments in original national surveys confirm that citizens who trust the European Union respond to signals from Brussels. Unanimity in the Council of the European Union augments the impact of these cues.

Large-N Qualitative Analysis (LNQA): Causal Generalization in Case Study and Multimethod Research

We describe an emerging research practice that we call Large-N Qualitative Analysis (LNQA), outline its core components and codify best practice. LNQA starts with hypothesized regularities and causal mechanisms. Regularities take two basic forms: Y generalizations (if Y then X) or X generalizations (if X then Y), albeit with more complex variants. To establish a causal generalization requires defining its scope. The strength of the regularity is simply the percentage of cases conforming with the causal claim. The causal force of LNQA, however, comes from within-case causal inference, which demonstrates the presence and operation of the postulated mechanisms in all cases in the scope. The method thus partly obviates problems arising from case selection in qualitative and multimethod work. We also identify a multimethod variant (M-LNQA), which combines LNQA with experimental, quasi-experimental, or observational statistical analysis. An appendix introduces over fifty examples of the method.

Using machine learning and remote sensing to track land use/land cover changes due to armed conflict

Armed conflicts have detrimental impacts on the environment, including land systems. The prevailing understanding of the relation between Land Use/Land Cover (LULC) and armed conflict fails to fully recognize the complexity of their dynamics – a shortcoming that could undermine food security and sustainable land/water resources management in conflict settings. The Syrian portion of the transboundary Orontes River Basin (ORB) has been a site of violent conflict since 2013. Correspondingly, the Lebanese and Turkish portions of the ORB have seen large influxes of refugees. A major challenge in any geoscientific investigation in this region, specifically the Syrian portion, is the unavailability of directly-measured “ground truth” data. To circumvent this problem, we develop a novel methodology that combines remote sensing products, machine learning techniques and quasi-experimental statistical analysis to better understand LULC changes in the ORB between 2004 and 2022. Through analysis of the resulting annual LULC maps, we can draw several quantitative conclusions. Cropland areas decreased by 21–24 % in Syria's conflict hotspot zones after 2013, whereas a 3.4-fold increase was detected in Lebanon. The development of refugee settlements was also tracked in Lebanon and on the Syrian/Turkish borders, revealing different LULC patterns that depend on settlement dynamics. The results highlight the importance of understanding the heterogenous spatio-temporal LULC changes in conflict-affected and refugee-hosting countries. The developed methodology is a flexible, cloud-based approach that can be applied to wide variety of LULC investigations related to conflict, policy and climate.

How effective is the professional development in which teachers typically participate? Quasi-experimental analyses of effects on student achievement based on TIMSS 2003–2019

This study examines the effect of teachers’ participation in mathematics and science professional development (PD) on student achievement in nationally representative settings. We use data from all OECD countries in the 2003 through 2019 cycles of the Trends in International Mathematics and Science Study (TIMSS) and apply student fixed effects to control for unobserved student characteristics and school quality. We find a small negative average effect of PD participation, with negative effects concentrated among high-performing students. We discuss potential explanations of these results and suggest ways PD studies may inform the PD in which teachers typically participate.

Impact of the publication of the Finnish Meds75+ database on the use of potentially inappropriate medications in older persons.

To evaluate the impact of the updated nationwide Meds75+ database and its linkage to the Finnish health portal on the use of potentially inappropriate medications (PIMs) among older persons. We also aimed to evaluate whether there is regional variation in trend changes of PIM use. Meds75+ was implemented at the population level in 2015, so randomization is unfeasible. We used a quasi-experimental interrupted time series analysis to evaluate the changes in levels and trends of PIM use. The data included all Finnish community-dwelling persons aged ≥75 years (N = 920 163) who had medication purchases in the Prescription Register during 2009-2020. Data were linked with the Care Registers for Health and Social Care and the cause of death register. The prevalence of PIMs decreased from 20.2% in 2009 to 11.7% in 2020. The change of level of the monthly PIM users was negative (β -0.036, 95% confidence interval [CI] -0.202 to 0.131), but not statistically significant (P = .673) after the publication of the database. We found a small decrease (β -0.018, 95% CI -0.083 to 0.047, P = .593) in the slope of PIM users, but it was not statistically significant. The regional results were similar to the main findings. Publication of the updated Meds75+ database did not decrease the level or trend of PIM users. In addition, this study did not show any significant regional variation in PIM use trends. Further research should focus on determining barriers and facilitators to the utilization of PIM criteria in clinical practice.

Growth Performance and Interrupted Time Series Approach to Estimate Immediate and Sustained Effects of Oilseeds Mission on Groundnut in India

Oilseeds are mostly grown in marginal lands with inadequate irrigation facilities (only 10% is irrigated) as a result yields tend to be low leading to a widening gap between domestic production of vegetable oil and demand. Production growth in the early eighties was slow due to insufficient technologies and the turning point was the year 1985-86. Since then, oilseeds production in the country has increased due to implementation of technology mission. The present study was attempted to examine the growth performance of groundnut in the major states of India and assess the immediate and sustained effects of oilseeds mission on groundnut production in order to identify the potentials for future expansion of area and scaling -up the yield of groundnut-based production system. Growth and quasi experimental time series analyses were employed to assess the growth performance and intervention’s effects (oilseeds mission) using time series data. Increase in groundnut production has been contributed mainly by increase in productivity. Though the maximum productivity growth was 6.24% per annum in India, overall growth rate in yield was 2.28 % per annum due to yearly aberrations indicating the high instability. Groundnut yield grew by 3.84, 3.06 and 2.16 % per annum respectively in Rajasthan, Madya Pradesh and Tamil Nadu for the overall period (1992-93 and 2020-21). However, these states witnessed production shortfalls and production fell by 0.94, 6.42 and 2.05 % per annum, respectively. Except Gujarat the other major states also exhibited negative growth in production and the rate of drop was higher in the Uttara Pradesh (7.91%) followed by Madhya Pradesh (6.42%), Maharashtra (4.94%), Andhra Pradesh (3.69%) and Karnataka (3.03%). Groundnut production in India also fell by 2.13 % per annum mainly due to fall in area and marginal growth in yield. The estimated yield increase was 450 kg/ha in India, which is higher by 48 % after the intervention. The estimated positive and significant coefficient of interrupted time series for India (50.36) reveal that the oilseeds mission has created sustained effects as a result there was a yield improvement. Sustained effects of intervention are noticed in most of the states. Sustaining the productivity in those states with high yield potential and improving the productivity in other major states by prioritizing and disseminating the seeds of suitable varieties and production technologies are vital as there is lackluster response from the farmers in adoption of varieties and technologies.

Management for Acute Uncomplicated Appendicitis During Pregnancy: National Trends and Patient Outcomes.

This study analyzes national trends in the management of uncomplicated appendicitis during pregnancy, comparing outcomes for nonoperative management (NOM) and appendectomy. In the nonpregnant population, several randomized controlled trials demonstrated noninferiority of NOM compared with appendectomy for acute uncomplicated appendicitis. However, it remains unclear whether these findings are generalizable to pregnant patients. The National Inpatient Sample was queried for pregnant women diagnosed with acute uncomplicated appendicitis from January 2003 to September 2015. Patients were categorized by treatment: NOM, laparoscopic appendectomy (LA), and open appendectomy. A quasi-experimental analysis with interrupted time series examined the relationship between the year of admission and the likelihood of receiving NOM. Multivariable logistic regression analyses were used to evaluate the association between treatment strategy and patient outcomes. A total of 33,120 women satisfied the inclusion criteria. Respectively, 1070 (3.2%), 18,736 (56.6%), and 13,314 (40.2%) underwent NOM, LA, and open appendectomy. The NOM rate significantly increased between 2006 and 2015, with an annual increase of 13.9% (95% CI, 8.5-19.4, P <0.001). Compared with LA, NOM was significantly associated with higher rates of preterm abortion (odds ratio [OR]: 3.057, 95% CI, 2.210-4.229, P <0.001) and preterm labor/delivery (OR: 3.186, 95% CI, 2.326-4.365, P <0.001). Each day of delay to appendectomy was associated with significantly greater rates of preterm abortion (OR: 1.210, 95% CI, 1.123-1.303, P <0.001). Although NOM has been increasing as a treatment for pregnant patients with uncomplicated appendicitis, compared with LA, it is associated with worse clinical outcomes.

Folkloric dance and its contribution to the reduction of sedentary lifestyle in teaching staff

The teaching staff is going through an occupational health problem due to the long working hours that they have little free time left to develop; One of the factors that affects the sedentary lifestyle of teachers, is the null practice of work recreation within the school institutions, since it originates from the ignorance of the benefits offered by recreation, it is precisely in this research that emphasizes the awareness of the benefits of work recreation in teaching staff, focused from the dance part within the working day in the face of this problem there is a large number of studies that explain the benefits of work recreation as a strategy to reduce sedentary lifestyle in teachers of the tax education system. For this reason, the article focuses its attention on evaluating a recreational program of folkloric dance as a means of reducing sedentary lifestyle aimed at high school teachers of the fiscal system. The project is based on different research designs starting from the documentary, field and quasi-experimental analysis, through the application of tests directed to the teachers and the sedentary lifestyle that allowed to collect significant amounts to determine the diagnosis; As a result of these investigative analyzes, the final conclusion was reached that responds to the stated objective, which is to reduce sedentary lifestyle in teachers. Therefore, it is affirmed that the Folk Dance Recreational Program has significant effects on the reduction of sedentary lifestyle in secondary education teachers of the fiscal system.

The impact of telework on the satisfaction of U.S. federal workers

ABSTRACT Evidence has been somewhat mixed on how telework affects job satisfaction, career advancement, and relationships with supervisors. Larger samples and better measures of telework and control variables, however, suggest that frequent telework increased satisfaction with jobs, advancement opportunities, fair treatment, supervisors, and co-workers in both the 2012–2015 and the 2020 Federal Employee Viewpoint Surveys. A quasi-experimental analysis shows that switching to frequent telework during the pandemic decreased turnover intentions. Employees now understand the benefits of teleworking. Supervisors must learn to communicate and monitor performance online in this new reality or face increased resistance and turnover.

Carbon Emission Reduction Effects of the Digital Economy: Mechanisms and Evidence from 282 Cities in China

The digital economy has great potential to boost innovation and social productivity, and it plays an important role in helping to achieve carbon peak and carbon neutrality. This study focuses on analyzing and testing the role of the digital economy in promoting carbon reduction in Chinese cities. Based on panel data of 282 cities in China from 2011 to 2019, this study measured the development level of the digital economy and carbon emission intensity by constructing a digital economy development level evaluation index system and a carbon emission inversion model, respectively. It was found that the digital economy can significantly reduce urban carbon emissions by promoting industrial structure upgrading and green innovation, and the digital economy will have a more obvious promotion effect on urban carbon emission reduction over time. This conclusion was found to be valid after we performed robustness tests such as the instrumental variable method, quasi-experimental analysis, and placebo test. Furthermore, heterogeneity analysis showed that eastern, regenerative, and provincial capital cities are better able to promote carbon emission reduction under the development of the digital economy. This study provides new empirical evidence at the city level for developing the digital economy to reduce urban carbon emissions and acts as a useful reference for developing countries to realize “smart carbon emission reduction”.

Application of Project-Based Learning (PjBL) Models Assisted with Teaching Aids to Improve Students' Science Process Skills on Work and Energy Materials

This research aimed to assess if MAS Syamsuddhuha's application of the PjBL model has increased the efficiency of the student's training processes. This analysis is a quasi-experimental design analysis. The subjects of this research are students from grades X IPA 4 as the experimental class and X IPA 5 as the control class. During the experiment, the experimental class used the PjBL model with teaching aids, whereas the control class used the PjBL model during the teaching process. The design method used in this study is called nonequivalent control group design. Instrumental research tools in the form of tests and observation sheets are used to observe students' science process skills. The hypothesis uses a non-parametric test for the post-test sample rate. The results showed that the post-test experimental class score was 81.19, and the control class post-test score was 66. Applying the PjBL model with teaching aids has increased students' science process skills in work and energy.

Complementary and Integrative Health Approaches and Pain Care Quality in the Veterans Health Administration Primary Care Setting: A Quasi-Experimental Analysis.

Background: Complementary and integrative health (CIH) approaches have been recommended in national and international clinical guidelines for chronic pain management. We set out to determine whether exposure to CIH approaches is associated with pain care quality (PCQ) in the Veterans Health Administration (VHA) primary care setting. Methods: We followed a cohort of 62,721 Veterans with newly diagnosed musculoskeletal disorders between October 2016 and September 2017 over 1-year. PCQ scores were derived from primary care progress notes using natural language processing. CIH exposure was defined as documentation of acupuncture, chiropractic or massage therapies by providers. Propensity scores (PSs) were used to match one control for each Veteran with CIH exposure. Generalized estimating equations were used to examine associations between CIH exposure and PCQ scores, accounting for potential selection and confounding bias. Results: CIH was documented for 14,114 (22.5%) Veterans over 16,015 primary care clinic visits during the follow-up period. The CIH exposure group and the 1:1 PS-matched control group achieved superior balance on all measured baseline covariates, with standardized differences ranging from 0.000 to 0.045. CIH exposure was associated with an adjusted rate ratio (aRR) of 1.147 (95% confidence interval [CI]: 1.142, 1.151) on PCQ total score (mean: 8.36). Sensitivity analyses using an alternative PCQ scoring algorithm (aRR: 1.155; 95% CI: 1.150-1.160) and redefining CIH exposure by chiropractic alone (aRR: 1.118; 95% CI: 1.110-1.126) derived consistent results. Discussion: Our data suggest that incorporating CIH approaches may reflect higher overall quality of care for patients with musculoskeletal pain seen in primary care settings, supporting VHA initiatives and the Declaration of Astana to build comprehensive, sustainable primary care capacity for pain management. Future investigation is warranted to better understand whether and to what degree the observed association may reflect the therapeutic benefits patients actually received or other factors such as empowering provider-patient education and communication about these approaches.

A quasi-experimental analysis on the causal effects of COVID-19 on urban park visits: The role of park features and the surrounding built environment

Although many studies have explored the correlations between mobility intervention policies and park use during COVID-19, only a few have used causal inference approaches to assessing the policy’s treatment effects and how such effects vary across park features and surrounding built environments. In this study, we develop an interrupted time-series quasi-experimental design based on three-month mobile phone big data to infer the causal effects of mobility intervention policies on park visits in Shenzhen, including the first-level response (FLR) and return-to-work (RTW) order. The results show that the FLR caused an abrupt decline of 2.21 daily visits per park, with a gradual reduction rate of 0.54 per day, whereas the RTW order helped recover park visits with an immediate increase of 2.20 daily visits and a gradual growth rate of 0.94 visits per day. The results also show that the impact of COVID-19 on park visits exhibited social and spatial heterogeneities: the mobility-reduction effect was smaller in low-level parks (e.g., community-level parks) with small sizes but without sports facilities and water scenes, whereas parks surrounded by compact neighborhoods and land use were more impacted by the pandemic. These findings provide planners with important insights into resilient green space and sustainable neighborhood planning for the post-COVID era.

Early Award Scholarship Program Results in Improved Attendance and State Math Test Scores for Students from Lower-Income Households

In this study we conduct a quasi-experimental analysis comparing students who enrolled in Early Award Scholarship Program (EASP) (formerly Promise Scholars) at any time during the 2016–17 or 2017–18 school year with their counterparts who did not enroll in the program during this time. We employed an inverse-propensity weighting (IPW) design to adjust for baseline differences in characteristics between students who did enroll in EASP (treatment) and students who did not enroll in the program (comparison) using pretreatment administrative data from 2015–16. This IPW approach successfully removed baseline differences for baseline equivalence between a treatment and comparison group. Our findings show that participation in EASP results in significant educational benefits—higher state math test scores and improved attendance—for students from lower-income households (students receiving free/reduced lunch) but not their economically more advantaged peers. No impacts were found for ELA test scores. In short, these findings suggest that EASP may be an effective gap-closing program that improves math achievement and attendance for students from lower-income households. Effects are stronger for students who earned more award dollars by participating in more incentivized engagement activities across the 2016–17 and 2017–18 school years.

Impacts of Outpatient Payment Reforms on Volume and Expenditures in Public Hospitals: Evidence from a Quasi-Experimental Analysis in Zhejiang, China.

China developed an innovative episode-based payment scheme for outpatient care, namely "Ambulatory Patient Groups (APGs) + capitation" payment, to constrain inflation in outpatient expenditures. This study aimed to assess the effects of this payment method on volume and expenditures in Chinese public hospitals. A quasi-experimental study was conducted with 7 municipal and 12 county hospitals from Jinhua as the intervention group and 15 municipal and 24 county hospitals from three neighbouring cities as the control group. The payment reform was introduced to municipal and county hospitals in the intervention group in January 2020 and January 2021, respectively. Monthly data on volumes and outpatient expenditures were collected from each hospital from January 2019 to December 2021. Controlled interrupted time-series analyses were performed to determine the effects of the funding reforms. Outpatient visits in municipal hospitals decreased by 1417.54 (p=0.048) per month on average compared with control ones after the reform was implemented, whilst that in county hospitals increased by 1058.04 (p=0.041) per month on average. The trend of drug expenditures (β 7=-1.41, p=0.019) in municipal hospitals dropped, which was accompanied by an immediate reduction in consumable expenditures (β 6 =-6.89, p=0.044). The funding reform also led to the significant declines in drug (β 6=-10.96, p=0.009) and consumable (β 6=-4.78, p=0.041) expenditures in county hospitals. Municipal hospitals experienced the drop in the trend of total outpatient expenditures (β 7=-3.99, p=0.018) over the same period. The strength of the "AGPs + capitation" payment for outpatient care lies in its ability to control the excessive growth of medical expenses through correcting inappropriate incentives. However, minimising potential cost-shifting and risk-shifting to uninsured service items should be given attention.

Short-term impacts of all-driver handheld cellphone bans on high-schoolers’ texting while driving: quasi-experimental analyses of Illinois and Georgia

Teen drivers are more likely than their older counterparts to engage in distracted driving. Many states prohibit cellphone use for teen drivers, but only prohibit texting for all drivers. Evidence that these laws have been effective is mixed. We hypothesize that recent policy changes in Georgia and Illinois from teen cellphone bans with all-driver texting bans to all-driver handheld phone bans yielded short-term reductions in teen texting while driving. We analyzed Youth Risk Behavior Surveys in Georgia, Illinois, and control states North Carolina and Michigan. We estimated the reduction in texting while driving associated with policy changes via difference-in-differences models. In Illinois, 45.4 % of high school drivers texted while driving in 2013. After a 2014 policy change to an all-driver handheld ban, the percentage decreased in 2015 to 41.8 %, and decreased further in 2017 to 37.7 %. The adjusted DID estimate comparing Illinois to Michigan from 2013 to 2017 was −8.3 % (95 % CI: −15.5 % 1.1 %; p-value = 0.025). In Georgia, the percentage decreased from 37.5 % before the law to 30.8 % after, and the adjusted DID estimate comparing Georgia to North Carolina was −10.8 % (95 % CI: −19.0 %, −2.5 %; p-value = 0.011) than in North Carolina. Results support all-driver handheld phone bans to improve traffic safety for high school drivers.

Difference-in-difference estimation in combined feedback on writing skill: a quasi-experimental study

PurposeThis quasi-experimental study examined the effectiveness of audio-visual and written feedback (AVF + WF) on undergraduate students versus only receiving WF in the context of an English as a Foreign Language (EFL) online classroom during the coronavirus disease 2019 (COVID-19) lockdown.Design/methodology/approachThe study used the estimator Difference in Difference (DID) to compare a treated and control group in a pre-and post-test under the application of six treatment sessions, plus a student's perception survey at the end of the treatment. The treated group that received the multimodal feedback showed higher improvement rates in the paragraph content between the first and final drafts than students in the control group.FindingsResults indicated that receiving a combination of AVF + WF had a statistically significant effect on mechanics (p < 0.001) and the use of transition words (p = 0.003).Practical implicationsThese findings will benefit educational agents, professors and stakeholders for social and economic development.Originality/valueWhile previous studies have only used student perceptions of the feedback, this study contributes with empirical data through quasi-experimental analysis and measures the effectiveness of feedback in online learning environments.

The Role of BISP’s Unconditional Cash Transfers in Alleviating Extreme Poverty in Pakistan: A Quasi-Experimental Analysis for the Period 2011–2019

The Role of BISP’s Unconditional Cash Transfers in Alleviating Extreme Poverty in Pakistan: A Quasi-Experimental Analysis for the Period 2011–2019

How do male nursing students' voluntary activities affect their image in society?

To determine the effect of male nursing students' voluntary activities on their image in society. The role of voluntary nursing services in enhancing the visibility of nursing in society can also contribute to enhancing the image of male nurses in society. This study employed a one-group, quasi-experimental pre-post analysis design. It was carried out between September 2020 and June 2021 in the pedestrian zone, which is one of the main streets of Bartın in Turkey. Using a convenience sampling approach, tradesmen aged 18 and over operating in commercial enterprises (n=81) were asked to participate in the study. Information form and Nursing Image Scale were used to collect the research data. Results from the paired sample t test were utilized to analyse the study's data using the intervention of 'men nursing students' voluntary activities'. The total Nursing Image Scale score of the participants was statistically considerably greater after the intervention than the pre-intervention score. Based on the paired sample t test results, it was observed that the participants obtained higher scores after the intervention than before in the gender sub-dimension as well as all other sub-dimensions of the Nursing Image Scale, and these results were statistically significant. According to the findings of the study, volunteering by male nursing students improved both the profession of nursing and the perception of men in nursing in society. This study suggested that male nursing students' voluntary activities could be one of the strategies to overcome the nursing shortage due to its enhancing effect on the profession of nursing and the perception of men in nursing in society.