Evidence-based Instructional Practices Research Articles

Recommendations for Integrating Automated Writing Evaluation with Evidence-Based Instructional Practice

Automated writing evaluation systems are formative assessment systems that provide immediate, automated feedback on L1, L2, and EFL students' writing in the form of writing-quality scores and suggestions for revising. As such, these systems have the potential for alleviating some of the persistent barriers teachers face to implementing evidence-based writing instruction practices. However, simply adopting this technology without careful attention to how it is implemented will not guarantee instructional benefits. In this article we draw on prior research to make recommendations to effectively integrate automated writing evaluation alongside evidence-based writing instruction practices to improve writing instruction and intervention, leveraging the affordances of this technology while addressing its limitations. Specifically, we discuss how researchers, interventionists, and educators using automated writing evaluation should develop students' knowledge of underlying evaluation criteria; teach strategies for planning, drafting, and revising; supplement automated feedback with effective teacher-provided feedback; and enact goal setting and progress monitoring.

Evidence-Based Instructional Practices for Twice-Exceptional Students With Autism

Academically talented students with autism, also known as twice-exceptional students with autism (2eASD), are increasingly identified in school. These students present challenges to educators who attempt to plan and implement successful instructional opportunities, as teachers’ knowledge and use of evidence-based practices (EBPs) for students identified with 2eASD vary. The purpose of this qualitative study was to identify current practices used by 10 high-school content and special education teachers who teach these students, as well as their recommendations for postsecondary institutions for these students. The findings suggest high-school teachers support the use of differentiated, strength-based individualized instruction for college-bound students with 2eASD, but are generally unable to offer specific examples of how these practices are implemented in their special education or content classrooms. In addition, they seldom focus on the strengths and talents of this population in their classrooms and fail to recommend competitive colleges for their consideration.

A class-oriented architecture for designing learning apps

ABSTRACT In the age of Apps, where almost everyone is fast becoming accustomed to using apps in almost every walk of life. Such widespread production, consumption, and burgeoning proliferation of Apps are also frequently seen in the various educational pitches and we call them “Learning Apps” (LAs). Now, approximately everyone is believing in and engaging through these apps as the mandatory future of our educational-organizations. However, their overwhelming nature surprised everyone including learners, parents, and other stockholders. Every day, a thousand apps get published, and continuously adding in educational categories of various app stores. Significantly, most LA developers are targeting preschoolers. And, who knows if they contain true educational values or not? Nevertheless, this scenario seems elusive. We observe the emergence of several de facto design paradigms, having no or little theoretical basis. Moreover, their design features do not scientifically connect with evidence-based teaching practices. Despite the expansion of enterprises and the development of new tools and technology, there is a lack of a sound app design strategy grounded in established didactics. Realizing this, we developed A Class-oriented Architecture of LAs to facilitate the content experts’ design.

Design and Development of Virtual Reality Application Implementing Age-Friendly Care and the 4Ms: A Quality Improvement Project.

With an increase in the aging population, the application of evidence-based practice in geriatric education can strengthen knowledge, skills, and clinical experience for healthcare students caring for older adults. The Age-Friendly Health System (AFHS) is one of the frameworks founded on providing evidence-based and low-risk care centered on what matters most to older adults, their families, and caregivers. Virtual reality (VR) platforms are gaining popularity due to their ability to provide an immersive, hands-on learning experience resembling an actual medical practice or care setting. Immersive learning enhances students' sensory perceptions, promoting an innovative and engaging way of acquiring concepts that are difficult to teach in real life. This study aimed to design, develop, implement, and evaluate a case-based training module highlighting AFHS and educating medical students on the 4Ms approach in geriatric care (What Matters, Medication, Mentation, and Mobility). The project was a feasibility study completed in two phases. Phase one included planning and developing a case-based scenario incorporating the 4Ms of AFHS. Phase two included implementing and evaluating the VR training module into the geriatric curriculum for medical students. The final VR case displays a hospital and post-acute setting where an elderly patient is admitted for a hip fracture. Students learn how to triage and treat patients from admission to discharge while demonstrating their knowledge of AFHSs. Approximately 10% of students completed the evaluation survey, and preliminary results indicate significant knowledge change in pre-post scenario-based training on an AFHS. The VR education platform and embedded scenario promise an innovative adaptation of technology in learning the concepts of the 4Ms of AFHSs. However, future studies should explore VR education with clinical assessment evaluation to ensure competence in providing age-friendly care.

Experiences Using Media Health Claims to Teach Evidence-Based Practice to Healthcare Students: A Mixed Methods Study

Background A multifaceted and interactive teaching approach is recommended for achieving proficiency in evidence-based practice, with critical thinking considered vital for connecting theory and practice. In this context, we advocate the strategic use of health claims in the media to promote critical thinking, complemented by a blended learning approach and a group exam. Method We conducted a convergent mixed methods study, including a cross-sectional survey with structured and open-ended questions as well as focus group interviews, at Oslo Metropolitan University, during the 2020-2021 academic year. Participants were bachelor’s students in healthcare. We employed a blended learning approach, combining digital learning resources, teaching in critical assessment of health claims and evidence-based practice, and a concurrent group exam assignment centered around media health claims. The outcome measures included students’ experiences integrating health claims into evidence-based practice teaching and their experiences with teaching approaches and the group exam. Results Out of 465 participants, 136 (29.2%) responded to the structured questions in the survey. In response to the open-ended questions within the survey, 109 (80.1%) of the respondents shared positive experiences about the course, while 98 (72%) suggested improvements. Additionally, 25 students participated in focus group interviews. Synthesizing the results, we found that students viewed the inclusion of health claim assessment as a useful entry point for learning evidence-based practice. In addition, the students identified both the blended learning design and the group exam as contributors to a positive perception of learning outcomes from the course. Conclusions Based on student feedback, integrating critical reflection on media health claims into evidence-based practice education, alongside a blended learning approach and a group exam, may be beneficial in teaching evidence-based practice to bachelor’s healthcare students. However, further rigorous study designs are needed to objectively assess the effect of the course on learning outcomes. Registration DOI 10.5281/zenodo.6985449

PULSE Ambassadors program: empowering departments to transform STEM education for inclusion and student success.

The Partnership for Undergraduate Life Sciences Education (PULSE) is a non-profit educational organization committed to promoting the transformation of undergraduate STEM education by supporting departments in removing barriers to access, equity, and inclusion and in adopting evidence-based teaching and learning practices. The PULSE Ambassadors Campus Workshop program enables faculty and staff members of host departments to 1) develop communication, shared leadership, and inclusion skills for effective team learning; 2) implement facilitative leadership skills (e.g., empathic listening and collaboration); 3) create a shared vision and departmental action plan; and 4) integrate diversity, equity, and inclusion practices in the department and curriculum. From the first workshop in 2014, teams of trained Ambassadors conducted workshops at 58 institutions, including associate, bachelor, master, and doctoral institutions. In their workshop requests, departments cited several motivations: desire to revise and align their curriculum with Vision and Change recommendations, need for assistance with ongoing curricular reform, and wish for external assistance with planning processes and communication. Formative assessments during and immediately following workshops indicated that key outcomes were met. Post-workshop interviews of four departments confirm progress achieved on action items and development of individual department members as agents of change. The PULSE Ambassadors program continues to engage departments to improve undergraduate STEM education and prepare departments for the challenges and uncertainties of the changing higher education landscape.

An exploration of the relationship between active learning and student motivation in STEM: a mixed methods study.

Much of the research on science, technology, engineering, and mathematics (STEM) students' motivation measures the relationship between student motivation and academic outcomes, focusing on the student's mindset. Our mixed-methods research takes a different approach and considers the relationship between student motivation and instructional practices. Teaching practices and student motivation were analyzed simultaneously in undergraduate Biology classes using a self-determination theory-based survey to measure students' motivation during courses that were observed using the Classroom Observation Protocol for Undergraduate STEM (COPUS), and observation notes were collected to document instructor and student behaviors. Quantitative data were used to differentiate students' motivational levels, and qualitative data were collected to describe how instructors use specific teaching practices. The results provide a lens into how students' intrinsic motivation varies alongside the instructional practices and interactions in these classes. We found a correlation between higher levels of student motivation in interactive lectures and student-centered teaching profiles. This study highlights how the same practice can be implemented by multiple instructors with varying student motivation scores, pointing out the importance of fidelity to evidence-based instructional practice methods. The results of this study are discussed in the context of published empirical studies examining evidence-based instructional practices that are conceptually supportive of autonomy, competence, and relatedness. Active learning practices observed in this study correlated to positive learning outcomes are discussed and may serve as a guide for instructors interested in implementing specific active learning practices. Recommendations for instructors and departments that are interested in flexible methods to monitor progress toward active learning practices in biology and other STEM disciplines by combining the COPUS and self-determination survey results are presented.NEW & NOTEWORTHY This study uses a novel combination of instruments to describe students' intrinsic motivation in response to teaching practices. Findings demonstrate that active learning methods may support higher student motivation. Recommendations drawn from the study include using a variety of active learning methods, using evidence-based instructional methods with fidelity, and monitoring the students' affective response to those methods. Alignment of active learning practices to the components of self-determination may result in higher quality student motivation in science, technology, engineering, and mathematics (STEM) courses.

An Exploratory Mixed-Methods Analysis of Factors Contributing to Students' Perceptions of Inclusion in Introductory STEM Courses.

In this exploratory mixed-methods analysis of students' perceptions of inclusion in introductory STEM courses for STEM majors, we asked students to rate inclusion in their class and to provide an open-text explanation of their rating. Analyzing 1930 qualitative responses resulted in a codebook containing academic, identity, and nonspecific categories. The majority of responses (>80%) cited academic factors such as interactions between students and instructors or course elements and policies. Most academic responses aligned with evidence-based teaching practices fostering inclusion, describing a range of strategies and policies instructors can implement to increase students' perceptions of inclusion. A small number of student responses indicated that their perception of the required knowledge background for the course impacted course inclusivity. Few differences in frequency distributions were found between subgroups examined (gender, race and ethnicity, self-reported inclusion score, and discipline). Additionally, tracking a subset of students (135) across three courses revealed that most (80%) cited different factors influencing their perception of inclusion in each course. This suggests students' perceptions of inclusive practices are complex, and most students recognize multiple factors that influence their inclusion. Overall, our findings suggest instructors can significantly influence students' perceptions of inclusion by using multiple inclusive teaching strategies and course policies.

Effects of Evidence-based Intravenous Infusion Therapy Practice Education for Nursing Students Applying the Peer Teaching Method between Seniors and Juniors: A Quasi-Experimental Study

Purpose: This study aimed to organize a training program for nursing students using the peer teaching method between seniors and juniors and to investigate its effects on self-confidence, skill performance ability, and self-directed learning ability.Methods: A non-equivalent control group pretest-posttest design was used. The study population comprised 76 nursing students (experimental group, n=37; control group, n=39) from two universities. The experimental group received four training sessions of 2 hours each, during which peer teaching was applied between seniors and juniors. Data were collected between September 4 and September 15, 2023 and analyzed using SPSS for Windows version 28.0.Results: Compared with the control group, the experimental group exhibited significant increases in self-confidence (t=4.36, p<.001), skill performance ability (t=4.74, p<.001), and selfdirected learning ability (t=2.25, p=.027).Conclusion: Peer teaching between seniors and juniors was found to be an effective tool in nursing education to cultivate nursing students' skill performance confidence, skill performance ability, and self-directed learning ability. The findings of this study can guide nursing professors in designing and implementing educational programs that incorporate peer teaching between seniors and juniors. Future studies should continue to apply peer teaching to nursing education programs and evaluate its effectiveness.

Exploring the teaching methods used in graduate teaching assistant-led calculus recitations

ABSTRACT Many universities offer recitation sections taught by graduate teaching assistants (GTAs) as a way to supplement their large enrolment calculus courses. While some mathematics departments have revamped their calculus recitations to feature more evidence-based teaching practices, other departments rely on GTAs to decide how to run the recitation and what content to cover. In this latter context, more needs to be learned about the teaching practices of GTA recitation leaders and their impact on different student outcomes. As such, this study examines the teaching methods that twelve GTAs chose to implement in their calculus recitation sections. The goal of this study was twofold: (1) to examine whether GTAs utilised evidence-based teaching practices such as student-centred instruction and conceptually-oriented instruction, and (2) whether these practices were related to calculus students' attitudes toward the recitation, student engagement in the recitation, and students' expected final course grades. Using quantitative dominant mixed-methods, findings demonstrate that GTAs used a range of student-centred practices; however, they primarily emphasised the procedural aspects of calculus. Student-centred instructional practices were found to have a positive relationship with students' course attitudes, engagement, and predicted final examination grades. Focusing on concepts, had less of a relationship with these outcomes.

Scientific Writing Training for Teachers in Kindergarten for Children in Jambi City

Training on writing scientific papers for Kindergarten teachers in Buah Hati Jambi City aims to improve the professionalism and skills in writing scientific papers of teachers. This training was carried out face to face for one day involving 10 teachers. The methods used include lectures, question-and-answer sessions, group discussions, and practical exercises. The evaluation showed very enthusiastic and active participation from the participants, with significant improvements in the ability to write scientific papers. Evaluation results through writing assignments, satisfaction surveys, observations, and in-depth interviews show that participants can understand and apply techniques for writing scientific papers better. This training has a positive short-term impact in the form of increasing technical skills and teacher confidence and is expected to have a long-term impact on improving the quality of education through the implementation of evidence-based teaching practices. Overall, this training made a significant contribution in improving the professional competence of the Buah Hati Kindergarten teachers in Jambi City. Recommendations for future training include increasing length, individual coaching sessions, and the use of interactive learning media. This training is an important first step in efforts to improve the quality of education in the region.

Administrative and leadership requirements for implementing evidence-based practices in special education programs: the perspective of special education teachers

Administrative and leadership requirements are crucial to the application of evidence-based practices (EBPs) in special education. Therefore, the current study aimed to assess the availability of administrative and leadership requirements for applying EBPs in special education programs from the teachers’ perspective, as well as determine the differences in their availability depending on the variables of disability category (intellectual disability (ID), autism spectrum disorder (ASD), and learning disabilities (LDs)) and school stage (e.g., primary or middle school). The sample included 243 special education teachers working in the city of Riyadh, Kingdom of Saudi Arabia. A questionnaire on the administrative and leadership requirements for implementing EBPs in special education programs (prepared by the researchers) was used to collect data. The results revealed the availability (which ranged from moderate to high) of administrative and leadership requirements for implementing EBPs. Moreover, there were differences in the availability of administrative and leadership requirements according to students’ disability category; these differences were in favor of the learning disability group. However, there were no differences according to the academic stage. We recommend conducting further research on administrative and leadership requirements using different methods.

Electronic Newsletters as a Professional Development Tool for Rural Educators

Rural educators need access to evidence-based instructional practices and technologies that meet the needs of our communities. Difficulty accessing quality professional development due to geographic isolation, limited access to specialists, cost constraints, staffing shortages, lack of access to resources and technology, and less time to participate in meaningful professional development are common barriers facing rural teachers. One way to disseminate evidence-based practices is through an electronic newsletter. This article shares how a behavior analyst developed an online newsletter to build relationships, offer resources, highlight staff achievement, provide instruction, and model evidence-based behavior interventions for school staff.

Evaluating the Impact of an Evidence-Based Practice Education Program on Clinical Nurses’ EBP Competencies at HMC, Qatar: A Pre-Post Study

Evaluating the Impact of an Evidence-Based Practice Education Program on Clinical Nurses’ EBP Competencies at HMC, Qatar: A Pre-Post Study

Enhancing teaching and learning of evidence-based practice via game-based learning

Introduction: The Singapore Institute of Technology-University of Glasgow (SIT-UofG) Nursing Programme has traditionally taken a didactic teaching approach in the delivery of the Evidence-Based Practice (EBP) module. A hybrid approach was introduced using Game-Based Learning (GBL) to encourage active learning through gameplay. Methods: A Randomised Controlled Trial (RCT) was undertaken encompassing a cohort of 100 Nursing students taking the EBP module in their first year at the Singapore Institute of Technology (SIT) in the 2021/22 academic year. The experimental group (n=27) worked through the online GBL intervention and the EBP module, while the control group (n=27) took the EBP module alone. The GBL included five Learning Quests and three case studies. Results: High levels of satisfaction were reported by both the experimental group (n=22) and the control group (n=15) on the traditional content and delivery of the EBP module. High levels of engagement were reported by the experimental group on the GBL intervention; a one-sample statistics analysis confirming a significant level of engagement (p<0.001). A Mann-Whitney U Test, however, found no significant difference in the Continuous Assessment (CA) scores of the two groups (p=0.507 and 0.461). Conclusion: The introduction of GBL designed to deliver educational content directly associated with the learning outcomes increased the nursing student engagement in the EBP module. These findings and discoveries can be utilised to improve the GBL intervention to the EBP module to have a more positive impact the student CA scores and therefore on student learning. Keywords: Evidence-Based Teaching, Evidence-Based Practice (EBP), Nursing Education, Game-Based Learning (GBL), Teaching and Learning EBP, Nursing Students, Gamification

Knowledge, skills, and attitudes of nursing students on evidence - based practice

ABSTRACT Background: Evidence - based practice (EBP) has not only emerged as a trend but has also established itself as a standard in nursing professional practice. Consequently, it is imperative that undergraduate nursing students are proficient in EBP before graduation. This study aims to evaluate nursing students’ competencies (knowledge, skills, and attitudes) in EBP. Methods: 230 nursing students participated in the cross - sectional study. Data were collected using the “Evidence - Based Practice Competencies Questionnaire” (EBP - COQ), which was translated into Vietnamese. Results: The average score of nursing students on the EBP - COQ was 3.56 ± 0.39. Among the components, attitude had the highest score, with 3.77 ± 0.45, followed by knowledge with a score of 3.38 ± 0.53, and skills with the lowest score of 3.27 ± 0.52. Conclusions: The competency of nursing students regarding EBP was found to be good. The results of the study provide valuable insights that can assist nursing educators in guiding their teaching of EBP for nursing students.

Using case-based learning to enhance students’ performance in mechanical engineering undergraduates

Among the myriad of instructional approaches in engineering education, case-based learning (CBL) has emerged as a promising pedagogical strategy that promotes active learning, critical thinking, and real-world application of knowledge. This study investigates student performance and satisfaction with CBL methodologies in the context of mechanical engineering education, conducted in Sri Lanka. A mixed-methods approach was employed, including paired t-tests to analyze academic performance data and a survey to assess student perceptions and practices. The results indicate a positive relationship with grades and perception of CBL among students, with a majority expressing agreement or strong agreement with its implementation. Additionally, results from the survey discovered that conversational AI systems and chatbots emerged as a much-preferred supplementary resource utilized by students. Recommendations for future higher education methodologies include enhancing the integration of CBL, leveraging technology-driven resources, promoting active learning strategies, implementing continuous assessment and feedback mechanisms, investing in educator professional development, and promoting research and evaluation initiatives. These findings contribute valuable insights into student experiences and preferences, informing the development of evidence-based instructional practices in higher education.

Content and Sentiment Analysis of Autobiographical Narratives of Experienced and Well-Evaluated Teachers in Spain

Analysing the content and feelings of teachers’ autobiographical narratives provides relevant information about teaching processes, challenges in professional development, performance, and identity. In this work, we analysed the narratives of five well-evaluated Spanish teachers with more than 10 years of experience. We used Iramuteq, RStudio, and TextRazor to describe the main themes, analyse the emotions, and check whether evidence-based teaching practices were mentioned. The results showed that emotional aspects were central, with positive feelings dominating. In the content analysis, themes such as mental health, inclusion, immigration, war, empathy, critical pedagogy, and autonomous and emancipatory education stand out. The analyses are relevant for teacher educators, policy makers, researchers, and teachers in training or in active service.

Enhancing appendiceal cancer care: Towards evidence-based practice and continuous education for healthcare providers.

e16377 Background: Appendiceal cancers (AC) are a set of rare and histologically diverse malignancies with distinct biological features and treatment implications. Despite surgical advances, there are gaps in the standardization of systemic therapies for AC. Hence, there is a pressing need to understand the current practice patterns amongst oncologists to facilitate unifying management strategies. Methods: A cross-sectional survey was distributed electronically among GI oncology specialists between April – October 2023 to map current practices in AC care. The survey contained 18 questions structured in three sections— participant demographics, treatment experiences, and management preferences for hypothetical cases. The analysis focused on response frequencies informing the need to develop targeted educational and research initiatives. Results: Most of the respondents (N = 104; response rate 22%), primarily from academic (86%) and urban settings (77%), manage up to 10 AC patients annually. Despite over five years of practice experience for 80% of respondents, high confidence in treating AC was modest (38%). The majority (83%) cited lack of guidelines and standardized treatments as a concern. The NCCN guidelines were commonly referred to, but only 13% were satisfied with AC education. For intermediate and high-grade AC, 63% and 53%, respectively, of respondents reported using perioperative chemotherapy with cytoreductive surgery and hyperthermic intraperitoneal chemotherapy. 40% opted for systemic therapy for low-grade neoplasms. 5FU/Capecitabine and oxaliplatin were the most common regimens of choice, whereas irinotecan, anti-VEGF, and anti-EGFR agents were used less frequently. Surveillance primarily involved serum CEA (91%) and CT scans (99%), with PET, MRI, and ctDNA used by 20-30% of the respondents. Free-text comments noted deficient evidence and educational needs to guide clinical practice. Conclusions: Our study is the first to describe physician attitudes and practice patterns in the management of AC. The survey highlights that even experienced providers feel underconfident when treating AC patients and supports the need for better evidence and data for systemic therapies. About 40% of the respondents noted offering chemotherapy to low grade neoplasms – a disease that is not thought to respond to systemic therapy, highlighting the need for education and clinical trials to guide evidence-based decision-making in this disease. In addition, multidisciplinary, multi-institutional efforts to unify treatment approaches and enhance patient outcomes are needed.

Contextual Influences on the Adoption of Evidence-Based Instructional Practices by Electrical and Computer Engineering Faculty

Contextual Influences on the Adoption of Evidence-Based Instructional Practices by Electrical and Computer Engineering Faculty