STEM Courses Research Articles

Using Continuous Online Assessment of Learning Outcomes for Grading: A Case Study

In recent years, the problem of the number of students enrolled in STEM courses falling below the minimum required to carry out the courses has worsened. This situation, which used to occur primarily in degree programs at the end of their life cycle, is increasingly happening in active STEM degree programs as well. The declining attractiveness of traditional STEM degree programs and negative demographic trends are seen as the main causes of this problem. To assist students and their teachers in this situation, a novel approach to grading student work based on the level at which students achieve learning outcomes in an online system was explored. Since the focus was on STEM students, math-based tasks were used to assess student knowledge within the online system. In addition to the accuracy of the final results of the tasks, the accuracy of the intermediate results was also monitored. Each result was linked to the corresponding concepts, which in turn were linked to the corresponding learning outcomes. By entering correct intermediate and final results, the online system was able to monitor student success in mastering concepts and learning outcomes. The implemented online system utilizes fuzzy inference to calculate the levels at which students have achieved the learning outcomes. These levels are continuously recalculated during the semester and presented to the students through generated recommendations after each solved task. The proposed approach has positively impacted students’ motivation to learn during the semester, as confirmed by an anonymous questionnaire. Additionally, the results have shown that the final level at which students have achieved the learning outcomes within the online system, calculated at the end of the semester, can be used for grading and is comparable to the grades students would achieve in traditional midterm and final exams, thus helping teachers with their workload.

Two Belonging-Based Interventions and Faculty-Staff Collaborations Support Student Outcomes and Sense of Belonging in First-Year STEM Course

Two Belonging-Based Interventions and Faculty-Staff Collaborations Support Student Outcomes and Sense of Belonging in First-Year STEM Course

Unskilled and unaware? Differences in metacognitive awareness between high and low-ability students in STEM

IntroductionMetacognition, or the ability to monitor and control one's cognitive processes, is critical for learning in self-regulated contexts, particularly in introductory STEM courses. The ability to accurately make predictions about one's ability and performance can determine the effectiveness in which students effectively prepare for exams and employ good study strategies. The Dunning-Kruger pattern, where low-performing individuals are more overconfident and less accurate at the ability to predict their performance than high-performing individuals, is robustly found in studies examining metacognitive monitoring. The extent to which the Dunning-Kruger pattern can be explained by the lack of metacognitive awareness is not yet established in the literature. In other words, it is unclear from prior work whether low-performing students are “unskilled and unaware” or simply “unskilled but subjectively aware.” In addition, arguments about whether this pattern is a psychological phenomenon or a statistical artifact of the measurement of metacognition can be found in the literature.MethodsStudents enrolled in three different physics courses made predictions about their exam scores immediately before and after taking each of the three exams in the course. Student predictions were compared to their exam scores to exam metacognitive accuracy. A new method for examining the cause of the Dunning-Kruger effect was tested by examining how students adjust their metacognitive predictions after taking exams.ResultsIn all contexts low-performing students were more overconfident and less accurate at making metacognitive predictions than high-performing students. In addition, these students were less able to efficiently adjust their metacognitive predictions after taking an exam.DiscussionThe results of the study provide evidence for the Dunning-Kruger effect being a psychological phenomenon. In addition, findings from this study align with the position that the skills needed to accurately monitor one's performance are the same as those needed for accurate performance in the first place, thus providing support for the “unskilled and unaware” hypothesis.

Paradoxical perceptions: minoritized high school students’ stereotypical and expansive views of science and scientists at an urban, inclusive STEM-focused high school (ISHS)

Existing research on inclusive STEM-focused high schools (ISHSs) has focused on the design and implementation of ISHSs at the school-level, along with the positive effects of ISHSs on STEM course taking, college majoring, and STEM career orientations. Missing from the literature are studies that foreground the perspectives and voices of students of color and their perceptions of science and scientists from asset-based, critical perspectives. Thus, the purpose of this qualitative case study is to document the perceptions of science and scientists among racially, ethnically, and linguistically minoritized ninth graders at an urban, inclusive STEM-focused high school in a mid-sized, northeastern city in the United States, along with the contexts, sources, and associated experiences informing these perceptions. Iterative cycles of inductive and deductive coding and domain analysis, informed by theoretical perspectives on ecological systems and Discourses, revealed paradoxical perceptions. Students viewed science as a body of knowledge, testing and experimenting, a life-enhancing discovery, building on background information, and connected with other disciplines and everywhere. Students’ perceptions of scientists were both stereotypical and expansive, including that scientists are smart and serious; use science equipment and gear in traditional lab contexts; and are creative, curious, and open-minded. While students primarily identified deceased White males as scientists, three girls of color mentioned counter-stereotypical women and people of color when they thought of science. Students noted that science field trips and after school programs, as well as science in the media and school, informed their perceptions. These findings suggest that despite reform efforts such as Science for All, very little has changed regarding conceptions of science and scientists. What is more, these findings are troubling when minoritized students at an ISHS continue to replicate status quo perceptions of science and scientists. This study has implications for practice, research, and policy related to building on and extending these views in more critically conscious and equity-oriented ways.

The Influence of the Sherman STEM Teacher Scholars Program on Persistence in Science, Technology, Engineering, and Mathematics: A Mixed-Methods Study

This sequential explanatory mixed-methods study investigated the differences in persistence between students from the Sherman STEM Teacher Scholars Program (STEP), a STEM teacher scholarship and career preparation program, and STEM majors not in the program. Quantitative results indicated that STEP participants had higher levels of academic integration, women scored higher on persistence factors than men, and White students had a higher degree commitment than students of color. Qualitative findings indicated that STEP provided a family atmosphere and connected their coursework to their career aspirations. Women of color felt stereotyped by White classmates in STEM courses, which impacted their degree of commitment, and students of color in STEP relied on the program as a counterspace to racially insensitive STEM classrooms.

Classroom Interactions Facilitate a Sense of Belonging in Remote STEM Classes: Lessons from a Large-Scale Quantitative Study

AbstractDuring the global COVID-19 pandemic, instructors strove to facilitate student learning, engagement, and community in an unfamiliar environment, while students adapted to a college experience that differed from their expectations. This context provided the opportunity to identify factors that increased undergraduates’ sense of belonging in remote STEM classrooms. We analyzed responses from 1589 students in 26 undergraduate STEM courses at a large R1 research university in Likert-style surveys to assess how the remote modality affected their sense of belonging in their STEM course. Likewise, we analyzed data from 22 instructors about their pedagogical mindset and implementation of classroom activities. K-means clustering of student survey responses sorted classes into four significantly distinct clusters. Student responses in cluster 1 revealed an increased sense of belonging in the post-survey, whereas students in cluster 4 reported a decreased sense of belonging. Further, we observed that a higher frequency of active learning activities (student–student and student-instructor interactions) and instructor type (teaching faculty) correlated with an increased sense of belonging. Many studies have investigated alterations in students’ sense of belonging; our study contributes by identifying activities that enhance a sense of belonging in remote STEM classrooms. Moreover, our findings from a quantitative study allow us to propose ways instructors can modify their courses to increase student sense of belonging and insulate students from the isolation of remote classrooms.

Changes in Intrinsic Motivation and Self-Efficacy

Grades in introductory STEM courses can impact intrinsic motivation (IM) and self-efficacy (SE). We used an exploratory approach to examine trends in grades and how IM and SE impact students’ grades. It is known that most first-generation (FG) college students are from underrepresented backgrounds (URM), and that these students are least likely to persist in STEM fields. Therefore, gaining a better understanding of motivation in our most underserved students could be critical to improving their success in introductory biology courses and ultimately future persistence in STEM. We found that, on average, URM FG students received the lowest final grades and experienced the greatest declines in IM and SE. This research informs the way we may think about changes in motivation and self-efficacy in our introductory biology courses as these lay the foundation for future learning and success.

Learning from watching dialog and monolog videos in online STEM courses

BackgroundInstructional videos have been increasingly critical to afford effective learning experiences in online courses, but most videos follow a lecturing monolog delivery format. This format tends to lead students to observe the videos passively. Previous laboratory studies have indicated that observing dialog videos of an instructor tutoring a tutee enhances student learning more than watching monolog videos of the same instructor lecturing. This paper describes two empirical studies that replicated the laboratory findings in large-scale college-level online STEM courses.ResultsThe results show that observing dialog videos of tutoring led to superior learning outcomes compared to monolog videos of lecturing, regardless of whether students observe the videos individually or collaboratively, as long as they engaged generatively with the materials. This finding was confirmed across two tested STEM domains.ConclusionsThe findings of these classroom studies suggest that observing dialog tutoring videos is a novel and robust online instructional format that can be generalized across STEM domains. The benefit of overhearing tutorial dialogs requires students to engage in Constructive and Interactive behaviors, as defined by the ICAP framework, rather than exposing students to long didactic lectures.

“Not a cookie cutter situation”: how neurodivergent students experience group work in their STEM courses

BackgroundAlthough group work is increasingly used in STEM courses and may lead to improved academic outcomes, there is evidence that some implementations of group work may lead to unintended barriers for certain students’ learning. Despite the growing number of neurodivergent undergraduate students, there is limited research on neurodivergent students’ experiences with group work in STEM courses. To address this knowledge gap, the current research investigated the experiences of 22 neurodivergent undergraduate students with group work in STEM courses at a range of institution types and in a variety of STEM disciplines. Participants shared experiences with in-class and out-of-class group work assignments for lecture and laboratory courses.ResultsThrough inductive thematic coding of semi-structured interview transcripts, we identified seven themes impacting participants’ experiences. Three themes were individual level: personal characteristics that participants associated with their neurodivergence; strategies for academic success (with subthemes of organization/time management, adaptive communication, and self-advocacy); and beliefs on group work’s value. Four themes were group level/classroom level: group dynamics; role in group (including leadership roles); the competitive culture within STEM; and recommendations for instructors. Through a social-relational perspective on disability, we proposed a model showcasing how group and classroom factors serve as supports or barriers to neurodivergent students’ full participation in group work, as well as to their sense of belonging. Using the seven themes we articulated, we outlined a set of practices for designing group work assignments. In addition, we propose how pairing inclusive assignment design with instructor reflection and articulating anti-ableist values can support neurodivergent student belonging by disrupting discourses of normalcy in STEM.ConclusionsAs one of the first studies exploring the impact that group work in STEM courses has on neurodivergent undergraduates, this work may inform reimaginations of group work practices to better address the needs of neurodivergent STEM students and support a more inclusive culture in STEM classrooms. In addition, our conceptual model may serve as the basis for future research regarding interactions between individual-level and group-level factors associated with neurodivergent students’ learning through group work and other active learning practices.

“You Didn’t Go by Choice!”: Exposing Institutional Barriers Leading to Latinx STEM Pushout at a Hispanic-Serving Research Institution

As the Latinx student population grows in the United States, more public research-intensive institutions are becoming Hispanic-Serving Research Institutions (HSRIs). This exploratory qualitative study examines the experiences of Latinx students at an HSRI, particularly in STEM fields where they face underrepresentation and are pushed out. The objectives for this study were two-fold: (1) investigate the institutional factors contributing to Latinx student pushout in STEM at an HSRI and (2) develop recommendations for enhancing Latinx student retention in STEM at HSRIs. Through an investigation at a public four-year HSRI in California, three key themes emerged regarding institutional factors contributing to STEM pushout: (1) a disconnect in theory-based STEM courses, (2) unsupportive and busy research-focused environments, and (3) the psychological toll of a stripped STEM identity. The authors offer recommendations for targeted interventions to genuinely “serve” Latinx students in STEM fields at HSRIs.

An Exploratory Mixed-Methods Analysis of Factors Contributing to Students' Perceptions of Inclusion in Introductory STEM Courses.

In this exploratory mixed-methods analysis of students' perceptions of inclusion in introductory STEM courses for STEM majors, we asked students to rate inclusion in their class and to provide an open-text explanation of their rating. Analyzing 1930 qualitative responses resulted in a codebook containing academic, identity, and nonspecific categories. The majority of responses (>80%) cited academic factors such as interactions between students and instructors or course elements and policies. Most academic responses aligned with evidence-based teaching practices fostering inclusion, describing a range of strategies and policies instructors can implement to increase students' perceptions of inclusion. A small number of student responses indicated that their perception of the required knowledge background for the course impacted course inclusivity. Few differences in frequency distributions were found between subgroups examined (gender, race and ethnicity, self-reported inclusion score, and discipline). Additionally, tracking a subset of students (135) across three courses revealed that most (80%) cited different factors influencing their perception of inclusion in each course. This suggests students' perceptions of inclusive practices are complex, and most students recognize multiple factors that influence their inclusion. Overall, our findings suggest instructors can significantly influence students' perceptions of inclusion by using multiple inclusive teaching strategies and course policies.

Using BioRender for Active Learning: Exploring Learning-Style Preference and Visual-Spatial Ability in Undergraduate Students.

Visual-spatial reasoning has been considered a predictor of performance success in STEM courses, including engineering, chemistry, biology, and mathematics. Little is known, however, about whether visual-spatial ability predicts success for non-STEM students in general education neuroscience courses. In the following study, we investigate how scores on tests of visual-spatial object rotation relate to student performance on illustrative and content exams in a large non-major undergraduate neuropharmacology course. To help students understand content visually, the course provided students with homework assignments that allowed them to create illustrations of lecture content using the online scientific illustration software, BioRender. Findings suggest that percent completion of BioRender assignments was a greater predictor of student performance than tests of innate visual-spatial ability. In addition, we show that visual learning style preference was not correlated with visual-spatial ability, as measured by the Purdue Spatial Visualization Test-Visualization of Rotations. Neither did learning style preference predict student success. The following paper suggests practice illustrating neuroscience concepts, or perhaps content practice in general, had a greater impact on student learning independent of learning style preference or innate visual-spatial ability.

Embodied curriculum mapping as a foundation for critical self-reflection and culture change

This article describes a first-person qualitative research study to understand how common pedagogical approaches and cultural learning environments in STEM impact individuals. Prior to the study, the author observed that many students who were successful in advanced undergraduate neuroscience courses reported having struggled academically, socially, or emotionally in introductory STEM courses. The objective was to generate new ideas for approaches to address high rates of student attrition from introductory STEM courses related to this full range of issues through curriculum development. The author, a neurobiologist and tenured faculty member at the institution, audited four introductory STEM courses: Introduction to Cellular and Molecular Biology, Atoms & Molecules, Calculus 1, and Introductory Physics 2: Electromagnetism, Optics, and Modern Physics, offered by tenured colleagues in four different departments. A total of approximately 600 hours was spent by the author attending lectures, participating in classroom activities, completing homework, and studying for assessments. Homework, quizzes, and exams were marked by the course faculty using the same criteria as were applied for student work. In addition to measures of academic performance collected through the normal assessments, the author made note of her own emotional responses throughout the course of the study, which is why the process was dubbed ‘embodied’ curriculum mapping. The emotional responses revealed high levels of emotional stress associated with assessment, sensitivity to disciplinary boundary reinforcement, and a complex role of social and academic identity in all aspects of the experience. Given the first-person nature of the study, the potential future generalizability of the findings must be considered in light of the various revealed aspects of identity and experience of the author and subjected to further study using a broader range of empirical methodologies. The focus of this article’s conclusions and recommendations is therefore the impact of the process on the author and the potential for a similar process to serve as a foundation for critical self-reflection and learning for other STEM educators. The author recommends the process as a generative tool for pedagogical innovation and building faculty capacity for culture change in STEM.

Differences in Perception of Peer Interactions in Student-Centered STEM Courses

Differences in Perception of Peer Interactions in Student-Centered STEM Courses

Teaching the Nature of Science Improves Scientific Literacy Among Students Not Majoring in STEM.

Traditionally, science courses focus on knowledge and practices within specific disciplines. There has long been a call, however, to increase the focus on the nature and process of science as a way to improve scientific literacy and increase the transfer of knowledge. Despite this, there are few systematic studies that seek to understand the impact of this approach. Revising a STEM course in a liberal arts curriculum to primarily focus on the nature and process of science rather than on the content of a specific discipline increased student scores on the Test of Scientific Literacy Skills and improved perceptions of STEM. In the revised course, students self-reported higher levels of confidence in their ability to learn scientific information and their ability to contribute to scientific progress compared to traditional methods. These data and other literature suggest that the traditional knowledge-focused approach to science education is insufficient to facilitate scientific literacy and address equity gaps in STEM. Proposed is a model where scientific literacy and feelings of inclusion in STEM are the product of direct engagement in the process of science and careful evaluation of the nature of science. Long-term, a holistic approach that includes an authentic discussion of the enterprise of sciences is needed to prepare students to engage in future problems that are best solved by cross-disciplinary collaboration.

Positive Feedback as a Lever to Boost Students' STEM Outcomes.

Although many college students intend to major in Science, Technology, Engineering, and Mathematics (STEM), dropout from these fields is high, especially among members of historically underrepresented groups, such as women and racial-ethnic minorities. We propose a minimal, yet potentially powerful intervention to broaden participation in STEM: giving positive feedback to students in STEM. Studies 1 and 2 found that giving positive feedback is less normative in math (vs. English) courses, and instructors' feedback-giving practices and students' experiences mirror these norms. However, students who received positive (vs. only objective) feedback on introductory-level college calculus exams showed greater belonging and self-efficacy in math, which predicted better STEM outcomes (i.e., increased interest in STEM and higher final math course grades, respectively, Study 3). These findings were especially strong for racial-ethnic minority students. Giving positive (vs. only objective) feedback is thus a potentially transformative tool that boosts student outcomes, especially for underrepresented groups.

Professional development sessions increased teacher knowledge and confidence to include agriculture in core curricular courses

AbstractAgricultural systems are complex and can be used as examples to teach science, technology, engineering, and math (STEM) concepts. However, inclusion of agriculture in core STEM courses is often limited. Three professional development sessions for K‐12 teachers were offered in 2021–2022 (hybrid or remote sessions) and repeated in 2022–2023 (in‐person sessions) to highlight ways that agricultural plant production systems could be incorporated into core courses like biology, environmental science, chemistry, and math. Teacher participants asked how knowledge level and confidence were influencing their inclusion of agriculture into STEM courses before and after the sessions, and gains in knowledge on content‐based questions were also evaluated. Response rates in Year 1 ranged from 8.0% to 38.5%, and usable response rates in Year 2 ranged from 47% to 68%. The availability of lessons or activities and teacher content knowledge both increased teacher likelihood to incorporate in three sessions. However, the additional time needed to incorporate new lessons was identified as affecting the likelihood to incorporate materials after the Year 1 ecology session. Teacher confidence to incorporate agricultural lessons or activities into their courses increased in four of the sessions, though teachers became more aware that limited resources are available to help increase adoption. Awareness of how agriculture can be used to meet learning standards also improved teacher confidence in four sessions. Average score on knowledge‐based questions increased in all six sessions, but was only significant for two sessions. These sessions were successful at increasing teacher knowledge and confidence to incorporate agriculture into STEM courses.

Integration of Sustainable Development Goals in university STEM courses

The objectives of this study are: (1) to provide an overview of the validity of learning tools for STEM Method courses based on the Sustainable Development Goals Curriculum, (2) to assess the practicality of these learning tools, and (3) to evaluate their effectiveness in enhancing students' problem-solving abilities. This research employs the Research and Development (R&D) methodology. Data collection methods include interviews, product validation, questionnaires, and tests. Data analysis techniques encompass qualitative analysis, product validity testing, practicality testing, and effectiveness testing. The findings indicate that: (1) learning tools for STEM Method courses based on the Sustainable Development Goals curriculum comprise a Learning Plan and teaching materials, both of which are highly valid (scores of 3.4 and 3.5 respectively), (2) the practicality test of the teaching materials scored 3.73, indicating high practicality, and (3) these tools effectively improve students' problem-solving abilities, as evidenced by the experimental class outperforming the control class. In conclusion, the study demonstrates that the designed learning tools aligned with the Sustainable Development Goals Curriculum not only show strong validity and practicality but also significantly enhance students' problem-solving skills in STEM education contexts.

Making the (Letter) Grade: The Incentive Effects of Mandatory Pass/Fail Courses

Abstract In fall 2014, Wellesley College began mandating pass/fail grading for courses taken by first-year, first-semester students, although instructors continued to record letter grades. We identify the causal effect of the policy on course choice and performance, using a regression-discontinuity-in-time design. Students shifted to lower-grading science, technology, engineering, and mathematics (STEM) courses in the first semester, but did not increase their engagement with STEM in later semesters. Letter grades of first-semester students declined by 0.13 grade points, or 23 percent of a standard deviation. We evaluate causal channels of the grade effect—including sorting into lower-grading STEM courses and declining instructional quality—and conclude that the effect is consistent with declining student effort.

Alternative Pedagogies to Advance Equity in Undergraduate STEM Courses: A Systematic Review of Research

Alternative Pedagogies to Advance Equity in Undergraduate STEM Courses: A Systematic Review of Research