Clicker Questions Research Articles

Evaluation of the Activity Engagement Survey (AcES) for Use with Clicker Questions

Evaluation of the Activity Engagement Survey (AcES) for Use with Clicker Questions

How Does Utilizing Clicker Questions for Exam Preparation Affect Test-Taking Anxiety in Human Anatomy Students in a Flipped Classroom?

How Does Utilizing Clicker Questions for Exam Preparation Affect Test-Taking Anxiety in Human Anatomy Students in a Flipped Classroom?

An advanced course sequence in eukaryotic cell and molecular biology: A year-long course where active learning and peer-led groups resulted in higher learning gains and significant course passing scores.

We developed an advanced, year-long course sequence in eukaryotic cell and molecular biology in order to increase conceptual understanding. Three years of historical data from a one semester, traditional-lecture, senior cell and molecular biology course (n = 237) were compared with 3 years of data collected from the year-long course sequence (n = 176). There were significant content gains for the students who enrolled in the course sequence when pre- and post-assessments were compared (p < 0.0001). There was an association between earning a C or better in the course sequence and 70% or higher in the post-assessment instrument (p < 0.05). Final course grades for Bio 135A were calculated from three open ended exams and the percentage of correct answers on the clicker questions. For Bio135B, final grades were calculated from three open ended exams, clicker responses, a seven-page literature review on an environmental carcinogen and its effects on signal transduction pathways, and a formal presentation of one of the research articles they used in the literature review. The students who took the second semester of the course passed at higher rates than the students who enrolled in the traditional-lecture course (p < 0.05). Clicker answers to the research problem sets and the final course grades correlated significantly for both semesters of the course sequence (p < 0.01). We conclude that conceptually-connected learning gains can be obtained when the content is taught in a format that includes short lectures and group work to solve research questions.

Impact of Clicker and Confidence Questions on the Metacognition and Performance of Students of Different Achievement Groups in General Chemistry

Impact of Clicker and Confidence Questions on the Metacognition and Performance of Students of Different Achievement Groups in General Chemistry

Higher-Order Clicker Questions Engage Students and Prepare Them for Higher-Order Thinking Activities.

Previous research has shown that the use of clickers in the classroom enhances student engagement. However, few studies have investigated how the type of clicker question may influence learning outcomes. To explore this, we compared the effects of lower-order cognitive skill (LOCS) and higher-order cognitive skill (HOCS) clicker questions on later exam performance in a biology course. During class time, students were presented with clicker questions directly related to unit content. Half of the content units were taught with LOCS, the other half with HOCS. To ensure that type of content did not influence results, the cognitive level of the clicker questions was counterbalanced across two semesters. The exams included a mix of LOCS and HOCS for each content unit. We also investigated the possible moderating effects of student perceptions on the relationship between type of clicker question and exam performance using student surveys. We found that using HOCS clicker questions significantly affects student learning. Practice with HOCS clicker questions improved performance on LOCS exam questions but not on HOCS exam questions. Students ranked lecture with clickers as a preferred and most helpful teaching methodology. Overall, these results suggest that practice with HOCS questions is engaging and gives students practice recalling content to "solve" a problem, thereby encoding low-level information and preparing them for higher-order thinking activities.

Using Clickers to Address Common Errors and Misconceptions in Statistics

ABSTRACT Using clickers in the statistics classroom can help students identify and understand common errors and misconceptions through a combination of surprise and discussion. Students are presented with multiple-choice questions that they discuss with each other and then vote on; a class-wide discussion follows. Questions for which many students vote for the same wrong answer and questions that reveal a common misconception jolt students’ attention and lead to fruitful discussions. To identify the questions that most effectively target misconceptions, we recorded the percentage of the class voting on each of the possible responses on every clicker question used in 28 sections of introductory statistics courses taught by 3 instructors at 2 institutions. For each question, we identified the distractor that attracted the highest percent of votes on average. We present and discuss the six questions for which this average was at least 50%. We find that each of these question statements is fairly brief and tightly focused on a particular common error or misconception.

Revisiting Clickers: In-Class Questions Followed by At-Home Reflections Are Associated with Higher Student Performance on Related Exam Questions.

ABSTRACTClicker questions are a commonly used active learning technique that stimulates student interactions to help advance understanding of key concepts. Clicker questions are often administered with an initial vote, peer discussion, and a second vote, followed by broader classroom explanation. While clickers can promote learning, some studies have questioned whether students maintain this performance on later exams, highlighting the need to further understand how student answer patterns relate to their understanding of the material and to identify ways for clickers to benefit a broader range of students. Systematic requizzing of concepts during at-home assignments represents a promising mechanism to improve student learning. Thus, we paired clicker questions with at-home follow-up reflections to help students articulate and synthesize their understandings. This pairing of clickers with homework allowed us to decipher how student answer patterns related to their underlying conceptions and to determine if revisiting concepts provided additional benefits. We found that students answering both clicker votes correctly performed better on isomorphic exam questions and that students who corrected their answers after the first vote did not show better homework or exam performance than students who maintained an incorrect answer across both votes. Furthermore, completing the follow-up homework assignment modestly boosted exam question performance. Our data suggest that longer-term benefits of clickers and associated homework may stem from students having repeated opportunities to retrieve, refine, and reinforce emerging conceptions.

Blended, active, and persistent: An investigative study of blended learning affordances for active learning and student persistence in university-level introductory science courses

Higher education has seen the accelerated development of blended learning (BL), active learning (AL), and STEM education. This study explores a proposed framework showing that BL affordances enable or constrain AL and that the relationship between BL affordances and AL influences student persistence in introductory science courses and the sciences. A multiple-case study examined an introductory physics course and an introductory chemistry course. Interviewed were two student volunteers from high-, average-, and low-performing groups from each course. Course documentations underwent content analysis, and in-class and online observations were evaluated using the practical observation rubric to assess active learning (PORTAAL). The researcher developed a survey instrument, blended learning for active learning (BL4AL), capturing students’ perspectives concerning AL through traditional and nontraditional learning methods for their persistence in the sciences. Findings indicated students from all levels had varying views of BL affordances. However, in-class clicker questions and a third-party tutoring service were discovered to consistently enable AL. Students’ perceptions of BL for AL had a medium effect on whether they would continue in the sciences.

Interactive online lectures for asynchronous delivery

Physics teachers often use active learning techniques such as “clicker questions” in their lectures. We created a set of asynchronous online lectures that include clicker questions. Five instructors created and shared their Interactive Online Lectures for the first semester of an introductory calculus-based course. Each lecture consists of short video lecture segments interspersed with required multiple-choice clicker questions designed to help students understand the content. After submitting an answer, the student sees an explanation of why that answer is right or wrong. Instructors at five institutions used the lectures during the Fall Semester of 2020.

Challenges in addressing student difficulties with time-development of two-state quantum systems using a multiple-choice question sequence in virtual and in-person classes

Research-validated clicker questions as instructional tools for formative assessment are relatively easy to implement and can provide effective scaffolding when developed and implemented in a sequence. We present findings from the implementation of a research-validated clicker question sequence (CQS) on student understanding of the time-development of two-state quantum systems. This study was conducted in an advanced undergraduate quantum mechanics course for two consecutive years in virtual and in-person classes. The effectiveness of the CQS discussed here in both modes of instruction was determined by evaluating students’ performance after traditional lecture-based instruction and comparing it to their performance after engaging with the CQS.

Garden Variety Mutations: Using Primary Data to Understand the Central Dogma in Large-Lecture Introductory Biology

The ability to interpret and create an argument from data is a crucial skill for budding scientists, yet one that is seldom practiced in introductory courses. During this argumentation module, students in a large lecture class will work in groups to understand how a single mutation can lead to an obvious phenotypic change among tomatoes. Before the module begins, students are provided with background information on mutations and techniques to give them a starting point to explain what they will see in the data. In class, students will use data from the primary literature to understand the relationship between single amino acid mutations and phenotypic variation within the context of a &ldquo;big question&rdquo; about garden tomatoes that ripen without turning red. Over two days, small groups will negotiate data, create and evaluate hypotheses, and consolidate their understanding through clicker questions and writing tasks. Together, they will craft an argument for how mutations can lead to phenotypic changes, even if they do not lead to disease like in many common examples. Through this activity, the instructor and students work together to understand an engaging and relevant example of the central dogma. During our implementation of this activity, we observed high engagement with the in-class and out-of-class aspects of the argumentation activities to explain how a single mutation could result in a visible change to the flesh of a tomato. <em>Primary Image:</em>&nbsp;Garden Variety Mutations. Students work in small groups, interpreting data and evaluating hypotheses that explain how a single nucleotide change can alter tomato plant coloration.

An Open-Access Clicker Question Bank for Numerical Analysis

ABSTRACT We present a question bank consisting of over 250 multiple-choice and true–false questions covering a broad range of material typically taught in an introductory undergraduate course in numerical analysis or computational science. The questions are ideal for polling students during lectures by means of a student response system that uses clicker remotes or smartphones running a suitable app. We describe our experiences implementing these clicker questions in a recent class and provide evidence of their effectiveness in terms of testing students' prior knowledge, gauging understanding of new material, increasing participation, and especially improving student satisfaction. Our conclusions are supported by a mid-semester student survey as well as anecdotal observations. The question bank has been released as an open-access educational resource under a Creative Commons license (CC BY-NC-SA) for free use by the mathematics community.

Promoting economic literacy: Combining news articles and clicker questions in a large introductory microeconomics course

The author of this article presents a brief introduction to the use of current events news articles in an introductory microeconomics course for business students. Popular press articles are integrated with small-group peer instruction, and student understanding is assessed using student response system, or clicker, questions. Examples of lesson learning objectives are presented, along with a discussion of how news articles and clicker questions are combined to promote student interest and engagement. Sample clicker questions are also provided.

Predict-observe-explain activities preserve introductory geology students’ self-efficacy

To support student construction of knowledge during class meetings, there is a growing demand to incorporate active learning practices. However, ’active learning’ can range from occasionally voting on a multiple-choice question, to spending all of class time on worksheets. Consequently, the outcomes of active learning course reforms vary widely. Here we present an exploratory study comparing student outcomes from two introductory geology courses that both use active learning practices. In one course, students regularly respond to ‘Clicker’ questions with no peer interaction, using a personal response system. In the other course, students engage in Clicker questions as well as collaborative predict-observe-explain (POE) activities. Our results showed no statistically significant difference in content knowledge gains between these two courses POE activities. However, we find that students who experienced both Clickers and POE activities have enhanced self-efficacy and interest in the subject. As self-efficacy and science interest are integral for retention in STEM beyond first-year courses, we argue that some active learning strategies, such as POE, may be better suited to recruiting and retaining STEM majors. Thus we highlight the need for more studies that compare active learning strategies while monitoring student feelings and perceptions in addition to content knowledge.

Identifying Clicker Questions that Provoke Rich Discussions in Introductory Statistics

To identify clicker questions likely to provoke rich and engaging student discussions, we recorded the percentage of the class voting on each option on every clicker question used throughout each semester, encompassing nineteen sections of introductory statistics, taught by three instructors. Working from the hypothesis that seeing student votes broadly distributed across several different options is an indication of a good discussion question, we present the four questions with the most broadly distributed votes and discuss their use. Next, we present and consider the educational value of the questions with the lowest percentage of students voting correctly. We find that both broadly distributed votes and a low percentage of students voting correctly can be good indicators of effective discussion questions. Further, we find that questions devoid of numbers and based on general cases have fewer students voting correctly and have a significantly broader distribution of votes, thus indicating that this characteristic may be an important indicator of good discussion questions.

Assessing Water Literacy: Undergraduate Student Conceptions of Groundwater and Surface Water Flow

Given the importance of fresh water, we investigated undergraduate students’ understanding of water flow and its consequences. We probed introductory geology students’ pre-instruction knowledge using a classroom management system at two large research-intensive universities. Open-ended clicker questions, where students click directly on diagrams using their smart device (e.g., cell phone, tablet) to respond, probed students’ predictions about: (1) groundwater movement and (2) velocity and erosion in a river channel. Approximately one-third of students correctly identified groundwater flow as having lateral and vertical components; however, the same number of students identified only vertical components to flow despite the diagram depicting enough topographic gradient for lateral flow. For rivers depicted as having a straight channel, students correctly identified zones of high velocity. However, for curved river channels, students incorrectly identified the inside of the bend as the location of greatest erosion and highest velocity. Systematic errors suggest that students have mental models of water flow that are not consistent with fluid dynamics. The use of students’ open-ended clicks to reveal common errors provided an efficient tool to identify conceptual challenges associated with the complex spatial and temporal processes that govern water movement in the Earth system.

How a Classroom Failure Improved My Teaching

How a Classroom Failure Improved My Teaching

Multicourse Comparative Study of the Core Aspects for Flipped Learning: Investigating In-Class Structure and Student Use of Video Resources

Since 2013, the number of publications on flipped learning within chemistry have steadily increased. However, most of these studies focus on flipped course reforms within individual institutions, while the outcomes of any learning environment are dependent on how the environment is structured and the degree to which students interact with its elements. In this study, we apply a coordinated set of assessment practices to investigate similarities among flipped chemistry courses at five institutions in the United States. All courses in the study followed the two basic tenets of flipped learning: (1) foundational information was delivered through preclass materials (PCMs), and (2) the face-to-face (F2F) environment applied or extended the content through active learning. Each F2F environment was characterized using video recordings analyzed with the Classroom Observation Protocol in Undergraduate STEM (COPUS) tool. Each individual course showed consistent use of F2F time across each session recording; however, there were significant differences in the predominant student behaviors between courses. Student behavior in two of the courses (Courses Four and Five) was dominated by work in small-groups on problem-solving worksheets, in contrast to another course (Course One) where responding to whole-class questioning posed by the instructor dominated students’ behaviors. While behaviors in the two remaining courses (Courses Two and Three) included a mix of responding to clicker and whole-class questions, one of them (Course Three) also included large episodes of students simply listening during instructor presentation of material. A midsemester survey was administered in each course to characterize students’ interactions with, and perceptions of, the PCMs. Of particular note, student self-reports of the number of videos viewed and the timing of viewing trended with the amount of peer-to-peer interaction during F2F sessions. That is, students in courses with more consistent groupwork reported watching more of the video content and doing so before the F2F session. These results demonstrate that flipped classrooms can take many forms and suggest that F2F structure may create non-grade-based incentives for PCM utilization.

Clickers in Class: Fostering Higher Cognitive Thinking Using ConcepTests in a Large Undergraduate Class

Unlike design studio, preparatory modules in the undergraduate Architecture course typically have a high student–teacher ratio and are conducted in a traditional lecture setting. By nature, lecture setting hinders engagement and reduces motivation, eventually lowering student learning outcomes. This study aimed to increase engagement with the content, lecturer, and among peers in a traditional lecture and consequently improve higher cognitive learning outcomes. Wi-Fi-enabled devices as clickers were used in all lectures to implement “pause and recall” with ConcepTests to increase participation and interaction. Lectures were paused every 15–20 min, and students were asked questions of higher cognitive order that required them to apply the concepts covered in an online platform that acted as clickers. For this quasi-non-experimental mixed-method study, 79 students’ approach to learning before and after the intervention, perception of using clickers, and learning outcomes were measured for a preparatory module, Environmental Systems in the undergraduate Architecture program. Learning outcomes were measured at various cognitive levels based on Bloom’s taxonomy. Students’ deep approach to learning increased at the end of the semester (Cohan’s d = 0.277 and 0.216 for deep motive and strategy, respectively). Students generally have a positive perception and those who showed a positive attitude towards using clickers achieved better scores at higher cognitive questions in the final test (rs = 0.359, p = 0.001). Students with a deep strategy approach to learning reflected increased self-evaluation (rs = 0.275, p = 0.022) and study behavior (rs = 0.263, p = 0.029) to use clickers. Clickers used to pose ‘ConcepTest’ questions to execute “pause and recall” in a large lecture class had a positive impact on student performance. Semi-structural interviews were performed to further explain the findings. Results were consistent with the generative theory of learning. The timing and design of clicker questions followed by a discussion were particularly beneficial in improving critical thinking among students.

Checkpoint Clicker Questions for Introductory Statistics

ABSTRACT We recorded the percentage of students voting on each option on every clicker question used in 19 introductory statistics classes. To identify the questions that provide the most useful feedback, we looked for those for which the percentage of students voting correctly varied the most from class to class, producing the largest standard deviations. We present the nine questions with the highest standard deviations, discuss how students voted on them, and explain how we used them. We find these questions to be very diverse, but possessing especially well-designed distractors.