Force Concept Inventory Research Articles

How persistent are the misconceptions about force and motion held by college students?

The purpose of this work is to study the effectiveness of our introductory mechanics instructions in changing students’ misconceptions about Newtonian concepts. We gave the force concept inventory (FCI) test to 341 of our students twice, before and after instructions. The data were analyzed using a method first reported by Martín-Blas et al (2010 Eur. J. Eng. Educ. 35 597–606). We examined all of the known misconceptions found in the original paper by Hestenes et al (1992 Phys. Teach. 30 141–51) and determined the dominant ones from students’ incorrect answers for each of the 30 questions in the inventory. By comparing the dominant misconceptions held by our students in the pre- and post-tests, we were able to determine which ones were unchangeable by instructions and students couldn’t overcome. Results indicate some overall improvement in students’ performance but also the existence of very resistive to change misconceptions that were not affected by instructions.

Development and Validation of the Conceptual Assessment of Natural Selection (CANS).

We developed and validated the Conceptual Assessment of Natural Selection (CANS), a multiple-choice test designed to assess how well college students understand the central principles of natural selection. The expert panel that reviewed the CANS concluded its questions were relevant to natural selection and generally did a good job sampling the specific concepts they were intended to assess. Student interviews confirmed questions on the CANS provided accurate reflections of how students think about natural selection. And, finally, statistical analysis of student responses using item response theory showed that the CANS did a very good job of estimating how well students understood natural selection. The empirical reliability of the CANS was substantially higher than the Force Concept Inventory, a highly regarded test in physics that has a similar purpose.

Secondary analysis of teaching methods in introductory physics: A 50 k-student study

Physics education researchers have developed many evidence-based instructional strategies to enhance conceptual learning of students in introductory physics courses. These strategies have historically been tested using assessments such as the Force Concept Inventory (FCI) and the Force and Motion Conceptual Evaluation (FMCE). We have performed a review and analysis of FCI and FMCE data published between 1995 and 2014. We confirm previous findings that interactive engagement teaching techniques are significantly more likely to produce high student learning gains than traditional lecture-based instruction. We also establish that interactive engagement instruction works in many settings, including those with students having a high and low level of prior knowledge, at liberal arts and research universities, and enrolled in both small and large classes.

Using the method of dominant incorrect answers with the FCI test to diagnose misconceptions held by first year college students

We started this work with the goal of detecting misconceptions held by our students about force and motion. A total of 341 students participated in this study by taking the force concept inventory (FCI) test both before and after receiving instructions about force or motion. The data from this study were analysed using different statistical techniques with results from frequencies and the dominant incorrect answer reported in this paper. All misconceptions reported in the original paper of the designers of the FCI test (Hestenes et al 1992 Phys. Teach. 30 141–58) were examined and the results are reported. Only pre test results are reported in this paper leaving post data for future work. We used the modified version of the FCI containing 30 questions and therefore used the revised list of misconceptions. Problems with impetus and active force are among the most dominant ones found with the full list reported in this paper.

Using module analysis for multiple choice responses: A new method applied to Force Concept Inventory data

We describe Module Analysis for Multiple Choice Responses (MAMCR), a new methodology for carrying out network analysis on responses to multiple choice assessments. This method is used to identify modules of non-normative responses which can then be interpreted as an alternative to factor analysis. MAMCR allows us to identify conceptual modules that are present in student responses that are more specific than the broad categorization of questions that is possible with factor analysis and to incorporate non-normative responses. Thus, this method may prove to have greater utility in helping to modify instruction. In MAMCR the responses to a multiple choice assessment are first treated as a bipartite, student X response, network which is then projected into a response X response network. We then use data reduction and community detection techniques to identify modules of non-normative responses. To illustrate the utility of the method we have analyzed one cohort of postinstruction Force Concept Inventory (FCI) responses. From this analysis, we find nine modules which we then interpret. The first three modules include the following: Impetus Force, More Force Yields More Results, and Force as Competition or Undistinguished Velocity and Acceleration. This method has a variety of potential uses particularly to help classroom instructors in using multiple choice assessments as diagnostic instruments beyond the Force Concept Inventory.10 MoreReceived 13 January 2016DOI:https://doi.org/10.1103/PhysRevPhysEducRes.12.020131This article is available under the terms of the Creative Commons Attribution 3.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasAssessmentCollective behavior in networksCommunity structureInstructional materials developmentPhysics Education ResearchNetworks

Experimental validation of the half-length Force Concept Inventory

Experimental validation of the half-length Force Concept Inventory

Can dual processing theory explain physics students’ performance on the Force Concept Inventory?

Demonstration of the dual processing theory as a way to understand learning and assessment in introductory physics.

Teaching assistants’ performance at identifying common introductory student difficulties in mechanics revealed by the Force Concept Inventory

The Force Concept Inventory (FCI) has been widely used to assess student understanding of introductory mechanics concepts by a variety of educators and physics education researchers. One reason for this extensive use is that many of the items on the FCI have strong distractor choices that correspond to students' alternate conceptions in mechanics. Instruction is unlikely to be effective if instructors do not know the common alternate conceptions of introductory physics students and explicitly take into account students' initial knowledge state in their instructional design. Here, we discuss research involving the FCI to evaluate the pedagogical content knowledge of both instructors and teaching assistants (TAs) of varying teaching experience. For each item on the FCI, the instructors and TAs were asked to identify the most common incorrect answer choice of introductory physics students. We also discussed the responses individually with a few instructors. Then, we used the FCI pre-test and post-test data from a large population (~900) of introductory physics students to assess the pedagogical content knowledge of physics instructors and TAs. We find that while both physics instructors and TAs, on average, performed better than random guessing at identifying introductory students' difficulties with FCI content, they did not identify many common difficulties that introductory physics students have, even after traditional instruction. Moreover, the ability to correctly identify students' difficulties was not correlated with the teaching experience of the physics instructors.

Asking the right questions: Developing diagnostic tests in undergraduate physics

Being able to discover students‟ conceptions and more importantly alternate- and misconceptions about a topic is vital in order to be able to assess and thus be able to improve student learning. It is well known that this can be achieved via the use of well-designed diagnostic tests, a widely used example of which is the Force Concept Inventory. Creating the right questions in order to form a reliable diagnostic test can be a lengthy and complicated process. This article reports work on a Development Project funded in 2008 to develop such a test for introductory Quantum Mechanics courses in both physics and chemistry. We present details of our methodology, which involves augmenting a „standard‟ multiple-choice question set with free-response boxes to determine the reasons for a student choosing a particular answer, and a self-assessment of their level of confidence in their choice. The responses from piloting this initial test in different institutions are used to inform the subsequent refinement of the test, as well as assessing the reliability and validity of the questions. We highlight examples of misconceptions that have been found during the development of the diagnostic tests.

Diagnostic tests for the physical sciences: A brief review

We present a review of diagnostic testing in the physical sciences. We cover the motivation for using such instruments and their historical development via a case study of probably the most cited and influential test instrument and application: the Force Concept Inventory, developed in the early 1990s by Hestenes and co-workers, and its use to quantify learning gains from different instructional methodologies by Richard Hake. We then present an overview of the process of creation and validation of such instruments, and highlight the results from studies that have made use of some of the many instruments available in the literature. We conclude with a short summary of our own recent work to develop a diagnostic test of data handling skills of physical science undergraduates.

Enhanced conceptual understanding in first year mechanics through modelling

As part of the National HE STEM programme, we have developed and implemented a modelling curriculum in first year mechanics to overcome well known conceptual difficulties. By modelling, we mean more than just the development of mathematical equations to describe the evolution of a physical system; we also mean the use of multiple representations both to understand the problem at hand as well as to develop a solution. We have developed a structured approach to both teaching and assessing the use of such representations through the ACME protocol: Assess the problem, Conceptualise the Model, and Evaluate the solution. This paper describes the implementation of this protocol within a conventional lecture setting during a single semester of the 2011-12 academic session and demonstrates the impact on conceptual understanding of 42 students though pre-course and post-course testing using the Force Concept Inventory (FCI). Detailed analysis shows that on virtually every question in the FCI student performance improved, with questions 4 and 15, relating to Newton’s third law, showing especially large gains. The average FCI score rose from 17.7 (out of 30) to 22.5, with the distribution of post-instruction scores being statistically significantly different (p=0.0001) from the distribution of pre-instruction scores.

Whiteboarding: A Tool for Moving Classroom Discourse from Answer-Making to Sense-Making

In 1998 I had been teaching science for 13 years. I was a good teacher: I had the plaques and certificates to prove it. But often I felt like an impostor (which I have since learned is not unusual—70% of all people feel like a fake at one time or another). While my students could solve problems and ace tests, every June when I sat down to look at their Force Concept Inventory (FCI) results, I was confronted by how little they had actually learned in my physics classes. It was this annual reality check that drove me to pursue my first Modeling Workshop in summer of 1998. For four weeks I was a physics student again—every day, for six to eight hours a day. I (re)learned to think aloud, to “speak physics” and to listen to how I and others (students) spoke physics. That summer changed everything. When I returned to my high school physics classroom equipped with a new way of teaching in September of 1998, I was excited. I felt like I had the key to the perfect year—I wouldn't be an impostor anymore.

Evaluating the Cognitive Consequences of Playing Portal for a Short Duration

Learning physics often requires overcoming common misconceptions based on naïve interpretations of observations in the everyday world. One proposed way to help learners build appropriate physics intuitions is to expose them to computer simulations in which motion is based on Newtonian principles. In addition, playing video games that require spatial processing may also facilitate the development of spatial skills that have been associated with learning in science, technology, engineering, and mathematics areas. Two studies were conducted to examine whether playing the first-person perspective puzzle game Portal causes improvements in physics intuitions and spatial cognition skills. In Experiment 1, college students played Portal, the two-dimensional puzzle game Tetris, or the anagram game TextTwist for 75 minutes. There were no significant differences on measures of naïve physics reasoning (selected from the Force Concept Inventory) or measures of spatial cognition (mental rotation and perspective taking). To determine whether Portal could influence formal physics learning, in Experiment 2 participants viewed a brief lesson on Newton’s laws of motion after playing one of the three games for 1 hour. The groups did not differ on subsequent tests of physics learning. This study shows that Portal was not successful in priming intuitions about motion or spatial abilities related to physics learning.

Using a Force Concept Inventory Test with Visually Impaired and Blind Students

This paper reports on a study to determine whether blind students’ conceptualizations of force and motion differ from sighted students. This is particularly concerned with the question of whether the students’ visual experiences have any relation to their conceptualizations or misconceptualization about force and motion. The research was designed as a case study and the data was collected from 6 blind high school students based on conceptual physics problems related to force and motion. The analysis of the data revealed that although the blind students’ conceptions about force and motion are not radically different from those of sighted students, however, there were several conceptual problems which seem to be particular to the blind students because of their lack of visual experiences. The results revealed that visual experiences do not seem to have a significant role on the conceptualizations about force and motion.

Counterintuitive Dynamics Test

One way to fascinate, engage, arouse curiosity, motivate, and stimulate intellectual development in learning scientific concepts is to use counterintuitive questions. These questions make students aware of the inadequacies of their own thinking by exposing them to situations whose outcomes are inconsistent with what they would expect. In this study, a counterintuitive dynamics test (CIDT) is developed and administered to high school students along with the force concept inventory (FCI). After expert reviews, the initial version of the test consisting of 39 questions was administered to 87 students as a pilot study. After item analysis, a final version of 30 questions was developed; its internal consistency reliability coefficient was calculated as 0.826. The CIDT and FCI were administered to 229 students from 9 different high schools in Turkey. The results indicated that while in FCI students were mostly affected by everyday experiences and while in CIDT by carelessness and a superficial approach. Average scores for both tests were roughly equal and low. The results showed that the CIDT is a new test that measures another dimension of dynamic concepts and should be used along with the FCI.

Investigation of the secondary education students' conceptual understanding levels and attitudes towards force and motion

The purpose of this study is to investigate the 9th, 10th and 11th grade of secondary education students' conceptual understanding levels and attitudes regarding Force and Motion and the change according to the variables of gender and class level. The research sample is composed of 110 students in a state school in Ankara. 'Force Concept Inventory Test' and 'Attitude Scale towards Force and Motion' were used as data collection tools in the research in which the descriptive method was used. Results of the research, it was seen that the students' conceptual understanding levels regarding this concept were low. The class level were investigated, both the conceptual understanding levels and attitudes of the 9th grade students were observed to be in better level in terms of mean scores than the levels of the others. Conceptual understanding levels of 9th grade students differ meaningfully when compared with other grades. There were meaningful differences in favor of the males in the change of the students' conceptual understanding levels regarding Force and Motion according to gender. There were meaningful differences regarding the attitude between the 9th and 11th grade students and these differences were in favor of the males. Attitude scores of the 10th grade students did not change according to the factor of gender. It was revealed that there was a meaningful relationship at a medium level in a positive way between the students' conceptual understanding levels and attitudes regarding Force and Motion without making any discrimination at the class level.

Dividing the Force Concept Inventory into two equivalent half-length tests

Splitting the Force Concept Inventory into two statistically equivalent subsets that can be used in pre-post studies.

Compressed-format compared to regular-format in a first-year university physics course

We compare student performance in two sessions of a large first-year university physics course, one with a normal 12-week term and the other with a compressed 6-week term. Student performance is measured by the normalized gain on the Force Concept Inventory. We find that the gains for the regular-format course are better than the gains for the compressed-format course, and while the differences in gains are small they are statistically significant. Not accounted for are the differences in effectiveness of the different instructors in the two versions of the course.

Polarization of physics on global courses

Since October 2010, the Chemistry–Biology Combined Major Program, an international course taught in English at Osaka University, has been teaching small classes (no more than 20 in size). We present data from the Force Concept Inventory (FCI) given to first-year classical mechanics students (N = 47 students over three years) pre and post score, for a class that predominantly uses interactive engagement, such as MasteringPhysics. Our findings show a G-factor improved score of about ∼0.18, which is marginally about the average of a traditional-based course. Furthermore, we analyze in detail a set of six questions from the FCI, involving the identification of forces acting on a body. We find that student answers tend to cluster about ‘polarizing choices’—a pair of choices containing the correct choice and a wrong choice, with the latter corresponding to a superset of forces in the former. Our results are suggestive that students have a good idea of the right set of forces acting on a given system, but the inclusion of extra force(s) brings about confusion; something that may be explained by misleading ontological categorization of forces. In an appendix we also comment on possible correlations between the pre/post score and the level of English ability on entry to the course.

Exploration of Students’ Misconceptions in Mechanics using the FCI

During 3 years, we have used the Force Concept Inventory (FCI) to assess the progress of our First-Year students in Engineering in mastering the concepts of Newtonian Physics and to compare the efficiency of two teaching methods, courses and drills versus Problem-Based Learning. If both methods lead to quite similar deceptive results, the detailed analysis of the response to each question of the test allowed us to identify our students’ most common misconceptions. This paper presents this research and discusses our findings.