Abstract
Research on the test structure of the Force Concept Inventory (FCI) has largely been performed with exploratory methods such as factor analysis and cluster analysis. Multidimensional Item Response Theory (MIRT) provides an alternative to traditional exploratory factor analysis which allows statistical testing to identify the optimal number of factors. Application of MIRT to a sample of N=4716 FCI post-tests identified a 9-factor solution as optimal. Additional analysis showed that a substantial part of the identified factor structure resulted from the practice of using problem blocks and from pairs of similar questions. Applying MIRT to a reduced set of FCI items removing blocked items and repeated items produced a 6-factor solution; however, the factors still had little relation the general structure of Newtonian mechanics. A theoretical model of the FCI was constructed from expert solutions and fit to the FCI by constraining the MIRT parameter matrix to the theoretical model. Variations on the theoretical model were then explored to identify an optimal model. The optimal model supported the differentiation of Newton’s 1st and 2nd law; of one-dimensional and three-dimensional kinematics; and of the principle of the addition of forces from Newton’s 2nd law. The model suggested by the authors of the FCI was also fit; the optimal MIRT model was statistically superior.Received 8 March 2018DOI:https://doi.org/10.1103/PhysRevPhysEducRes.14.010137Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasAssessmentInstructional materials developmentPhysics Education Research
Highlights
The Force Concept Inventory (FCI) was introduced 25 years ago and has become one of the most used and most studied instruments in physics education research (PER) [1]
The FCI was first examined with Multidimensional Item Response Theory (MIRT) without employing a theoretical model, performing an exploratory factor analysis (EFA)
This is analogous to a confirmatory factor analysis (CFA), where the analysis proceeds from the theoretical model and determines how well the data fit the model
Summary
The Force Concept Inventory (FCI) was introduced 25 years ago and has become one of the most used and most studied instruments in physics education research (PER) [1]. Its success was followed by the development of numerous other conceptual instruments some of which found wide-spread use including the Force and Motion Conceptual Evaluation [3], the Conceptual Survey of Electricity and Magnetism [4], and the Brief Electricity and Magnetism Assessment [5]. These four instruments have in turn been used to help understand the effect of pedagogical innovations, the challenges of learning physics, and issues of inclusion in physics. For a broad overview of PER including the role of conceptual inventories in PER, see Docktor and Mestre’s recent synthesis [6]
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
