A phenomenological study of challenges that prospective mathematics teachers face in developing mathematical problems that require higher-order thinking skills

Abstract

Assessment in mathematics education in the 21st century should be more directed at higher-order thinking skills (HOTS). Not only teachers but also prospective mathematics teachers should be supported to design and carry out HOTS assessments. This qualitative study applying a phenomenology approach was mainly conducted to investigate the challenges that prospective mathematics teachers face in developing HOTS questions, including their strategies for dealing with these challenges. Our informants were 20 students of master’s program in mathematics education. They were enrolled in the assessment of mathematics learning course, which was designed with a project-based learning model. Considering the learning model used, the purpose of this study then was extended to explore the benefits of implementing a project-based learning model in supporting student competence in developing HOTS questions. Data collection was carried out by (1) administering open-ended questionnaires; (2) observing the end product in the form of mathematics learning achievement tests and test blueprints; and (3) involving two experts who worked independently to judge the questions posed by students based on levels in the cognitive process dimension in the revised Bloom’s taxonomy. Data collected from the open-ended questionnaire were analyzed qualitatively, while data from observation and judgment by experts on the end product yielded by students were analyzed descriptively. Our study supports previous studies, which demonstrate that the application of a project-based learning model that involves students to develop HOTS questions deepens students’ knowledge of assessment. In developing HOTS questions, students struggled more in matching action verbs, item indicators, and test items to the level of cognitive process they defined, as well as constructing multiple-choice HOTS questions. The strategies that students took in dealing with challenges that arose in developing HOTS questions indicate that students regulate their learning.