Higher Order Thinking Research Articles

Exploring how video conferencing impacts students' cognitive, emotional, and behavioral engagement

Video conferencing has become an essential tool in the realm of education, offering educators a plethora of features to enhance student learning. This study delved into the comparative impact of video conferencing and Learning Management Systems (LMS) on student engagement in online education. The primary objective was to discern the most effective mode of communication for fostering student engagement in online learning, examining cognitive, emotional, and behavioral dimensions of engagement. The researchers used a quasi-experimental design with a historical cohort control group to compare the effectiveness of Zoom and Moodle (LMS) on student engagement. The study involved English education students from a private university in Indonesia, with 20 students in each group. Data collection included recording online interactions, conducting semi-structured interviews, and administering a Likert-style survey. Data analysis involved content analysis, thematic analysis, and the Mann-Whitney U test. The findings underscored the advantages of utilizing Zoom, particularly in nurturing interpersonal relationships among students. Notably, the platform enhanced intimacy and interactivity within the learning environment, bolstering students' intrinsic motivation. Moreover, indicators such as creativity and idea exchange pointed towards heightened cognitive engagement facilitated by Zoom. Additionally, Zoom emerged as a practical tool for fostering social interaction and stimulating higher-order thinking during discussions. Consequently, these results provide compelling evidence supporting the integration of Zoom to enrich learning experiences and promote deeper engagement among students, both practically and theoretically.

Communication Skills Assessments and Rubrics In The Higher Education: A Meta-Analysis

Effective communication skills are crucial in the higher education system. Consequently, there is a growing concern about how higher education institutions can better equip students with the communication skills required for success in both academic and professional settings. The assessment of communication skills, especially in higher education, is complex and can have a substantial impact on students' academic achievements, preparedness for their careers, and overall professional growth. Due to this disparities and assessment challenges, this meta-analysis sought to answer the following research questions: (a) What are the assessments employed for communication skills in multi-discipline studies in higher education? (b) What are the “key findings” contributing to the issues of communication skills assessment in higher education? In this article, a meta-analysis was conducted to determine the types of communication skill assessments and other key findings concerning the assessment issues in this area. Sources were identified using Scopus, Web of Science, Wiley Online Library, Taylor & Francis Online and Springerlink, and, after inclusion criteria were applied, 21 samples of articles were included in the meta-analysis. The findings demonstrate the existence of issues from the aspects of audience, mode, and purpose of the assessments, which mainly are: (1) impact of language proficiency and ICT competency; (2) communication skills approach to non-scientific audience; (3) blended assessment and feedback communication; (4) use of explicit and direct teaching assessment; (5) critical thinking and opportunity for justifying scientific ideas; and (6) benefit of early and continuous communication tasks. The review finds an extensive gap on the communication skills assessment related to higher-order thinking and problem-solving abilities in junior students. This meta-analysis may be of great interest to university policymakers, language lecturers, and academic lecturers from other disciplines who are searching for the best assessments strategies to measure students' communication skills.

Ahmad Dahlan Thoughts Through Al-Ma'un and Higher Order Thinking Skill (HOTS) in Education: Is It Relevance?

This research seeks to determine the significance of Higher-Order Thinking Skills (HOTS) learning in the Al-Ma'un philosophy, as KH Ahmad Dahlan taught. The method employed is a literature review, with data collected from literature relevant to the theme of KH Ahmad Dahlan and Higher-Order Thinking Skills (HOTS) learning. The data is then analyzed thematically and processed using an inductive method. According to the findings, KH Ahmad Dahlan taught Al-Ma'un to his students, which is similar to Higher-Order Thinking Skills or HOTS nowadays.

Development and validation of a higher-order thinking skills (HOTS) scale for major students in the interior design discipline for blended learning

Assessing and cultivating students’ HOTS are crucial for interior design education in a blended learning environment. However, current research has focused primarily on the impact of blended learning instructional strategies, learning tasks, and activities on the development of HOTS, whereas few studies have specifically addressed the assessment of these skills through dedicated scales in the context of blended learning. This study aimed to develop a comprehensive scale for assessing HOTS in interior design major students within the context of blended learning. Employing a mixed methods design, the research involved in-depth interviews with 10 education stakeholders to gather qualitative data, which informed the development of a 66-item soft skills assessment scale. The scale was administered to a purposive sample of 359 undergraduate students enrolled in an interior design program at a university in China. Exploratory and confirmatory factor analyses were also conducted to evaluate the underlying factor structure of the scale. The findings revealed a robust four-factor model encompassing critical thinking skills, problem-solving skills, teamwork skills, and practical innovation skills. The scale demonstrated high internal consistency (Cronbach's alpha = 0.948–0.966) and satisfactory convergent and discriminant validity. This scale provides a valuable instrument for assessing and cultivating HOTS among interior design major students in blended learning environments. Future research can utilize a scale to examine the factors influencing the development of these skills and inform instructional practices in the field.

Feasibility of a problem-based social constructivism learning model to improve higher-order thinking skills among primary school students

This research aims to demonstrate the results of an experiment on how the Problem-Based Social Constructivism Learning Model (PBSCL) can be developed to effectively promote Higher-Order Thinking Skills (HOTS) among primary school children. The methodology employed in this study was developmental research which involved thorough preliminary studies, meticulous product development and comprehensive product testing stages. Respondents for this study included model experts, language experts, content specialists and practitioners. Data collection instruments used were detailed questionnaires served during the feasibility test. In addition, product testing involved rigorously confirming the findings of product development through extensive expert validation, including learning model expert validation, content or material expert validation, language expert validation and practitioner validation. The results of the assessment on learning design expert validators for the PBSCL learning model indicated that they had high qualifications with the average score being 3.29. Consequently, learning design experts ensured that the criteria were meticulously met by the PBSCL learning model for HOTS improvement. Additionally, subject matter specialists confirmed the appropriateness and effectiveness of using the PBSCL learning model for HOTS improvement. The findings suggest that the PBSCL learning model has significant potential to substantially enhance HOTS among primary school students. However, further investigation is needed to fully validate its effectiveness and practical application in diverse educational settings.

Teaching Design for Practical Courses Based on Virtual Simulation Technology

The National Virtual Simulation Experimental Teaching Project (NVSETP) is one of the five "Golden Courses" launched by the Ministry of Education (MoE) of the People's Republic of China. These courses need to adhere to the Golden Course standards, which include offering a curriculum that is innovative, challenging, and designed to develop higher-order thinking skills through rich content and novel teaching methods. Students receive opportunities for both practical and theoretical learning that guide them in engaging in innovative thinking and practice. This article discusses the teaching design for practical courses based on Virtual Simulation Technology, grounded in the Outcome Based Education, and drawing from the construction of the first batch of NVSETP Teaching Centers and Projects. It primarily addresses four aspects of teaching: objectives, curriculum content, methods, and assessment. Taking the lack of real experimental engineering conditions and high-risk, high-cost practical operations as the starting point, this paper designs the teaching content and methods; Revising the traditional experimental teaching process, this paper adopt blended learning methods. Evaluates the learning effect of students through the real-time feedback of virtual simulation software, further reforms the teaching and improves the teaching effect. The paper provides a reference for constructing Virtual Simulation Experimental Teaching Projects and reforming practical course teaching.

Adapting Reading Instruction to Meet the Needs of Nursing Students: Insights from a Targeted Educational Study

Developing Higher-Order Thinking Skills (HOTS) and effective information transfer is crucial for nursing students, impacting their academic and professional competence. This study aims to identify the gaps in English reading materials used by nursing students at a Health Polytechnic, assessing their adequacy in supporting these critical cognitive skills. The research focused on 79 second-semester nursing students during the 2022/2023 academic year and employed a 25-item questionnaire to analyze target situations, deficiencies, current situations, and strategies. The results reveal that existing general English coursebooks need to meet the specialized needs of nursing education. Notably, these materials lack content that promotes HOTS and aids in information transfer, essential elements for nurturing the cognitive and professional skills required in nursing. The study underscores a significant need for more appropriate materials that support HOTS, highlighting the need for strategically revised material development. It is recommended that custom English reading materials integrating HOTS and effective information transfer techniques be developed to enhance comprehension and relevance in the nursing curriculum, thereby better preparing nursing students for their future roles.

Contexts proposed by teachers in Papua for developing mathematics hots assessment instruments: A phenomenological study

The success of a school centers on teachers' ability to create well-aligned educational tools. The Merdeka Belajar curriculum requires adapting assessments, including Higher-Order Thinking Skills (HOTS) questions for real-world problem-solving scenarios. This study explored contexts proposed by teachers in Papua for developing Mathematics HOTS questions. A phenomenological approach within a qualitative framework was employed involving 24 mathematics teachers from public and private schools in focus group discussions. Participants included twenty teachers from Papua, two from Central Indonesia and two from Western Indonesia. Additionally, five teachers from Papua participated in in-depth interviews. Data was analyzed using Creswell’s model with Atlas.ti software. Teachers developed HOTS assessment instruments based on daily life, scientific and social contexts. However, no cultural contexts were incorporated into these instruments by the interviewed teachers. This study highlights the importance of teacher preparedness in aligning contextual learning with the Merdeka Belajar curriculum and reveals a significant gap in using cultural contexts for HOTS assessments among teachers in Papua. These insights contribute to the discourse on math education in Indonesia advocating for the integration of cultural elements into the freedom to learn initiative.

Implementation of Levels of Inquiry Model in Improving Students' HOTS on Fluid Material

This research is motivated by the low level of students' higher order thinking skills (HOTS) in physics. The purpose of this study is to determine how the application of Levels of Inquiry (LoI) learning model in improving students' HOTS. The research design used was a quasi-experiment involving grade XI students in one of the high schools in Bandung City with a research sample of 35 students in the experimental class and 25 students in the control class. The instruments used in this study were higher order thinking skills test in the form of two-level multiple choices for fluid material and observation sheet of learning model implementation. Data analysis techniques include N-Gain, hypothesis testing and effect size. The results of the analysis showed that the application of the LoI learning model in the experimental class was in the excellent category and could improve students' HOTS in the moderate category with an N-gain value of 0.53. In the control class, the application of the conventional learning model can improve students' HOTS in the low category with an N-gain score of 0.18. In addition, the analysis of the Mann-Whitney test results showed that there was a significant difference in students' HOTS between the experimental group and the control group with an effect size in the very large category. This research proves that the application of the LoI learning model is effective in improving students' HOTS in fluid materials.

Relieving negative Chinese transfer in EFL syntactic writing through negative feedback based on computational thinking

Negative feedback can temporarily relieve negative Chinese transfer (NCT) in English as a foreign language (EFL) syntactic writing by focusing only on the surface writing constructs, neglecting that EFL writing is an embodiment of the process by which higher-order thinking operates. To solve the problem, the researchers conducted a pretest, interventionist group dynamic assessment (IGDA) in the form of negative feedback based on computational thinking (CT), higher-order thinking, and post-test quasi-experimental design, with a control group receiving the direct correction feedback instructing model to mitigate the NCT in EFL syntactic writing. We analyzed the syntactic writing types and frequencies of the NCT obtained through repeated-measure ANOVA and confirmed by qualitative data through video recording. The results indicated that IGDA in the form of negative feedback based on CT principal skills could (1) significantly decrease syntactic writing errors caused by the NCT, (2) improve learners’ EFL writing performance, and finally, (3) elevate the computer as an essential mediation tool. This innovative instructing mode of intervening with writing constructs and higher-order thinking and bringing about deeper thinking and creativity contributes to the EFL writing teaching methodology in a foreign language higher education.

Analysis of higher order thinking skills and lower thinking skill items in summative evaluation of Akidah-Akhlak learning

This research explores the implementation of summative evaluation in Islamic Religious Education (Akidah Akhlak) subjects at SMP Muhammadiyah 4 Yogyakarta, with a focus on implementing Higher Order Thinking Skills (HOTS). Summative evaluation is considered very important in measuring the achievement of the Islamic Religious Education program. High-level critical and creative thinking skills (HOTS) are considered important in solving everyday problems, especially in the era of globalization. This research uses a qualitative descriptive method with document content analysis, especially the final semester assessment questions for Aqidah Akhlak class VII made by the Regional Leadership of Muhammadiyah (PWM) DIY. The findings show that of the 12 final semester assessment questions, 6 questions (15%) meet the HOTS criteria, while 28 questions (70%) fall into the low-level thinking ability (LOTS) category. In addition, 6 items (15%) did not have a correct answer among the available options. These findings underscore the need to increase the integration of HOTS in designing summative evaluation questions for Islamic Religious Education (PAI). This research aims to describe and collect information about the implementation of summative evaluations and assess the results at SMP Muhammadiyah 4 Yogyakarta. Effective summative evaluation is expected to make a significant contribution to improving the quality of Islamic education at the secondary level.

Time spent on active learning activities does not necessarily correlate with student exam performance: a controlled case study.

Active learning, including student thinking and discussion in class, has been shown to increase student learning gains. However, it is less clear how instructor-level variation in the implementation and timing of active learning activities affects student gains. Our study aims to investigate the extent to which the time spent on individual episodes of active learning activities influences student performance. We hypothesized that instructors who let students spend more time on peer discussion and individual thinking on practice problems associated with particular learning objectives would have better student exam scores on exam questions addressing those objectives. To test this hypothesis, we obtained a large data set of classroom recordings and student exam scores from an introductory biology course at a large 4-year university, where three instructors shared identical teaching materials and exams for different course offerings. Contrary to our hypothesis, although the three instructors spent significantly different amounts of time on episodes of thinking and peer discussion, there was no correlation between the total time spent on active learning activities and student performance on exam questions. Linear mixed-effects modeling of the effect of the length of episodes of student thinking and discussion on exam score found that in the context of shared instructional materials, the amount of course time spent on active learning activities did not reliably predict student performance on associated exam questions. This result held true even when only considering learning objectives with high variations in performance between offerings, difficult exam questions, or exam questions requiring higher-order thinking skills. Although our study was only conducted in one course, our results imply that time spent per individual episode of student thinking or peer discussion may not be the primary factor explaining the positive effects of active learning and that it may be worthwhile to explore other factors.

Empowering Social Studies Education: The Role of M-learning in Fostering Motivation and Well-being

Mobile learning (m-learning) offers new possibilities for enhancing motivation and well-being in social studies education. This literature review synthesizes current research on using mobile technologies in K-12 and higher education social studies contexts. Systematic searches yielded 37 empirical studies that were analyzed. Findings indicate emerging interest in m-learning for active learning opportunities leveraging mobile affordances. Student motivation may be increased through engagement, personalization, and bridging formal/informal learning. Well-being can potentially improve via reduced anxiety, social connections, and flow states. However, equitable access, teacher training, privacy, assessment, and curriculum integration require consideration. Gradual implementation, aligning activities to objectives, and promoting digital citizenship are advised. More rigorous research is needed to establish impacts on higher-order thinking and competencies. Harnessed effectively, mobile devices may reinvigorate social studies by connecting school to students’ lives.

The Application Research of 5E Teaching Model into the Blended English Reading Teaching of Chuxiong Medical College

The 5E model is a mode is based on constructivism, emphasizing student-centeredness. The 5E model into the blended teaching classroom and the wisdom tree learning platform was used and Xuexitong mini- program was used to deepen the reform of English- teaching of Chuxiong medical college, and effectively guide students to learn to think, analyze, evaluate and apply so as to improve students ability to learn higher-order thinking and the ability to apply English practically.

EduQuestioning mobile learning application: a catalyst for developing HOTS-based assessment questions referring to Revised Bloom’s Taxonomy

Mobile learning application for assisting teachers or preservice teachers to develop questions based on higher-order thinking skills had not been widely invented. Thus, this study aimed to develop EduQuestioning mobile learning application that could help teachers or teacher candidates create assessment questions based on higher-order thinking skills (HOTS). The present study used research and development design by involving developmental stages of analysis, design, development, implementation, and evaluation (ADDIE). This study involved qualitative and quantitative data. There were eight lecturers and sixty-one preservice teachers majoring in mathematics, natural science, social science, and Indonesian language education involved as the participants. They were chosen using inclusion criteria such as being involved in assessment course. Data were collected using forum group discussion, student-needs analysis questionnaire, Aiken and Expanded Gregorian Index content validity sheet, face validity sheet, and structured response questionnaire. The obtained qualitative data were analyzed using Miles and Huberman’s theory and the quantitative data were analyzed using descriptive statistics and Swanson’s quartile categorization. Results showed that EduQuestioning mobile learning application could be developed through ADDIE stages with a very high content and face validity. In addition, the participants gave positive response on the use of EduQuestioning with M% > 75% and Q = 4. This study suggested that EduQuestioning mobile learning application could be accessed freely and used to train developing HOTS-based learning assessment questions.

Cultivating sustainability and resilience in olive heritage

Learning outcomes The case study’s learning objectives, structured according to Bloom’s taxonomy, engage students in higher-order thinking for critical analysis and strategic decision-making. After completion of the case study, students will be able to analyze sustainability practices and evaluate the family’s distribution model for alignment with sustainability and potential expansion strategies; explore adaptive strategies to identify adaptive solutions to challenges such as climate change and economic fluctuations; apply theoretical frameworks to balance exclusivity and growth in the olive oil industry; and assess strategic decisions considering financial viability, environmental responsibility, community engagement and sustainability. Case overview/synopsis The case study centers on the Abi Raad olive farm, a multigenerational family-owned business deeply rooted in olive cultivation traditions in Selfaya village, within Mount Lebanon’s Aley district. Led by Richard Abi Raad, the family specializes in olive cultivation, olive oil production and handmade soap manufacturing within the agriculture sector. In 2023, the organization faces significant challenges such as rising labor costs and the exploration of sustainable labor sources for future growth. Abi Raad, the primary protagonist, grapples with critical decisions regarding maintaining traditional distribution methods versus expanding into broader markets. His choices must balance the preservation of cultural heritage with the need to uphold brand integrity and competitiveness. The case study traces the family’s historical journey in olive farming and explores their contemporary strategic dilemmas, offering insights into sustainable agriculture, entrepreneurship and navigating modern challenges while honoring tradition. Through the narrative of the Abi Raad family-owned business, the case study provides profound lessons in strategic decision-making and ensuring long-term sustainability. Complexity academic level This case study is suitable for students studying master’s in business. Supplementary materials Teaching notes are available for educators only. Subject code CSS 11: Strategy.

PENGEMBANGAN INSTRUMEN TES MATEMATIKA BERBASIS HIGHER ORDER THINGKING SKILLS (HOTS) UNTUK SISWA SMP

The aim of this research is to develop a mathematical test instrument based on Higher Order Thingking Skills for high school students. The research methods used in this research are research and development methods or Research and Development. (R&D). The data-gathering instruments for this search are teacher lift, student perception lift, observation sheet, interview guide, and the definition test of Higher Order Thinking Skills. (HOTS). The study was tested on 25 students of the eighth grade of high school, the test was carried out on the material of linear equations and linear inequalities of one variable. The results of the research show that: 1) the test instrument Higher Order Thinking Skills developed is valid and reliable, 2) has an average difficulty level for each type of question, and 3) the test instruments Higher order thinking skills (HOTS) developed fall into the category both in different power tests. So, the tool developed by the researchers deserves to be used as an assessment to measure the Higher Order Thinking Skills (HOTS) test for high school students

Reflective Thinking: A Bibliometric Analysis of Four Decades of Research and Insights for Future Studies

Reflective thinking (RT) is one of the higher-order thinking skills which have been of great importance to the researchers from a variety of disciplines for years. Although the significance of RT has been discussed in many studies and many different forms, there are no bibliometric studies conducted on this topic. This study aims to examine the current state and development of research in RT based on the data available in the Web of Science (WoS). To do this, a bibliometric approach was adopted to map the research literature on RT using the metadata from the WoS between 1986 and 2023 in terms of the distribution of the articles by year of publication and average citation status, the most productive journals publishing on RT and number of RT-related citations, the most cited RT articles and authors, top countries in which the articles about RT were cited most, the authors who have produced the most articles on RT, their publications and corresponding author(s)’ countries, and the trend of words associated with RT in the articles. Our main contribution is the quantitative methodological design for examining the evolution of reflective thinking research, which is highly multidisciplinary and covers a large volume of publications. We believe that this study provides a comprehensive review of the studies on RT and provides interesting insights about the development of the field for future research.

A qualitative analysis of Chinese higher education students’ intentions and influencing factors in using ChatGPT: a grounded theory approach

The emergence of ChatGPT has significantly impacted the field of education. While much of the existing research has predominantly examined the theoretical implications of ChatGPT, there is a notable absence of empirical studies substantiating these claims. As pivotal stakeholders in education and primary users of ChatGPT, exploring the willingness and influencing factors of higher education students to use ChatGPT can offer valuable insights into the real-world needs of student users. This, in turn, can serve as a foundation for empowering education with intelligent technologies in the future. This study focuses specifically on the demographic of students in Chinese higher education who have utilized ChatGPT. Using semi-structured interviews and grounded theory methodology, we aim to comprehensively understand the extent to which students embrace new technologies. Our objective is to elucidate the behavioral inclinations and influencing factors of student users. The findings of this study will contribute practical insights for refining policy frameworks, expanding the dissemination of quality resources, optimizing and upgrading products for an enhanced user experience, and fostering higher-order thinking skills to adeptly navigate evolving technological landscapes. In conclusion, this research endeavors to bridge the gap between theoretical discussions and practical applications.

Advancing to the academics: How did first-year Chinese undergraduates evaluate academic literature?

In the context of tertiary education, the ability to evaluate sources is of paramount importance for students’ academic reading and writing development, particularly for first-year university students who are still in the transitional stage. Some researchers have argued that Chinese students may lack critical thinking skills, including evaluation skills. However, little attention has been given to this higher-order thinking skill when it comes to first-year Chinese university students reading academic literature. Therefore, this study aimed to investigate the criteria used by 117 Chinese first-year undergraduates when evaluating academic literature and how these criteria influence their evaluation accuracy. The results revealed that students generally demonstrated the ability to distinguish reliable from unreliable academic documents by utilizing a range of evaluation criteria. Among the identified criteria, Topicality and Publication Information were prominently employed by students. Furthermore, these criteria accounted for approximately 21 % of the variance in evaluation accuracy, with Publication Information, Reference, and Data significantly predicting evaluation performance. The study also discussed the pedagogical implications of teaching academic literacy to first-year undergraduates.