HOTS-based Assessment Research Articles

Integration of Local Potential of Way Kambas National Park in Developing HOTS-Based Assessment Content in Biological Conservation Courses

The assessment of Higher Order Thinking Skills (HOTS) based on local potential has not been widely used in biological conservation education. Assessments like this aim to encourage students to think critically, analytically, and creatively, as well as familiarize students with solving problems in real contexts, especially in the conservation area of Way Kambas National Park (WKNP) in Lampung. This study aims to identify the local potential of WKNP conservation areas that have the potential to be integrated with the development of HOTS-based assessments in the Biological Conservation Course. The method used in this study is descriptive with a qualitative approach. Interviews were conducted with 6 informants. Triangulation techniques and data interpretation then analyzed the data obtained. The results of this study show that there is a lot of local potential in WKNP conservation area that has the potential to be integrated into the assessment content on 7 biological conservation materials that can be made HOTS-based assessments to hone students' high-level thinking skills.

EduQuestioning mobile learning application: a catalyst for developing HOTS-based assessment questions referring to Revised Bloom’s Taxonomy

Mobile learning application for assisting teachers or preservice teachers to develop questions based on higher-order thinking skills had not been widely invented. Thus, this study aimed to develop EduQuestioning mobile learning application that could help teachers or teacher candidates create assessment questions based on higher-order thinking skills (HOTS). The present study used research and development design by involving developmental stages of analysis, design, development, implementation, and evaluation (ADDIE). This study involved qualitative and quantitative data. There were eight lecturers and sixty-one preservice teachers majoring in mathematics, natural science, social science, and Indonesian language education involved as the participants. They were chosen using inclusion criteria such as being involved in assessment course. Data were collected using forum group discussion, student-needs analysis questionnaire, Aiken and Expanded Gregorian Index content validity sheet, face validity sheet, and structured response questionnaire. The obtained qualitative data were analyzed using Miles and Huberman’s theory and the quantitative data were analyzed using descriptive statistics and Swanson’s quartile categorization. Results showed that EduQuestioning mobile learning application could be developed through ADDIE stages with a very high content and face validity. In addition, the participants gave positive response on the use of EduQuestioning with M% > 75% and Q = 4. This study suggested that EduQuestioning mobile learning application could be accessed freely and used to train developing HOTS-based learning assessment questions.

Literature Review of Implementation HOTS-Based Assessment Instruments in Learning to Write Prose Fiction in Higher Education

Competence in writing prose fiction is one of the writing competencies that Indonesian literature students must have. The higher-order thinking skills (HOTS) based fiction writing competency assessment instrument is something that cannot be separated from students' achievement of fiction prose writing competency. HOTS-based competency assessment is one of the measuring tools in the process of developing student writing competency. This research was a literature review research on the implementation of a HOTS-based fiction writing competency assessment instrument in higher education. This research used the PRISMA method. A search for relevant literature was carried out through Google Scholar database with the criteria being limited to articles published in Sinta 1-3 indexed journals in 2016-2023. 12 articles met the criteria and became material for analysis. The results of these findings indicated that the research related to learning to write HOTS-based fiction prose in higher education had not yet been carried out. The HOTS-based writing competency assessment instrument in higher education had only been used for general Indonesian language learning, it had not been used in the realm of literature learning. The findings of this systematic literature review recommended that there was a need for further research in the field of development, implementation, and evaluation of Indonesian literature learning assessment instruments, especially the development of HOTS-based fiction prose writing competency assessment instruments in higher education.

Increasing Teacher’s Ability to Develop Teaching and Learning Material Based on Higher Order Thinking Skills (HOTS)

Learning with teaching material based on higher-order thinking skill could improve the learners’ understanding. This community service research provides training and mentorship for physics educators to compose innovative physics teaching materials. Twenty educators from Islamic Senior High Schools joined the community service activity. The success of the activity was observable on the educators while mentoring the teaching material preparation. The educators have high interest on the activities. They had the same objectives in the activity to create innovative teaching materials. Thus, the students while learning physics had high learning motivation. Generally, the program implementation remained within the activity orders, the workshop and training to develop teaching materials and HOTS-based assessment. The developed teaching material made the teachers enthusiastic to develop the HOTS-based teaching material. The products consisted of three HOTS-based modules, one book, one HOTS-based assessment, and three copyrighted works of the teachers.

DEVELOPING HOTS-BASED MATHEMATICS ASSESSMENT INSTRUMENTS TO IMPROVE CRITICAL THINKING SKILLS OF PROSPECTIVE ELEMENTARY SCHOOL TEACHERS

The current reality is that most teachers have not developed their students' Higher Order Thinking (HOTS) skills. This is because the teachers themselves do not understand HOTS well. This research aims to develop HOTS-based mathematics assessment instruments for prospective elementary school teachers. The type and model of research conducted is research and development (R n D), Borg & Gall model. The product developed is a 10-item HOTS question. The questions that have been compiled are validated by three validators. Valid questions were tested on students who took Mathematics Learning courses. The trial was conducted with the aim of determining the quality of the instrument using classical test theory, namely validity, reliability, difficulty index, and distinguishing power. The results showed that the HOTS-based mathematics assessment instrument met the criteria of a quality instrument, namely very valid, high reliability, with good differentiation and difficulty levels. Thus, the instrument developed is suitable to be used to measure the HOTS ability of prospective teacher students. From the results of the test analysis, it was found that the students' ability to solve HOTS-based problems obtained an average of 74.65 was in the moderate category and the results of the analysis of students' critical thinking skills obtained 62.89% also in the moderate category. So it can be concluded that students' ability to solve HOTS-based questions is directly proportional to students' critical thinking skills. Thus, it can be concluded that HOTS-based assessment instruments can improve the critical thinking skills of prospective elementary school teachers.

Development of an Ethnic-Math HOTS-Based Assessment Instrument to Measure Students' Numerical Literacy

Development of an Ethnic-Math HOTS-Based Assessment Instrument to Measure Students' Numerical Literacy

PENGEMBANGAN INSTRUMEN PENILAIAN BERBASIS HOTS BERBANTUAN WEBSITE WORDWALL PADA MATERI BANGUN RUANG

This study to khow how to develop HOTS-based assessment instruments assisted by wordwall websites on building material for classrooms V SDN Bantarkemang 2, as well as knowing the feasibility of assessment instruments using wordwall websites in the learning process. The method used in this study is using the ADDIE method (Analyze, Design, Development, Implementation, and Evaluation). This research begins with collecting information on the needs and problems that exist in elementary schools, designing assessment instruments, validating products to experts, revising products, and after that testing assessment instruments for students. The results of the feasibility trial of assessment instruments using the wordwall website show that this product is very feasible for use in learning. This is evidenced by the results of the response questionnaire of validators, evaluation experts, material experts, media experts and linguists by obtaining an average percentage of 98%, as well as student response questionnaires which obtained an average percentage of 99.7%. This is also supported by analyzing the validity of the question items, the reliability of the question items, the level of difficulty of the question items and the distinguishing power of the question items. So it can be concluded that the HOTS-based assessment instrument assisted by the wordwall website on classroom V building material is suitable for use by students.

Development of HOTS-based assessment instruments in calculating building structures moment for Vocational High Schools (VHS)

Vocational High School (VHS) is a secondary school that offers skill-based education with the main aim of providing students with knowledge and skills that are suitable to apply in the workplace after graduation. Digitalization in the industrial revolution 4.0 era requires VHS graduates to think analytically, adaptive, creatively, and innovative at a higher level. Therefore, a more weighty test instrument is needed to determine students’ thinking skills by measuring higher-order thinking skills or HOTS. This study aims to confirm the extent to which the indicators in the instrument items can measure the achievement of material or learning competence in engineering mechanics and the implications of measurement models for HOTS questions on engineering mechanics. Engineering mechanics is a concept of physics that discusses structures and their working loads. This study used is Research and Development (R&D) method with Confirmatory Factor Analysis (CFA) data analysis techniques. The number of samples used in the study was 200 VHS students with property construction technology expertise. The analysis process is carried out with the help of JASP software. The results obtained in this study are 11 measurement models obtained using JASP, namely the fit measurement model.

Development Of Hots-Based Assessment in the Curriculum to Increase Critical Thinking Skills of Elementary School Students

HOTS is an important aspect of learning. Higher order thinking skills are the process of analyzing, reflecting, giving arguments (reasons), applying concepts to different situations, and creating. Given the importance of the HOTS position in learning, teachers need to have knowledge and competencies that can help in developing the higher-order thinking skills of their students. This study aims to develop a qualified HOTS-based assessment instrument so that elementary school teachers can use it to develop students' thinking skills. This research is a research and development with the stages of the ADDIE model: (1) Analyze, (2) Design, (3) Develop, (4) Implement, and (5) Evaluate. The results of this study show that the HOTS-based assessment instrument developed for fifth grader is valid, practical, and reliable so that it is suitable for use in training fifth grader to do HOTS-based questions. The validation results of material experts and linguists show that the HOTS-based assessment instrument developed is valid.

PENGEMBANGAN INSTRUMEN PENILAIAN BERBASIS HOTS PADA MATERI BILANGAN DAN OPERASINYA PADA SISWA KELAS IV SD

High Order Thinking Skills (HOTS) are one of the important thinking skills for learning mathematics. The importance of HOTS causes teachers to be able to map students' HOTS abilities so they can provide appropriate learning, especially to improve HOTS itself. Therefore we need a HOTS-based assessment instrument so that students' higher-order thinking skills can be measured properly. This study aims to develop a HOTS-based assessment instrument on numbers and their operations for fourth grade elementary school students. The development stage carried out is the preliminary stage, the self-evaluation stage, the formative evaluation stage through expert reviews, one on one, and small group) and field tests. The test instrument used is content validity test with Lawshe's CVR coefficient. Furthermore, item analysis was carried out using Graded Response Model (GRM) analysis. The results of this study indicate that the HOTS mathematical test instrument developed using numbers and their operations in measuring the high-level thinking skills of fourth grade students at SD Gugus V Sukawati achieves predetermined criteria, namely valid and reliable. The test instrument in the form of HOTS math questions which was developed has a valid quality in improving the mathematical high-level thinking of fourth grade students at SD Gugus V Sukawati. This is supported by the validation results of 7 validators who obtained a value of 2.95, which means that the HOTS math questions are in the relevant criteria.

HOTS based Speaking and Reading Assessment in English Language Learning in Distance Learning System

The article was to determine the Higher Order Thinking Skills (HOTS) based assessment in speaking and reading in English language learning in distance learning system. The method used qualitative research with a field study design. Collecting data through observation and interview. This research was conducted at SMA Muhammadiyah 4 Makassar with twenty English teachers. The results showed that the HOTS-based assessment in speaking and reading in English language learning within a distance learning system was carried out effectively by the English teachers. However, there were several challenges encountered during implementation, including technological limitations. Distance learning requires a stable internet connection and adequate devices, but not all students have good access to the internet, which can hinder teachers in effectively conducting speaking and reading assessments. Additionally, not all students have sufficient audio or video devices to participate in speaking assessments, which can hinder their ability to practice speaking clearly and listen well. Furthermore, there were challenges in providing direct and individual feedback in distance learning. In speaking assessments, timely and direct feedback is crucial for students to correct mistakes and improve their speaking skills. However, in distance learning, feedback was often given in written form or through recorded videos, which can result in delays and limit students' opportunities for improvement.
 Keywords: HOTS based Speaking, Reading Assessment, Distance Learning System

Pelatihan Pengembangan Asesmen Berbasis High Order Thinking Skills (HOTS) Bagi Guru MIPA SMP di Kotabumi Lampung Utara

The development of this thinking ability through education, with education students can make the best use of the information they have. The observation results show that most of the teachers have not used HOTS-based assessments. This is very concerning because students are only fed by learning with the old pattern, namely students are only learning objects with the lecture method. The aim of the training is to increase teachers' understanding of assessment, increase teachers' understanding of the HOTS-based assessment concept and efforts to improve teachers' skills in developing in learning evaluation. Training methods Lectures and demonstrations. The success of the implementation of this training is determined based on pre-test and post-test data using a Likert scale. The results of increasing the pre-test and post-test scores in this community service activity show the criteria of "very good" which means that there is an influence of the activity on the ability of junior high school teachers in preparing HOTS-based assessments.

Implementation of Higher Order Thinking (HOTS) Based Assessment in the Subject of Islamic Religious Education (PAI) in Class 7 SMPN 1 Lebong Bengkulu

Assessment is an instrument used to measure the success of a program. In the world of education there are many assessment models or instruments, one of which is a hots-based assessment. This study aims to describe the implementation of host-based assessment on PAI subjects at SMPN 1 Lebong. The research method used in this study is a qualitative research method. Data collection techniques were carried out by interviews, observation, and documentation. While data analysis used qualitative data analysis from Milles which included several stages, namely, data reduction, data presentation, and drawing conclusions. The results of the study show that in the implementation of host-based assessments on PAI subjects in class 7 SMPN 1 Lebong, it is carried out using various strategies. There are positive and negative impacts on students in implementing host-based assessments in class 7 SMPN 1 Lebong.

Development of Higher Order Thinking Skills-Based Assessment Instrument on Acid-Base Materials in High School

Higher Order Thinking Skills (HOTS) are necessary skills to deal with the 21st century. This research aimed to develop a HOTS-based assessment instrument on acid-base for class XI that meets the aspects of validity, reliability, difficulty level and distinguishing power. This research is a Research and Development (R&D) study with a 4D model. The quality of the product was assessed by one material expert lecturer, one media expert lecturer, and four chemistry teachers of high school and tested on 30 science students in eleventh grade. The assessment of product quality obtained from material experts is 97.67% with the Very Good (VG) category; from media expert, it was 97.44% with the Very Good (VG) category; according to chemistry teachers, all items are feasible to be used as a field trial. After conducting the field trial, the product contained 18 valid items and 2 invalid items with the very reliable category, which was 0.899. At the difficulty level, the product had 11 easy items and 9 medium items. At the level of distinguishing power, the product had 1 very bad item, 2 sufficient items, 9 good items, and 8 very good items. Therefore, the resulting assessment questions instrument can be used to measure students' HOTS knowledge

Assessment Based on Higher Order Thinking Skill on SKI Learning

This research was conducted to know the assessment instrument for SKI subjects at a state Madrasah Aliyah in Jepara; piloted HOTS-based assessment instrument, and the results of the HOTS-based assessment on SKI subjects. This type of field research is quantitative. This research is field research, namely direct observation of the object under study. Collecting data through interviews, observation, and documentation. The approach used in conducting research is empirical. The instruments used in the SKI subject are oral tests, multiple choice, and assignments. Meanwhile, the researchers used multiple choice and essay test instruments to obtain HOTS-based assessment results. Then the researcher tested the feasibility of the questions with expert validity and the validity and reliability of the items. The final total of 4 multiple choice questions and two essays obtained the result. The HOTS-based assessment was applied to SKI subjects even though all KD could not be included. The findings of this study also show the results of the HOTS-based evaluation with 23 students in the high group, 60 students in the medium group, and 13 students in the low group.

Pelatihan Pendampingan Meningkatkan Keterampilan Menyusun Instrumen Penilaian Berbasis Hots Bagi Guru MIPA MTSN 1 Kampar

The purpose of this research is to carry out development training to improve teachers' skills in preparing HOTS-based assessment instruments for teachers of science clumps (MIPA). This type of research is School Action Research (PTS), which was conducted at Madrasah Tsanawiyah Negeri 1 Kampar on Jalan Transad No.7, Lereng Village, Kuok District, Kampar Regency, Riau Province in the even semester of the 2020/2021 academic year for three months starting from February to April 2021. Data collection methods in this study are observation, field notes and questions. The data analysis technique uses comparative descriptive. The subjects of this study were Science and Mathematics teachers with a total of 11 teachers. Consisting of 5 Mathematics teachers and 6 Science teachers. The research action was carried out with procedures based on the principles of Kemmis and Taggart in Ulfatin which included four activities, namely planning, implementation of action, observation, and reflection or evaluation (Prof. Dr. Nurul Ulfatin, 2022). The validation technique was carried out using data triangulation technique. The results of the study obtained an average value of teacher skills in pre-development training activities of 61 points which are classified as quite good, in cycle I activities there was an increase of 11% with an average value of 72 points in the predicate good. And in cycle III there was also an increase of 12% with an average score of 84 points with details of 3 teachers with very good predicates, and 8 teachers had good predicates. So overall the development training actions to improve the skills of MIPA teachers in preparing HOTS-based assessment instruments have met the criteria for achieving success indicators ≥ 80%

PELATIHAN PENYUSUNAN INSTRUMEN PENILAIAN BERBASIS HOTS BAGI GURU DI SDN 09 KAMPUNG MELAYU

A quality learning assessment instrument is a measuring tool to determine student learning outcomes. This HOTS-based assessment instrument preparation training aims to improve the ability of SDN 09 Kampung Melayu teachers in developing HOTS-based assessment instruments. This training activity is urgently needed by teachers due to the low competence of teachers in designing assessment instruments according to curriculum standards. Through this activity the teachers provide insight as well as technical skills in preparing assessment instruments. This training activity is divided into five parts, namely pre-test, exploration, elaboration, confirmation and post-test activities. In the pre-test stage the participants worked on questions related to HOTS-based assessments, in the exploration stage the resource persons conducted brainstorming with participants related to HOTS-based assessments. After brainstorming, the informants carried out elaboration activities, namely explanatory material regarding the preparation of HOTS-based assessment instruments. At the confirmation stage, the training participants were directed to form groups and hold discussions in preparing HOTS-based assessment instruments. The next stage is the group representative showing the results of the discussion in front of the other groups. In the post-test stage the participants worked on questions related to the training material with the result that there was an increase in the post-test score with an increase in value of 59.52% where the average post-test score increased to 74.60 from the pre-test average score 44.40 so that it can be interpreted that the results of this training can significantly increase the knowledge of SDN 09 Kampung Melayu teachers in designing HOTS-based assessment instruments.

LOTS to HOTS: How do mathematics teachers improve students’ higher-order thinking skills in the class?

This study explored how mathematics teachers improve students' thinking skills from low to higher order thinking skills (HOTS) during class. This study used a qualitative descriptive research design. The research subjects involved were mathematics teachers from one of the high schools in Malang City, East Java, Indonesia. Data were collected through a process of initial observation in schools, the results of preparing lesson plans, classroom assessments by teachers, and semi-structured interviews. The results of the research were analyzed using models, namely data reduction, data presentation, and concluding. Data focused on lesson plans based on a scientific approach and HOTS-based assessments: analyzing, evaluating, and creating. The teachers' class assessments were analyzed and classified into the HOTS cognitive level using the Anderson Krathwohls' Taxonomy indicators. The findings of this study indicate that teachers arranged the class with a scientific approach setting and provided HOTS-based class assessments to students to improve students thinking skills. But on the other hand, teachers experienced obstacles, that are students who are still passive when the scientific method was applied and the learning took a lot of time. Another obstacle related to the HOTS-based assessment is that teachers had difficulty when compiling HOTS-based assessment because it required a lot of time and thinking skill. Students also had difficulty in solving HOTS-based questions due to low reading interest and diverse student abilities.

Modeling higher order thinking skills and metacognitive awareness in English reading comprehension among university learners

This study aimed to examine the levels of Pakistani university learners' higher order thinking skills (HOTS) in English reading comprehension and to explore how explicit assessments of HOTS can reveal learners' strengths and weaknesses in reading as compared to the traditional assessment of reading. Secondly, the study analyzed the effect of learners' metacognitive awareness on reading on the relationship between their HOTS levels and reading performance. It used a mixed-method approach. In the quantitative phase, an explicit HOTS-based reading test was designed using Bloom's taxonomy. Using random stratified sampling, it was administered to the learners of Bachelor of Science in English (n = 200). Stratified sampling was performed for investigating the gender gap in HOTS levels. The learners' metacognitive awareness of reading was analyzed using Survey of Reading Strategies. Descriptive analysis, independent sample t-test, correlation analysis, and moderator analysis were conducted. It was found that the learners' HOTS levels correlated with their reading performance where creative skill was the strongest, and evaluating skill was the weakest. Metacognitive awareness of reading positively moderated the relationship between the learners' HOTS levels and reading performance. In the qualitative phase, purposive stratified sampling was applied. A subsample (n = 6) was extracted from the core sample based on the high, average, and low reading performance, and three groups were formed. A semi-structured interview was conducted to know learners' opinions on using HOTS-based assessment in reading and their cognitive and metacognitive abilities. The thematic analysis of the qualitative data revealed that three out of six learners did not approve of the way they were assessed by the university. They informed that they had issues with cognitive and metacognitive control of English texts. The findings revealed that the majority of learners suffered low HOTS levels in English reading. The study offers recommendations for English as a second language (ESL) teachers, assessors, and policymakers to improve learner performance to the possible optimal level, especially in underdeveloped contexts that use traditional reading assessments.

Forming Critical Character With Higher Order Thinking Skill (HOTS) Based Learning Assessment in Islamic Religious Education Subjects

Character formation is one of the goals of education, especially Islamic education. One important character is a critical character. Critical is a character that is commonly owned by students, the formation of this character is seen from the ability of students to analyze various kinds of problems sharply and deeply. The purpose of this study is to reveal that in developing the critical thinking character of students, it is necessary to apply a learning assessment based on High Order Thinking Skills (HOTS). HOTS-based assessment is an assessment based on questions compiled by the teacher to measure the ability of students in the realm of analysis, evaluation, and creativity. The method used in this research is library research method using a descriptive approach. The results of this study are in the form of concepts used in HOTS-based assessments, as well as their implementation in PAI subjects. Not only that, the competence of a PAI teacher in the application of the HOTS-based assessment concept is very influential, so that the HOTS-based assessment is able to form a critical character in students.