Development Of Test Instrument Research Articles

Empirical Analysis of Physics Test Instruments to Measure Graphical Representation Abilities in “Temperature and Heat” Topics

This study focused on developing physics test instruments for senior high school students on the topics of temperature and heat. The study aimed to determine (i) the quality of the test instrument content, (ii) the feasibility of the test instrument, and (iii) students’ graphic representation abilities on “Temperature and Heat” topics. The test instrument development went through three stages, namely test design, testing, and test assembly. The test instrument was tested in the Science Class XII of the Public Senior High School 5 Yogyakarta with a total of 195 students as research subjects. The item analyzes in this study included analysis of model validity, reliability, level of difficulty, and level of students’ ability. The research results showed that the test instrument for the graphical representation of “Temperature and Heat” topics had good content quality but still needed to be improved. The feasibility of the graphic representation test instrument showed that there were seven items that were declared valid and reliable even though the items tested did not conform to the Raschmodel. However, these seven items were still suitable for use on a wide scale to measure graphical representations of “Temperature and Heat” topics. Finally, in the analysis of students’ abilities regarding graphical representation individually, the largest percentage was in the low category, while, overall, the students’ abilities level was classified as medium. Thus, it was necessary to improve question items that involve graphical representation that meet the criteria for good, valid, and reliable question items, and can improve students’ graphic representation abilities.

PENGEMBANGAN INSTRUMEN EVALUASI BERBASIS KEMAMPUAN PEMECAHAN MASALAH PADA MATERI EKSPONEN DI TINGKAT SMA

The purpose of this research is to produce a test instrument to measure mathematical problem-solving ability by looking at the development procedures and the quality of the mathematics problem solving instruments developed. The research used is the type of research (R&D) that is the development of test instruments to measure the ability to solve mathematical problems. The development model of this research instrument is developed on the basis of the Tessmer model which is the formative type of evaluation, i.e. (1) preliminary stage, (2) self evaluation stage, (3) prototyping stage (expert reviews, one-to-one and small group) and (4) field test stage. The test subject of the experiment were X Students of SMAN 2 Bayah which amounted to 25 students. Based on the results of experiments conducted, it is found that: (1) math problem solving test instrument has been said "valid" because based on the CVR results are 1 and meet the criteria of ≥ 0.99 and CVI is 1 with a category perfectly suitable or in the range 0,68-1,00 (2) mathematical problem-solving test instrument is said to be reliable with a value of 0.754 with high category, and is in the range of 0.60 < r11 < 0,80 (3)instrumen test the math problem solving device has a level of difficulty good then the average level of difficulty obtained is 0.58 with the medium category that is in the range of 0.31 to 0.70. (4) instrumen test math problem solving devices has a power a good differentiator and the average distinguishing power obtained is 0.35 with sufficient category or is in the range Dp > 0.2. As a result, the produced instrument is appropriate for assessing pupils' mathematical problem-solving abilities

PENGEMBANGAN INSTRUMEN TES UNTUK KEMAMPUAN BERPIKIR REFLEKTIF MATEMATIS PADA MATERI ALJABAR

This research aims to produce a test instrument for students' mathematical reflective thinking ability on algebraic material. This research used the Research and Development (R&D) method with the ADDIE model (Analysis, Design, Development, Implementation, Evaluation). The subjects used were 35 seventh grade students in one of the private junior high schools in Tangerang City. Based on the results of the material expert validation received an average score of 87.7% with very valid criteria. The validity of the items received an average of 0.82 very valid criteria. Then it has a Chronbach's Alpha value of 0.945 which means reliable. In addition, the level of difficulty of moderate questions is 3 questions, difficult 1 question and easy 1 question. The results of the student response questionnaire after working on the test instrument obtained a score of 78% with good criteria. Then based on these results, the development of test instruments for students' mathematical reflective thinking skills is valid, reliable and worthy of use

Development of Test Instruments Utilizing Multiple Representations for Enhancing Understanding of Motion Kinematics

Problem-solving in physics remains low due to the limited use of varied or multi-representation test instruments. This study aims to develop a multi-representation-based test instrument on kinematic motion and describe the results of the logical validity and empirical trials of the developed multi-representation-based test instrument for kinematic motion. This research follows a Research and Development (R&D) approach, using stages synthesized from various expert opinions, ranging from needs analysis to test assembly. The research instrument consists of a multi-representation-based test consisting of 30 questions. The data were analyzed using ANATES after being reviewed by three experts. The results indicate that 30 test items were successfully developed, with an average logical validity score of 0.63, demonstrating that the test instrument is valid and feasible for use. Based on statistical analysis, including item validity, difficulty level, discrimination index, and reliability, the empirical validity results show that 11 test items are suitable for use.

Development of test instruments to measure problem-solving and science literacy of grade XI students on ion equilibrium material in salt hydrolysis

Low science literacy in students will have an impact on students' ability to solve problems. To improve it, it is necessary to develop an assessment instrument in the form of a science literacy instrument. This study aims to develop valid, reliable problem solving and science literacy assessment instruments for students. The material chosen is ion equilibrium in salt solution. The research was conducted in high, medium and low ability schools namely SMA Negeri 1 Pekanbaru, SMA Negeri 12 Pekanbaru and SMA Negeri 15 Pekanbaru. There are 16 questions out of 20 questions that are constructively valid with a correlation value> 0.36. The questions developed have met the reliability requirements with a Cronbach alpha coefficient value greater than 0.6, reaching a value of 0.874. The level of difficulty of questions between 0.3 -0.7 is in the good enough category and differentiating power ≥ 0.3. Based on two trials, namely one-on-one trials and limited trials, the same results were obtained that the assessment instruments developed for students had very good readability aspects (85%), good adequacy aspects (64%) and assessment instruments developed for teachers had very good feasibility aspects (91%). There is a significant difference in the ability of students in high schools with medium and low ability schools.

Training and Mentoring in the Development of Test Instruments for Measuring Learning Outcomes of Muhammadiyah School

This community service learning program is collaboration between the Curriculum and Educational Technology Department of the Faculty of Education Sciences. A key issue facing most SMA and SMK Muhammadiyah school teachers is their lack of knowledge and understanding on how to develop valid and reliable test instruments. This research aims to enhance the knowledge of SMA and SMK Muhammadiyah teachers in developing learning assessment instruments. The Blended Learning method was applied for 32 hours of lessons that involved lectures, Q&A discussions, assignments, practical work, and tests. A total of 12 teachers from SMA and SMK Muhammadiyah schools took part in the program. The research method used was the One-Group Pretest-Posttest Design, which is a type of pre-experimental research design. Data drawn from the pretest and posttest results were analyzed using the t-test. Following the smooth implementation of training and mentoring, a key conclusion is that the community service learning program has successfully met its expected outcome of enhancing the teachers’ ability to develop test instruments. This is evidenced by a significant increase in posttest scores compared to pretest results at Sig. (2-tailed) = 0.001 < 0.05.

Development of Test Instruments Based on Cognitive Processes and Knowledge Dimensions on Environmental Chemistry

This research aims to develop an instrument that can measure the achievement of student learning outcomes in chemistry education in Environmental Chemistry courses, which refers to Bloom's Taxonomy, which has been revised along with the dimensions of knowledge from Anderson & Krathwohl. The research method used in this research is research and development with 4 (four) stages of research 1) define; 2) design; 3) develop; and 4) dissemination. The validation of this instrument was carried out by two experts in the field of chemistry and tested on 20 students. The instrument used is in the form of a description that takes the cognitive domains C1 to C3. In addition, in the instrument there are also 4 (four) dimensions of knowledge tested, namely factual, conceptual, procedural, and metacognitive. Based on the results of expert validation, it was found that in content there were no problems only in the use of verbs in the instrument requiring more operational verbs and based on the test results it was found that all the questions given showed that 30.15% of the questions were categorized as easy, 44, 80% were categorized as moderate and 25.05% were categorized as difficult. This study shows that the knowledge dimension in Bloom's taxonomy needs to be applied by considering the knowledge dimension to develop thinking skills in students.

Pengembangan Instrumen Tes Tipe Higher Order Thinking Skills (HOTS) Pokok Bahasan Bangun Ruang Sisi Datar

This study aims to determine the process and analyze the quality of the HOTS-type test instrument development on flat side space and measure students' higher-order thinking skills. This type of research is research and development with the Formative Research (Tessmeer) model. The test subjects in this study were class XI.3 students at SMP Negeri 30 Makassar, totaling 30 students. Based on the research results, it is known that 1) the development process using the Formative Research (Tessmeer) model through 4 stages, namely the preliminary stage, the self-evaluation stage, the prototyping stage, and the field test stage. 2) the quality of test development is declared valid with a CVR (Content Validity Index) value, the average total score is 1 with a very appropriate category or is in the interval 0.68-1.00, practically based on the results of the questionnaire analysis of student responses 89.07% with the response category "Very Positive”, reliable with an average of 0.752 and 0.866 in the high category (reliable), the average difficulty level of the total score is 0.69 and 0.49 in the medium category, and the different power of the average total score is 0.42 and 0.49 in the good category. 3) students' critical thinking ability averaged 67.61, which was in the good category. Thus, this HOTS-type test instrument can be used to measure students' high-order thinking skills.

Development Of Test Instruments to Improve Students' Multirepresentational Ability

The aim of this research is to determine the feasibility of a physics test instrument to measure high school students' multiple representation abilities in rectilinear motion material and to determine the characteristics of respondents' multirepresentation abilities in rectilinear motion material. The development of this instrument was carried out using a modified development method of the Wilson, Oriondo, and Antonio. Students' multiple representation abilities were analyzed with the help of Quest which was then analyzed further using descriptive statistics. The results of this research are in the form of a test instrument to measure high school students' multi-representation abilities in rectilinear motion material consisting of 20 two-tier multiple choice questions. The items in the questions are valid, fit the PCM 1 PL model, have very good reliability with a score of 0.84, and have a good level of difficulty. The results of item analysis and analysis of students' abilities show that the instrument developed is effective in measuring high school students' multi-representational abilities in rectilinear motion material.

Development of a Test Instrument for Students' Mathematics Learning Outcomes Oriented to Hots

Higher order thinking skills (HOTS) are high-level thinking abilities that involve more complex thinking processes in analyzing arguments, identifying, evaluating and developing critical, creative and analytical thinking skills. The development of test instruments for student learning outcomes can be seen from the level of difficulty of the questions as well as the validity and reliability of the test. A lesson is said to be successful if students master a concept, because the concept that has been understood will stick in the students' memory for a long period of time. Given the importance of mathematics, students are expected to discover and understand mathematical concepts. In mastering mathematical concepts, students must have high-level thinking skills. One way to find out whether students already have these skills is by conducting an assessment. Many studies show that students in Indonesia have low HOTS abilities compared to other countries.

Development of Test Instruments Based on Problem Solving at The High School Level

Development of Test Instruments Based on Problem Solving at The High School Level

Development of Test Instruments to Test Students' Understanding of Macroscopic, Sub-Microscopic and Symbolic Levels in Acid-Base Titration Material Using the Rasch Model

This study created a test instrument that can test students' understanding of the macroscopic, sub-microscopic and symbolic levels in acid-base titration material that has been tested for validity, reliability, difficulty index and differential power of the questions . This development research uses the Rasch model. The subjects of this study were four lecturers, two high school chemistry teachers and 35 students of SMA N 2 Padang. The object is the quality of the test instrument that meets the criteria of validity, reliability, difficulty index and discriminatory power . Data analysis used the MiniFac and Ministep programs. This study has 10 stages, namely: (1) Defining the construct, (2) Identifying the construct, (3) Designing the items, (4) Testing the product, (5) Analyzing the data, (6) Reviewing the results of the analysis, (7) Reviewing the map wright, (8) Repeat steps 4-7, (9) Claim product quality, (10) Develop documentation. The results showed that the suitability of validation by experts using the MiniFac program was the exact agreement and expected agreement values were very close, namely 95.8% and 95.4%, this indicated that the results of this analysis fit the model and its estimation. Likewise testing of students using the Ministep program. Each item can be said to be valid because it meets the criteria of the MNSQ, ZSTD and PtMean Corr. The instrument is also claimed to be reliable because it has a value of 0.92 . The difficulty index and discriminating power of the items also varied from the easiest to the most difficult.

Development of Test Instrument to Assess Students' Understanding on Macroscopic, Sub-Microscopic, and Symbolic Levels of Acid-Base Topics Using Rasch Model

Students' conceptual understanding on acid-base topic has not been assessed comprehensively in multiple representation. The test instrument is needed to determine levels of students' understanding on acid-base topic comprehensively. This research developed an instrument to asses students' understanding on acid-base concept based on macroscopic, sub-microscopic and symbolic levels that is claimed valid, reliable, had good difficulty index and discriminatory item. This research is Research and Development (R&D) using Rasch model. The research procedure adopted ten stages by Wei, et al in 2012. The research instrument is questionnaire sheet given to subjects from chemistry lecturers and chemistry teacher. The data were analyzed using Rasch model assisted by minifacet and ministep software. The exact agreement value is 89,2% which have small range from the expect agreement with a percentage of 89,5%. It’s mean that, there is a fit between the results of expert's agreement and the results of estimated model. The pilot test results showed that all items have reached valid criteria based on the MNSQ, ZSTD, and Pt-Mean Corr. The reliability value is 0,80 in the good category. Difficulty index has variations of easy, medium, and difficult items. The discriminatory item is able to distinguish three levels of student ability.

Validity and Reliability of Higher Order Thinking Test Instrument Development Skills: systematic literature reviews

Higher Order Thinking Skill (HOTS) is the ability to think that does not simply recall, restate, or refer without reciting. HOTS questions in the context of assessment measure the ability to transfer one concept to another, process and apply information, find links from various information, use the information to solve problems, and critically examine ideas and information. In this study, 17 articles were used, which included 14 national articles and 3 international articles. The seventeen articles discussed the development of the Higher Order Thinking Skill Test Instrument Development instrument. The test instrument developed contains Higher Order Thinking Skills. Based on the results of the meta-analysis research, it can be concluded that the validity value of the seventeen journals is 1.85 with a high category. The reliability value is 0.615 to 0.94 with a high category. Development based on the level of study is still piled up at the junior and senior high school levels

Development of Test Instruments in Substance Pressure to Measure Student's Numerical Literacy Ability

The purpose of this study was to develop an instrument test to measure student's numeracy literacy skills on substance pressure and its application. The research was conducted using the Research and Development (RD) development method trough the ADDIE research design (Analysis, Design, Development, Implementation, and Evaluation) through several stages, namely curriculum analysis, content analysis, context analysis, and determining instrument framework, instrument development, pilot testing instrument and item analysis of the instrument. The trial was conducted on a sample determined by a random sampling technique. The item analysis of the instrument includes item validity test, item reliability test, item difficulty level, and item discriminatory power. The results of this study were the test instrument of numeracy literacy in the form of multiple-choice questions with 18 reliable questions with a reliability coefficient of 0.903. Based on the validity test, there are 5 questions with moderate validity category, 10 questions with high validity category, and 3 questions with very high validity category. Based on the results of the discriminatory power test and the level of difficulty of the questions, it was obtained that all questions had distinguishing power in the good category with the difficulty level of the questions in the easy, medium, and difficult category are 1, 13, and 4 questions, respectively. Therefore, it can be concluded that the numerical literacy test instrument on the substance pressure material and its application can be used as a test instrument to measure student's numeracy literacy skills.

Web-Based Design of BIPA Placement Test Instrument for Foreign Speakers

This study aimed to develop a web-based Indonesian-language placement test instrument for foreign speakers, commonly called BIPA (Bahasa Indonesia bagi Penutur Asing). The research method involved design-based research (DBR) with test instrument development procedures developed by the Association of Language Testers in Europe. The results show that 89% of respondents strongly agreed that the development of a BIPA placement test instrument was very much needed in BIPA learning. To triangulate the data from the interviews and questionnaire, a bibliometric analysis was performed. From the results of the bibliometric analysis, 117 studies were found on foreign-language placement tests in the 2012–2022 range and there was no research on the development of BIPA placement test instruments. The BIPA placement test is designed to measure the level of Indonesian-language skills of foreign speakers, which include listening, reading, writing, and speaking skills. This test can be used by teachers/institutions to determine the level of Indonesian-language skills of foreign speakers, starting from levels A 1, A-2, and B-1. This test is also useful for authorized institutions to provide Indonesian-language certification to foreign speakers who need it. Further research can be done with the development of BIPA test instruments for intermediate and advanced levels.

Create multiple-choice tests based on experimental activities to assess students' 21st century skills in the heat and heat transfer topic

Currently, we are facing the rapid development of information and communication technology (ICT) that characterizes the 21st century. Challenges, problems, life, and careers in the 21st century can be successfully faced if we master 21st-century skills. However, nowadays it is still very rare to develop a 21st century skill measurement model, so it is necessary to develop test instruments to measure 21st century skills. The development of test instruments to measure 21st-century skills in Indonesia is still very open, with attention being paid to the clarity of the instrument in describing real phenomena and complete data as material for problem solving. Based on the description above, the researchers developed a multiple-choice test based on experimental activities to measure students’ 21st century skills, which are creativity, critical thinking, collaboration, and communication (4Cs) in heat and heat transfer using research and development (RD) methods with the analyze, design, develop, implement, and evaluate (ADDIE) stage. Development begins with conducting literature and field studies, designing and making videos of experiment activities, compiling open-ended questions, distributing them to 12th graders of science, analyzing answers based on references, developing answer options, developing multiple-choice tests, conducting validation by experts, and testing limited to students. The product of this research is expected to be used by educators and students for independent learning activities or as an example to develop multiple choice tests based on experimental activities to measure 21st century skills in other physics materials and other subjects.

How is The Implementation of Diagnostic Tests in Biology Learning in South Sumatra?

Diagnostic tests have a very important role to provide information about the strengths and weaknesses of students related to a concept to be studied. This study aims to obtain an overview of the implementation of diagnostic tests carried out by Biology teachers in South Sumatra Province using the survey method. This study involved 86 Biology teachers in South Sumatra Province. Samples were taken using the convenience sampling method. Data collection by using e-questionnaire distributed through Google Form. The e-questionnaire consists of 25 questions developed from standard indicators of assessment, including planning, method selection, test instrument development, test implementation, test result management, test results reporting and the implications of these test results in the biology learning process in schools. The results of this study indicate that Biology teachers in South Sumatra have carried out routine diagnostic tests. The development of this diagnostic test instrument has also referred to the learning objectives and the results of the diagnostic test have been used to determine the methods, strategies, and approaches used in the learning process. Although in general the implementation of diagnostic tests in Biology learning is good, but the implementation and management of diagnostic tests that are very close to the learning process is feared will not have a significant effect on the implementation of the learning process in schools.

Development of Test Instruments to Measure Middle School Students' Creative Thinking Ability

The development of creative thinking skills really needs to be done because this ability is one of the abilities that the world of work wants. Mathematics learning needs to be designed so that it has the potential to develop students' creative thinking. The observation results show that teachers still pay little attention to students' creative thinking skills. Creative thinking ability tests have been compiled and validated by the validator. Based on the identification and definition of the problem that has been simplified, the formulation of the problem in this study can be formulated, namely how is the test instrument for measuring the creative thinking abilities of junior high school students. The purpose of this study was to develop a test instrument that measures the creative thinking abilities of junior high school students. Based on the data obtained, the average validation result by experts is 3.36. and 84%. So, it can be concluded that the development of a test instrument to measure creative thinking skills is feasible to use

Cognitive Analysis Using Rasch Modeling As an Assessment for Physical Fitness Knowledge for College Students

Having good physical fitness is the foundation for carrying out daily activities. Maintaining physical fitness requires knowledge and understanding for performing meaningful physical activities. This study aimed to analyze the physical fitness knowledge test instrument for college students using the Rasch modelling data analysis technique. The design, development, and research method employed the product model and research tool that consisted of four stages, including analysis, design, development, and evaluation. The samples involved in the instrument trial were 67 students from one university in Indonesia. The analysis used was the content validity ratio for testing content validity and the item response theory/Rasch model test employing Winstep software to determine the validity and reliability of the test instrument. The results of the data analysis showed a match between the students and the test instruments with very good quality items. It concludes that the test instrument development using the Rasch model can detect student misconceptions on physical fitness knowledge material.