Development Of Assessment Instrument Research Articles

A Brief Survey on Employing Machine Learning to Assess Risk Elements and Predict Lifespan in Heart Failure Patients

Heart failure continues to be a major global Wellness challenge due to its increased mortality rate and substantial financial consequences. In response to this urgent issue, the research paper investigates the methodologies, specifically the Survival Neural Network (Survival NN) and the Cox Proportional Hazards (Cox PH) model, to scrutinize risk factors along with predicting the life expectancy of individuals with heart failure. By applying strict feature selection and engineering approaches, we determine the most critical criteria that impact the prognosis of heart failure and pave the way for the creation of a comprehensive risk assessment framework. The Cox Proportional Hazards model facilitates the development of a trustworthy risk assessment instrument that takes the time-to-event component of heart failure outcomes into account. Furthermore, predictive abilities are enhanced by the Survival Neural Network (Survival NN) model integration by recognizing intricate, nonlinear patterns in the dataset. Combining the Survival Neural Network (Survival NN) with the Cox Proportional Hazards model allows for the development of real-time alerting and monitoring systems, which may reduce hospital readmission and mortality rates and help medical professionals make well-informed decisions. Our goal is to transform the way heart failure is treated, which will enhance patient care and the efficiency of the healthcare system.

The Validity and Reliability of Developing Assessment Instruments for Students in Electrical Installation and Maintenance Work: Concentration on Psychomotor Skills Assessment

Electrical installation and maintenance work is one of the trades in the curriculum of technical colleges. For the proper installation of electrical appliances, pupils are expected to develop psychomotor skills. Only the cognitive component of electrical installation work is evaluated by the NAtional Business and Technical Examination Board (NABTEB). According to the study, even though students graduate with good GPAs, they lack psychomotor abilities. Therefore, using flawed and unreliable instruments results in inaccurate assessments of pupils' improvement of psychomotor skills. Therefore, the study established the practical tasks in electrical installation and maintenance work to be completed by the students, validated the developed process assessment instrument in electrical installation and maintenance work, and also proved the reliability of the progressed process evaluation instrument in electrical installation and maintenance work. The developed instrument has provided a readily available process assessment instrument of high quality for the study. The following actions were advised for adoption by the study:1. For the purpose of certifying students, the external examination boards (NABTEB, NECO, and WAEC) should incorporate electrical installation and maintenance work skill assessment instrument items into their examinations.2. To train teachers of electrical installation and maintenance work how to apply the established electrical installation and maintenance work skill assessment instrument, the government should host seminars and workshops. 3. Technical education evaluators should examine their curricula, organize the material into pertinent activities, and create exams like to them in their particular subject areas using electrical installation and maintenance work skill evaluation instruments. 4. To evaluate students in electrical installation and maintenance work that is related to construction, teachers of electrical installation and maintenance work should be encouraged to use the created electrical installation and maintenance work skill evaluation instrument.

Developing English for Tourism Learning Model Based on Hypermedia

The development of the global tourism industry rapidly makes the importance of English communication skill at tourism workplace. State Polytechnic of Lampung has provided English subjects 1, 2, and 3 for students. Unfortunately, the implementation has not given any significant contribution to improve students’ English communication skills especially English for tourism. English instructional materials did not fulfill students’ needs and stakeholders’ needs and standard English competences in tourism workplace. The limitation of learning source become a learning problem for students due to limitation of time to practice English out site of classroom without teacher’s guidance. Therefore, it is important to develop a kind of learning model which independence resource that gives a solution to solve the learning problems. Developing model of English learning for tourism based on hypermedia was intended to give an alternative independence learning resource to improve competences in English for Tourism based on hypermedia. The developing of English learning model base on hypermedia applied research and development (R&D) model used a combination of Dick and Carrey model, Hannafin peck Model and Allen model. There were three stages in developing model of English for tourism based on hypermedia. The first step was conducting needs analysis; identifying instructional goals, conducting instructional analysis, and analyzing learners and contexts. The second step was designing material for learning based on hypermedia that was electronic module; writing instructional objectives, developing assessment instruments, and developing learning strategies. The third steps were developing learning material and implementation; developing and selecting instructional materials, implementing and conducting formative evaluation and revision. The results of the formative evaluation from subject matter experts (instructional, media and English for tourism), one to one evaluation, showed that model of English learning for tourism based on hypermedia generally was categorized very good (average score: 89,31). One to one evaluation by three learners was also and small group evaluation by eight learners which evaluated on clarity, impact on learners and feasibility showed that design model of English learning for tourism based on hypermedia was categorized very good. Field trial that was conducted to 37 students indicated that model design of English learning based on hypermedia for tourism was good and suitable with learning objective, easy to use and understand, demonstrate learning experiences, sufficient for English materials, useful, assessment measure learning outcome, feedback, interesting and engaging learning, motivating, and collaboration between students. The t-test paired sample test showed that design of English for tourism was effective to be used as learning resources with average pretest score was 58,05 and average post test score was 70,92 with gain score was 12,86, while the significant (2-tailed) was 0,000 < 0,05.

Development of Tolerance and Peace Loving Character Assessment Instrument for Vocational High School Students

This study aims to describe the tolerance and peace-loving character assessment instruments for vocational high school students. This research uses the Research & Development (R&D) method using the Borg and Gall method which has been adapted by Sugiyono. However, this study only used seven stages, namely: potentials and problems, data collection, product design, design validation, design revision, product testing, product revision. Instrument validity analysis was assisted with the help of Microsoft Excel. Reliability test using Alpha Cronbach formula. Based on the analysis, it is known that the reliability test results for the tolerance character instrument are 0.88 which indicates that the instrument used is reliable, as well as the peace-loving character assessment instrument. So it is recommended for teachers to use a peace-loving character assessment instrument for vocational high school students.

Instrument Analysis of Biology Teachers' Needs to Assess Students' Creative Thinking Skills Using RASCH Model

This study aimed to investigate the validity, reliability, scale understanding, item difficulties, and bias items of the instrument for analyzing the needs of biology teachers regarding the assessment of creative thinking skills using the RASCH model. The instrument was modified based on the indicators of divergent and convergent thinking processes in the scientific learning stages integrated with the dimensions of creative thinking skills by using ADDIE research model. The research participants comprised of 104 participants from the Solo Raya area, those of whom were 64 Senior High School Biology teachers and 40 Junior High School Science teachers. The research instrument used inventory with a Likert scale of 1 to 4. The instrument validity, reliability, scale understanding, item difficulties, and bias items were analyzed by applying the RASCH model using Winstep 3.73. The research results showed that the overall validity was acceptable, and the item validity did not need improvement. Overall reliability was very good, and the item reliability was excellent. Rating scale analysis showed respondents had understood the Linkert scale of 1 to 4 well. Based on the item difficulties results of the teachers' responses, it was found that there had not been any teachers who evaluated the indicators of creative thinking skills by using writings or pictures in problem-solving assessment. The bias test results on the instrument items indicated that five items could potentially be biased due to age difference, and the two others were due to gender type. Therefore, the development of assessment instruments for creative thinking skills with scientific and social problem-solving based assignments, as well as writing and visual expressions, is required.

Development of Higher Order Thinking Skills (HOTS) Assessment Instruments to Improve Students' Mathematical Creative Thinking Skills

The purpose of learning in the millennial era is the development and improvement of students' high-level thinking skills. High-level abilities or often referred to as higher order thingking skills (HOTS) are the level of thinking of students with stages of analysis, evaluation and creation. The indicators of HOTS can be derived from the ability to think critically and think creatively. In order for students' mathematical HOTS abilities to be known, a HOTS assessment instrument is needed. The purpose of this study is the development of a mathematical HOTS assessment instrument for MTs class VII students. The type of research is a development adapted from the development of Borg and Gall. Analysis of research data using quantitative and quality analysis to determine the quality of the mathematical HOTS assessment instrument conducted a review based on the criteria of validity, reliability, difficulty index and differentiating power of the problem. The result of this development is that the HOTS assessment instrument with the form of a description of 15 questions and is suitable for use. The HOTS assessment instrument is included in a valid category that is based on expert assessment with an average score of 36.5 and an excellent category. The difficulty level of the question is moderate with an average difficulty index of 0.5 in the medium category and the differentiating power of the question is good with an average differentiating power index of 0.33 in the good category. The developed mathematical HOTS instrument also meets the reliable criteria with a reliability coefficient of 0.733.

Development of the health literacy assessment instrument for chronic pain patients: A Delphi study.

To develop health literacy assessment instrument for patients with chronic pain. Qualitative methods based on Delphi technique, assessed against the CREDES checklist. A 2-round Delphi method was adopted in this study. The panel consisted of 19 experts. The health literacy assessment instrument for chronic pain patients was constructed, which contained 3 dimensions (functional health literacy, interactive health literacy and critical health literacy) and 41 items. The positive coefficients of two rounds Delphi were 100.00% and 89.5%, respectively. The authority coefficient of experts was 0.848 and 0.858, respectively. The coordination coefficients of dimension and items were 0.222 and 0.364, respectively. The health literacy assessment instrument dimensions and items for patients with chronic pain based on a Delphi method are valid. This instrument is suitable for investigating the health literacy level of patients with chronic pain.

Development of Assessment Instrument for Steam-Based Thematic Learning to Measure the Critical and Creative Thinking Skills of Students in Elementary Schools

Development of Assessment Instrument for Steam-Based Thematic Learning to Measure the Critical and Creative Thinking Skills of Students in Elementary Schools

KEPUASAN GURU SMA DESA BOBOJONG TERHADAP PELATIHAN PENGEMBANGAN INSTRUMEN PENILAIAN AUTENTIK UNTUK MENINGKATKAN PROFESIONALISME GURU

This service is carried out on the basis of the lack of understanding of educators in making assessment instruments. As well as the many inability of educators in compiling appropriate assessment assessments for their students. This service is a mentoring activity to increase the professionalism of high school teachers in developing authentic assessment instruments that aim to improve the ability of teachers to make assessment instruments. This service partner is a high school (SMA) located in Bobojong Village, Mande District, Cianjur Regency, West Java. With a focus on activities, namely assisting the development of assessment instruments for high school teachers. The methods used in this activity include lectures, discussions, direct demonstrations, questions and answers, and assignments. These methods are carried out by adjusting the situation and conditions in the classroom. The target to be achieved in the implementation of this activity is to improve the ability of high school teachers in Bobojong Village, Mande District, Cianjur Regency, West Java. in compiling the assessment instrument. In addition, as an outcome, coaching participants are expected to be able to use good assessments when administering education to evaluate the quality of program achievements. We use 2 stages of Kirkpatrick's evaluation, namely reaction and learning. The reaction evaluation is to determine the participants' reactions to the implementation of the training, while the learning evaluation is to measure the abilities obtained before and after the training.

Development and Validation of Assessment Instrument for School Students in Prison in Malaysia

The purpose of this study was to develop and validate an instrument to assess the occurrence of students in schools in prisons in Malaysia. Based on the literature review and sharing sessions with experienced teachers who teach in prison schools, the researcher identified constructs and items that contribute to the measurement of student achievement. Validity and reliability have been done on the constructed items. The content validity of this instrument involved 8 experts in various fields. A total of 432 students were involved in this study. As a result, a newly developed instrument consists of 4 constructs of student development which are attitude, achievement motivation, morals and academic self-efficacy. Exploratory factor analysis was conducted to obtain construct validity using SPSS software. The factor loading of each item is in the range of 0.669 to 0.805 and the reliability value (alpha) is in the range of 0.78 to 0.83. The total number of items built based on the construct is 55 items. The findings of this study clearly show that this instrument has high validity and reliability and can be used to assess the performance of students in schools in prisons in Malaysia.

Reconstruction and Development of Indonesian Language PAT Question Items Aspects of Class VII Literary Expression MTs N 1 Banjarnegara Academic Year 2021/2022

Assessment in the 2013 curriculum is seen as having more complexity than the assessment system in the previous curriculum. So that in this study will discuss "Reconstruction and Development of Instruments for Assessment of Indonesian Language Learning Outcomes Aspects of Literary Expression for Class VII Students of MTs 1 Banjarnegara for the 2021/2022 Academic Year" as an effort to reduce errors in making assessment questions about aspects of literary expression and present a form of improvement for errors that have been conducted. The approach in this research is a qualitative approach. The type of research used is content analysis research. Data analysis refers to the rules for writing questions contained in the 2013 Curriculum Assessment Guide issued by the Ministry of Education and Culture with due regard to material, construction, and language/cultural aspects. The results showed that there were still 2 Indonesian Year End Assessment (PAT) questions for class VII MTs 1 Banjarnegara for the 2021/2022 academic year in terms of literary expression which did not meet good quality standards.

Pengembangan Instrumen Penilaian Hasil Belajar Yang Mendukung Asesmen Kompetensi Minimum (AKM) bagi Guru Matematika SMP

DEVELOPMENT OF LEARNİNG OUTCOMES ASSESSMENT INSTRUMENTS THAT SUPPORT AKM (ASESMEN KOMPETENSI MINIMUM) FOR MİDDLE SCHOOL MATHEMATİCS TEACHERS. The cancellation of the implementation of the UN was realized due to the Covid-19 pandemic that hit in 2020, so it was not possible to carry out the UN with various considerations. Over time, preparations were made to strengthen the AKM and character surveys. The process of developing assessment instruments for junior high school teachers is carried out in a continuous training setting accompanied by experts from universities. Through this service activity for junior high school mathematics teachers, it is possible to collaborate among teachers in various educational units or to develop joint programs for the common good; For example, in professional development. Training and mentoring activities in the development of electronic-based learning outcomes assessment instruments that support AKM have been carried out very well. This is indicated by the results of the response questionnaire of 85% which exceeds the indicators of the success of training and service activities.

Different Typologies of Gamers Are Associated with Mental Health: Are Students DOOMed?

(1) Background: The inclusion of Internet Gaming Disorder in the Diagnostic and Statistical Manual for Mental Disorders (DSM-5) led to a rapid development of assessment instruments based on the suggested diagnosis. However, previous studies suggest that some of the symptoms in the diagnosis reflect engagement in gaming rather than a disorder or addiction. The aim of the present cross-sectional study was to investigate mental health associations with different typologies of gamers. (2) Methods: Data stemmed from a large national survey of students (SHoT2022) that was conducted between February and April 2022 (N = 59,544). Participants were categorized into non-gamers, recreational gamers, engaged gamers, problematic gamers, and addicted gamers. Logistic regression models adjusted for age were analyzed with and without gender-stratification for mental distress and life satisfaction as dependent variables across gaming categories. (3) Results: The proportion reporting case-level mental distress was lower for recreational gamers compared to non-gamers, indicating fewer mental health problems for recreational gamers. However, after stratifying the analysis by gender, female recreational gamers had higher levels of mental distress compared to female non-gamers, reflecting Simpson's paradox. (4) Conclusions: Future studies investigating mental health and gaming should include a gender perspective.

Pengembangan Instrumen Penilaian untuk Mengukur Critical Thinking Skill Materi Relasi dan Fungsi

The development of critical thinking skills assessment instruments for students of class VIII MTs on the subject of relations and functions as well as describing the quality of the instrument (validity, reliability, level of difficulty, discriminatory power) are the main objectives of this research. The development model refers to Tessmer's formative research with stages: (1) preliminary, (2) self-evaluation, (3) prototyping (expert reviews one-to-one, and small group), and (4) field test. The grid, performance test questions and critical thinking skills descriptions, as well as assessment rubrics are assessment instruments developed with characteristics that refer to the critical thinking skill indicators according to Facione (interpretation, analysis, evaluation and inference). The results showed: (a) the performance test and the description test had high validity; (b) the reliability category of the performance test and description test items is good; (c) Question number 1 on the performance test and description has an easy level of difficulty and item number 2 has a moderate level of difficulty; (d) The distinguishing power of item number 1 on the performance test and description is in the satisfactory category and item number 2 is in the very satisfactory category. The results of the study indicate that the category of research instruments developed for relation and function material has a quality that is feasible to use Keywords: Development, Assessment Instrument, Critical Thinking Skill

Pengembangan Modul Pembelajaran Aljabar Linear menggunakan Software Matrix Laboratory (Matlab) di Prodi Tadris Matematika

This research aims to produce a Linear Algebra learning module with MATLAB Software in the Tadris Mathematics Study Program that can be used practically and effectively. This research is development research based on the stages of Dick & Carey. The stages of research carried out in the development of this module are: Needs Analysis, Instructional Analysis, Context Analysis (students and content), The stage of writing performance objectives, Developing assessment instruments, Choosing learning strategies, Developing teaching materials, Designing and conducting formative evaluations, Revising, and The stage of designing and conducting a summative evaluation. The result of the research is that there are significant differences in learning outcomes in the pretest and posttest scores, which means an increase in test scores after using the linear algebra learning module with MATLAB software.

Critical sociology in the development of HOTS-oriented cognitive assessment instruments

The current curriculum focuses on three domains, one of which is cognitive. Cognitive abilities are very important for the development of individual competencies so that instruments to measure them must be carried out. High quality cognitive instruments are needed in the assessment. Assessment with High Order Thinking Skills (HOTS) orientation as an effort to implement 6c, namely communication, collaboration, critical thinking, creative thinking, also computational logic and concern by developing cognitive instruments in Sociology scientific assessment. The method used is Research and Development which is focused on development. Cognitive instruments were compiled and carried out content validity from 4 experts for Sociology, Education and Law which were then tested on 93 students through a questionnaire in the form of google form. Analysis of the data used is by using software iteman 4.3. The results of this study are cognitive instruments with 15 HOTS questions in the form of multiple choice using content validity with Aiken's count obtained a score of 0.75 to 0.9375 so it is included in the medium and high categories. The instrument has an Alpha score of 0.558 so it is included in the reliable category. For items that have a difficulty level of 0.637, it means that the difficulty of the questions is moderate and the positive discriminatory power with a number of 0.243 is in the medium category. Then the distractor on the answer choices in the question items can function well because most of them are 0.05.

Development of responsibility attitude competency assessment instruments for vocational high school students

This study aims to obtain a standardised responsibility attitude competency assessment instrument to measure the value of responsibility attitude competencies of students of SMK Negeri 8 Purworejo and to determine the results of the implementation of responsibility attitude competencies in students of SMK Negeri 8 Purworejo Central Java as measured by the assessment instrument developed so that the level of responsibility attitude value of SMK Negeri 8 Purworejo students can be known. This research is development research. The development stages were carried out with expert judgment validation, first revision, readability test, second revision, content validity test, construct validity test, third revision, final assessment instrument, and implementation of the final assessment instrument. The content validity test used the Aiken index. Reliability was tested with Cronbach Alpha formulation. Construct validity test used factor analysis. After preparing the assessment model and the pilot test, it was concluded that an assessment instrument was obtained to measure the attitude of responsibility as many as 50 items, consisting of 25 valence (attitude) items and 25 factual (behaviour) items. Second, the indicators of the attitude of responsibility assessment instrument are (a) Carrying out individuals well, (b) Accepting the risks of actions taken, (c) Doing tasks according to procedures, (d) Returning borrowed items, and (e) Doing group works together. Third, it measured the attitude of responsibility of 72 students of SMK Negeri 8 Purworejo with the measurement results in the Very High category.

Literatur Review Pengembangan Instrumen Asesmen Pemahaman Konseptual Pada Pembelajaran Sains

Conceptual understanding competence is something that every student must have. The concept understanding assessment instrument is something that cannot be separated in the achievement of students' conceptual understanding competence. Assessment is one of the measuring tools in the process of developing students' conceptual understanding. This research is literature review research on the development of conceptual understanding assessment instruments in science learning. There are 30 journals obtained from Google Scholar related to this research from 2014 to 2022. The results of this study show that first, based on the study of research objectives, it was found that the purpose of developing instruments was carried out at most, secondly, in terms of research design, the use of quantitative descriptive designs had the greatest frequency, Third, in terms of education level, most of this research was conducted at the SMA/MA/SMK level, fourth in terms of subjects that used concept understanding assessment instruments, most were obtained in physics subjects, and lastly, in terms of the type of instrument used, it was found that the rubric/ the most widely used concept understanding questionnaire. The lowest aspects of this research study can be recommended for other researchers for further research.Keywords: assessment, conceptual understanding, science

An Empirical Study on the Usage of Assessment Instrument in Empowering Creative Thinking Skill

This study aimed to determine how the analysis of assessment instruments is based on creative thinking skills. The objects in this study were 6 educators and 20 students of grade V elementary school at MI Muhammadiyah Banjarsari Metro. A qualitative method was applied, with research instruments such as observation and structured interviews. The data analysis method employed was descriptive qualitative. According to the findings of this preliminary study, the creative thinking ability of fifth-grade elementary school students at MI Muhammadiyah Banjarsari Metro is still relatively low, particularly in creative thinking skills, because students do not know how to give diverse interpretations by developing the opinions of other students, students' inability to come up with ideas because they are worried and afraid of being wrong on the answers given by the teacher, and even fear of being scolded by the teacher for the wrong answer. Thus, it can be concluded that the development of assessment instruments that can improve students' creative thinking skills, allowing them to maximize their understanding in providing diverse interpretations, is to develop opinions and express ideas or thoughts that spur their creative thinking skills.

THE DEVELOPMENT OF HIGHER ORDER THINKING SKILLS (HOTS) TEST INSTRUMENT ON METABOLISM TOPIC FOR SENIOR HIGH SCHOOL LEVEL

Research and development of the HOTS test instruments was carried out to measure students’ learning outcomes in the HOTS learning process on Metabolism topic at senior high school level. This study used the research and development method of the Dick & Carey systems approach model which consists of nine stages, namely: 1) assess needs to help identify learning goals; 2) conduct instructional analysis and analyze learners and contexts; 3) write performance objectives; 4) develop assessment instruments; 5) develop instructional strategies; 6) develop and select instructional materials; 7) design and conduct formative evaluation; 8) revise instruction based on the formative evaluation; and 9) design and conduct summative evaluation. The data of the students’ mastery on Metabolism topic was collected through a HOTS-based multiple-choice test related to Metabolism topic. A total of 610 research subjects were involved in this study. Content validity analysis were conducted using Aiken’s V formula and empirical validity analysis were carried out using product moment Pearson correlation. The results reveal that based on content validation, 83 out of 100 test items are valid, proven by the Aiken’s V value on the three indicators which is greater than 0.677. Based on empirical validation, in cycle I there are 60 valid test items as rcount > rtable (0.12) and sig. 2 tailed value < α 0.05. In cycle II, there are 55 valid test items as rcount > rtable (0.11) and sig. 2 tailed value < α 0.05. The 55 test items are in good quality category, thus they are ready to be implemented.