Aiken Index Research Articles

Development of Critical Thinking Essay Test Instrument and Prosocial Intention Questionnaire for Environmental Care in Students

Purpose of the study: Assessment of students' critical thinking skills and environmental care attitudes is crucial for science learning. This research aims to develop an essay test instrument for critical thinking and a questionnaire for environmental care attitudes, evaluating their validity through expert assessments and trials. Methodology: Utilizing the Research and Development (R&D) model by Oriondo & Dallo-Antoio (1998), the study comprises three stages: test planning, trials, and validation. A random sampling technique was employed, involving 267 students. The critical thinking instrument consists of essay questions, while the environmental care attitudes are measured using a prosocial intentions questionnaire. Main Findings: Validity results indicate a high Aiken index of 0.96 for critical thinking essays and 1.0 for the environmental care questionnaire. Reliability estimates were 0.73 for critical thinking and 0.71 for environmental attitudes, both good. The difficulty level for the critical thinking instrument was classified as medium (0.68), while the environmental care instrument was deemed difficult (1.65). Limitations include focusing solely on science subjects, trials restricted to one area, and reliance on self-reports for environmental attitudes, which may introduce bias. Novelty/Originality of this study: The novelty of this study lies in integrating critical thinking assessment with environmental care attitudes, a rare approach in previous research. In conclusion, the developed instruments effectively measure students' critical thinking skills and environmental care attitudes in science education, particularly regarding global warming.

Development of Science Technology Society (STS)-Based Physics Student Worksheet to Improve Students’ Science Literacy

The research on the development of Science Technology Society (STS)-based physics student worksheet has been conducted. This study aims to: (i) produce valid STS-based physics student worksheets, (ii) analyze the practicality of STS-based physics student worksheets, and (iii) analyze the effectiveness of STS-based physics student worksheets on students’ science literacy at SMAN 4 Gowa. The research method is Research and Development (R&D) with 4D model. The subjects of this research trial were 35 students of class XI IPA 1 at SMAN 4 Gowa. The instruments used include validation sheets, practitioner assessment questionnaires, and science literacy test instruments. Validity criteria based on expert validation results analyzed with Aiken's Index. Practicality criteria based on practitioners’ assessment result. Effectiveness criteria based on students' science literacy test result analyzed with N-gain equation. The results showed: (i) The validity of STS-based physics student worksheets meets the valid criteria with an expert agreement index (V) of 0.80, (ii) The practicality of STS-based physics student worksheets meets the practical criteria with a percentage of practitioner assessment of 91.88% in the very practical category, (iii) The effectiveness of STS-based physics student worksheets on science literacy of SMAN 4 Gowa students meets the effective criteria with an N-gain score of 0.42 in the medium category. Based on this research, it can be concluded that STS-based physics student worksheets are valid, practical, and effective in terms of improving students' science literacy.

AI-based assessment: Aiken index analysis of content validity in scientific literacy instruments on the basic laws of chemistry with ethnochemistry

AI-based assessment: Aiken index analysis of content validity in scientific literacy instruments on the basic laws of chemistry with ethnochemistry

Pengembangan Media Pembelajaran Video Interaktif Berbasis Quizizz Sebagai Upaya Edukasi Anti-Bullying di MTSN 1 Kota Bekasi

Bullying at school is a social problem that has a serious impact, both physically and mentally on students. At MTsN 1 Bekasi City, efforts have been made to prevent bullying through various anti-bullying educational programs, such as introducing the types of bullying, managing emotions, and career preparation. However, innovation is still needed to make anti-bullying educational programs more attractive to students. One potential innovation is the development of interactive educational video-based learning media to increase students' understanding of bullying and encourage student’s active participation in creating a safe and comfortable school environment. This research uses the Research and Development (R&D) method with the ADDIE development model, which includes five stages, namely Analysis, Design, Development, Implementation, and Evaluation. In the analysis stage, information is collected through field studies and literature studies to identify student’s needs. Next, at the design stage, media design is carried out to facilitate the production of learning media. The development stage is carried out by realizing the designs that have been designed into interactive video products. The final stage is evaluation, where the media is validated by three material experts and three media experts to assess the suitability of the product. The results of the study indicate that the developed interactive video is highly feasible for use based on validation from experts. The assessment by the media expert resulted in an Aiken index value of 0.8, which falls into the high validity category, while the assessment by the content expert resulted in an Aiken index value of 0.9, which falls into the high validity category.

Solar cell based power-bank prototype as a media to increase students' scientific literacy

This research aims to i) implement the solar cell based power-bank prototype for learning media; ii) describe the feasibility of the solar cell-based power-bank prototype for learning; and iii) describe students' scientific literacy. This research method uses the analysis, design, development, implementation, and evaluation (ADDIE) research and development model. The subjects of this research are class IX students and science teachers at SMPN 4 Central Bengkulu. Data collection techniques include questionnaires, tests, and interviews. The data analysis technique uses N-gain analysis, percentages, and the Aiken's V formula. The research results show that the media developed is valid with an Aiken index value of 0.98 > the minimum standard Aiken' V of 0.92 and can increase students' scientific literacy based on an N-gain of 0.92. 0.71, this can be seen in the dimensions of context and content based on N-gain of 0.73 and 0.69, while the dimensions of attitude, curiosity, respect, and willingness, reflect the respective percentages of 79.62%, 78.86%, 78.89%, 75.60%. Based on the results of the hypothesis test, the sig value is obtained. (2 tailed) 0.000 < 0.05 which means Ha is accepted and Ho is rejected, which means the solar cell-based renewable energy media used in science learning influences the increase in students' scientific literacy.

Reliability and separation index analysis of mathematics questions integrated with the cultural architecture framework using the Rasch model

This research uses Rasch model analysis to identify the reliability and separation index of an integrated mathematics test instrument with a cultural architecture structure in measuring students' mathematical thinking abilities. The study involved 357 students from six eighth-grade public junior high schools in Bima. The selection of schools was based on average school exam scores and considered the effectiveness of the learning process that used cultural settings to explore mathematical content. Data analysis was conducted using Microsoft Excel to calculate the content validity of Aiken's index with four experts and the jMetrik software to measure reliability and the separation index. The research results indicate that the mathematics test instrument passed validation by mathematics experts and measurements with a valid content validity level. Rasch model calibration shows a very high level of instrument reliability. Separation analysis on the logit scale indicates the instrument's ability to differentiate students with different ability levels with good homogeneity in the distribution of test items and individual abilities. Scale quality statistics show good item response variability, low error rates and a high separation index. This study has limitations because it focuses solely on multiple-choice questions. Similar research must be conducted using other types of questions (such as those used in PISA, namely open- constructed and closed-constructed questions) and integrating other mathematical materials within relevant cultural architectural structures.

Pengembangan Media Video Animasi Berbasis Powtoon untuk Meningkatkan Critical Thinking Peserta Didik Sekolah Dasar

This research aims to develop Powtoon-based animation videos to improve students' critical thinking. The research method uses ADDIE which consists of five stages: Analysis, Design, Development, Implementation, and Evaluation. The research sample was class IV A as the experimental class and IV B as the control class. The results of the study include the feasibility, practicality, and effectiveness of the product. The feasibility of the product is considered valid based on the validation results, with an average Aiken index of 0.808 for material, 0.958 for language, and 0.608 for media. The practicality of the product was seen from the responses of educators (90%) and students (89%), both of which were interpreted as very practical. The effectiveness of the product was measured through a comparison of the improvement of critical thinking skills between the experimental and control classes. The results show that the experimental class has an effect size value of 0.798, which is interpreted as high. This proves that the use of Powtoon-based animated videos significantly improves critical thinking skills compared to those who do not use the product.

Beyond The Classroom: Empowering Social Care Character Through Islamic Education Via Student Executive Board

Islamic Education (IE) in Higher Education is a compulsory course in Indonesia. However, it still dominantly assesses the cognitive aspect, while the learning competency of Islamic Education aims to form the religious character and social attitudes of students. Therefore, this study aims to develop indicators of student social care integrated with student organization activities. The indicator of social concern that has been validated and meets the content validity score will be used as a measuring tool for the attitude and skill components of students in Islamic Education learning. The process of developing indicators of social care integrated into student organization activities requires the ADDIE model development research method (Analysis, design, development, implementation, and evaluation, but in this study, there are only three stages: the first needs analysis, the second planning, and third development. The research subjects were students and lecturers of Islamic Education at Universitas Negeri Jakarta, Universitas Pendidikan Indonesia, and Universitas Muhammadiyah Jakarta. Data collection tools are questionnaires, interviews, and documentation studies. Data analysis used the Aikens Index and inter-rater reliability to see the suitability of the content of the indicator with the theory used and to see the agreement of experts in assessing the developed social care indicators. The results of the research based on the needs analysis by surveying 25 students from student organization members in three universities through quota, purposive sampling, and interviews found that 80% of students were involved in BEM social activities, and 72% of students agreed to integrate social activities of student organizations in PAI learning. The results of the Aiken Index content validity test of six skill indicators and four social care attitude indicators were a minimum score of 0.83 and a highest score of 0.91. The reliability test result is 0.64. These results indicate that three experts have agreed upon the content of social care indicators, and then it is feasible to construct a validity test to find out the indicators developed that can measure students' social attitudes and skills using the theory used.

Mentor Teachers' Perceptions Toward the Pedagogical Competence of Pre-Service Teacher Professional Education, FKIP, University of Palangka Raya in Practical Field Experience

This study aimed to determine student teachers' perceptions about the mastery of pedagogical competencies of students of the PPG Pre-service Study Program at FKIP Palangka Raya University in 2022 in Field Experience Practice. This research uses a quantitative approach with a descriptive research type. The research involved 15 student teachers as subjects, with the object being 62 students of the Pre-service PPG Study Program at FKIP Palangka Raya University in 2022, namely wave I as many as 33 people, and wave II as many as 29 people. Data collection was carried out using a questionnaire that had been validated by three experts and obtained a value of V (Aiken Index) = 0.92> 0.8 including in the high category and a PA value (Percentage of agreement) = 93%, meaning that it was feasible to use to collect data. The results showed that in wave I, 3 students (9.09%) were obtained in the high category, 24 students (72.73%) in the medium category and 6 students (18.18%) in the low category, and wave II, 4 students (13.79%) were obtained in the high category, 20 students (68.97%) in the medium category and 5 students (17.24%) in the low category. From waves I and II, it can be seen that the largest frequency is in the medium category, so it can be concluded that the perceptions of student teachers about the mastery of pedagogical competence of students of the PPG Study Program at FKIP Palangka Raya University in 2022 are in the medium category.

Revolutionizing home care with SIRAMAH: A smart system for supporting family members with mobility impairments

Many families independently care for patients with physical mobility disorders at home. One effective intervention to enhance family caregivers' knowledge and skills is the implementation of a telenursing application. This study aims to evaluate the effectiveness of the SIRAMAH telenursing application in improving the knowledge and skills of families caring for individuals with physical mobility impairments. The research was conducted in two stages. The first stage involved designing the telenursing system using a prototype method. In the second stage, the system was tested using a Pre-Experimental One Group Pretest-Posttest design. A simple random sampling technique was employed, with 30 family caregivers participating. The application was assessed through Black-Box testing, with content validity evaluated by experts. The Aiken index value (V) was 0.76, indicating high validity, while the application received a 78% validity rating from experts and a 90% rating from general respondents. Results showed a significant improvement in both knowledge and skills following the intervention. The average knowledge score increased from 58.00 before the intervention to 78.67 afterward. Similarly, the average skill score rose from 64.93 to 92.10. Statistical analysis revealed that the SIRAMAH telenursing application significantly enhanced the knowledge and skills of family caregivers (p < 0.001). The SIRAMAH telenursing application has proven to be a feasible and effective tool for improving the care provided by families to individuals with physical mobility impairments at home. The application meets the required feasibility standards and successfully boosts caregivers' knowledge and skills. Keywords: Caregivers; mobility disorders; telenursing; skills of family; home care

DEVELOPMENT OF GEOMETRY MOBILE LEARNING TO ENHANCE STUDENTS' MATHEMATICS LEARNING INTEREST

The development research aims to produce a mobile learning application for geometry to enhance students' interest in learning mathematics. The product encompasses solid geometry materials for 7th-grade junior high school students. The development process follows the ADDIE model: Analyze, Design, Development, Implementation, and Evaluation. The product underwent testing with 7th-grade students at a junior high school in Yogyakarta. Data collection instruments included a questionnaire on students' interest in learning mathematics, a product validation sheet, teacher and student assessment sheets, and an observation sheet on the feasibility of the learning process. These instruments were utilized to measure the validity, effectiveness, and practicality of the developed product. The research findings indicate that: (1) The developed mobile learning application for geometry is presented using Creative Problem Solving syntax, complemented with features such as liveworksheets, Geogebra, instructional videos, Quizizz, and Google Forms, facilitating the enhancement of mathematical creativity. (2) The developed product is declared valid based on the validation results obtained from two media experts and two content experts, with an average Aiken index reaching 0.94 out of the maximum score of 1, categorizing it as "High." The product is assessed as practical based on teacher assessment at 96.55%, student assessment at 71.28%, and an average learning process implementation percentage of 85.83%. The product is also deemed effective due to a significant increase in the variable of students' interest in learning mathematics. Thus, the developed geometry mobile learning application meets the criteria of validity, practicality, and effectiveness.

Development of character assessment instrument on English learning for middle school students

There is a present-day necessity to construct character education assessment instruments in English courses. Employing the ADDIE development model, this research undergoes stages encompassing analysis, design, development, implementation, and evaluation to craft a meticulously designed assessment instrument. The resulting instrument is a self-assessment for English subjects, subjected to scrutiny through both Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). The instrument attests to content validity, indicated by an Aiken index of 0.955, and construct validity using EFA & CFA. Outcomes showcasing loading factor values exceeding 0.4 for each item and the model for measuring student character aligns seamlessly with the hypothesized model, substantiated by statistical results of p-values = 0.056; CFI = 0.979; TLI = 0.972; RMSEA = 0.031; SRMR = 0.055. Furthermore, the item reliability in each dimension/factor surpasses 0.7. The study's revelations uncover that 46% of students predominantly concentrate on character development, while 35% prioritize character emphasis. Cultivated character for 14%, whereas a mere 5% of students necessitate guidance. This instrument not only guides educators and researchers in developing character assessment tools but also meets valid and reliable criteria, ensuring credibility and usability across various education levels.

Pengembangan Instrumen Assesmen Literasi Sains Berbasis Kontekstual pada Materi Koloid

This research is a development research (Research and Development) with the objectives: (1) to assess the quality of the instrument in terms of content validity and empirical validity, (2) to determine the reliability of the developed instrument, and (3) to assess the practicality of the developed instrument. The product developed is a contextual science literacy assessment instrument on the topic of colloids. The developed contextual science literacy instrument is in the form of multiple-choice questions. The research was conducted using the 4D development model, which includes the stages of define, design, develop, and disseminate. The results of rational validation by two expert validators yielded 15 valid test items with an Aiken's index ≥ 0.75. The instrument was tested on 34 students from class XII MIPA 3 of SMAN 1 Gowa. The results of empirical validation using the point biserial formula at α=0.339 yielded 14 valid test items. The results of the reliability test using KR-20 showed that the instrument was categorized as reliable with a value of 0.831. The analysis of the item discrimination power showed that there were 2 very good items, 6 good items, 4 fair items, and 3 poor items. The distribution of the item difficulty level was 47% difficult items, 40% medium items, and 2% easy items. The practicality of the contextual science literacy assessment instrument on the topic of colloids was categorized as practical based on the positive results of the student questionnaire (85%) and the teacher questionnaire (95%).

Development of an Online Project-Based Learning Assessment Instrument for Vocational Education Students

Objectives from the study This is an instrument for reliable online project-based learning assessment for vocational education students. Study This uses 10 procedures for the non-ttest instrument developed by Mardapi. The population study covers the whole Electrical Engineering Education student’s year at the First Faculty of Engineering, Universitas Negeri Padang. The sample consists of the 250 students selected through two stages: the trial stage, which uses the cluster random sampling method, and the stage measurement, which uses the simple random sampling method. Data analysis was performed using validity tests using the Aiken index as well as validity and reliability tests. Findings study These are (1) instruments. The assessment of project-based learning online consists of 30 valid and reliable items, so it can be used by lecturers. (2) Ability to measure cognitive, affective, and psychomotor skills in the learning process Cognitive, affective, and psychomotor vocational education students tend Good.

Development Of Google Form-Based Learning Outcome Evaluation Instruments For Animal Development Courses In The Biology Education Study Program FMIPA UNIMED

This study aimed to develop a valid and reliable google form-based learning outcome evaluation instrument for the Animal Development course. The instrument was developed following the 4D development model (define, design, develop, dessiminate). The research subjects were Biology Education Study Program (PSPB) class of 2021 class B students totaling 26 people. Data were obtained from validation questionnaires and student response questionnaires. The initial design of the learning outcome evaluation instrument consisted of 50 questions. Based on the validator's assessment, an instrument consisting of 25 valid and reliable questions was obtained. The results of validation by evaluation instrument experts obtained an average percentage of 98.6% with a very feasible category. Based on the validity analysis of the Aiken index, the value V = 0.942 was obtained with high validity criteria. Instrument reliability using Cronbach's Alpha obtained a value of 0.796 with high criteria (reliable), while the analysis of ICC reliability data obtained the results of inter-rater agreement of 0.796, and for each rater the consistency is 0.565. It can be concluded that the agreement between raters is very strong and each rater has a fairly good consistency. The results of the data analysis of student responses showed that each indicator was rated very well with an average percentage of 88%.theresa612

Development of Character Assessment Instrument on English Learning FOR Junior High School Students

This research endeavors to address a pressing need in education, specifically, the development of a robust character education assessment tool for junior high school students in the context of English subjects. The primary focus of this study is producing character education assessment instruments in English subjects for junior high school students with good construction. This study is a research and development using the ADDIE development model. The instrument development process consisted of the analysis stage, the design stage, development stage, implementation stage and evaluation stage. The instrument developed is an assessment instrument on English subjects in the form of self-assessment, analyzed using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA). The instrument developed has met the validity and reliability requirements with the results of content validity shown by the Aiken index of 0.955 while the test results with CFA show the loading factor value on each item > 0.4 and the student character measurement model compiled is fit with the theorized model by proving the results of p-values = 0.056; CFI = 0.979; TLI = 0.972; RMSEA = 0.031; SRMR = 0.055 with the results of the reliability of the items in each dimension/factor > 0.7.

Development Of An Ethnoscience-Based Digital Comic "Tari Saman" For Human Movement System Material

Scientific literacy skills are still low, and students' lack of interest in getting to know culture is a current educational issue, so innovative, creative and interesting learning media are needed to increase interest in reading and the formation of national cultural character in students. The development of digital comics in the field of science has been carried out by many researchers, but there are still few who combine the material with local wisdom to form cultural characters. This ethnoscience- based digital comic designed to be a pilot project and learning resource for teachers and students in Indonesia in mastering science, technology, skills and attitudes based on the Independent Learning Curriculum. The data was analyzed by processing validator response data with a Likert scale which was converted into qualitative data . The research subjects were media, material and language experts, 60 high school students in class XI high school science, and 6 biology teachers. The instruments used were expert validation tests and questionnaires. The data was analyzed by processing validator response data with a Likert scale which was converted into qualitative data. The purpose of this research can measure the effectiveness of the ethnoscience -based digital comic "Tari Saman" on movement system material to improve students' scientific literacy skills and national cultural character according to P5 (Strengthening Pancasila Student Profile Project). This research uses the 4D method (Define, Design, Develop, Disseminate). The validity test results show that ethnoscience-based digital comics “tari saman” have a moderate level of validity with an Aiken index value > 0.4. the results of the feasibility test were 88% by the teachers and 90% by students and media practicability were 88% by teachers and 89% by students. It can be concluded that ethnoscience-based digital comics “tari saman” are valid, feasible and practical to use as supporting media for Biology learning.

Aiken Index Analysis to Determine The Contents Validity of Project Assessment Instrument in Learning Islamic Religion and Character in the Independent Curriculum

This research aims to analyze the validity of the content of the project assessment instrument for Islamic religious learning and character in the independent curriculum based on the Aiken validity index so that the instrument can measure what it will measure. The research method used is a quantitative descriptive method based on content validity results which are calculated using the Aiken V formula. Content validity data was obtained from 5 experts, namely 2 Islamic religious education experts and 3 evaluation experts. The content validity test in this study used 4 assessment criteria, namely Very Appropriate (VA), Appropriate (A), Not Appropriate (NA), Very Inappropriate (VI). The Project Assessment instrument for learning Islamic religious education and morals resulted in 15 indicators being declared valid with an average Aiken index above 0.873. The project assessment is declared to be suitable for measuring what it wants to measure, and can be used to measure the results of Islamic religious education and character learning project assignments in the independent curriculum.

Developing The Instrument of E-Learning Evaluation: Study at Vocational School

This study aims to develop an instrument for the evaluation of e-learning with Learning Management System (LMS) in vocation school majoring in office administration. The instrument development from CSE-UCLA evaluation model. The sample used was cluster random sampling technique, taken at the small-scale trial stage were 85 respondents and wide-scale trial stage 235 respondents. The instrument was validated employing Aiken, construct validation used was EFA and CFA, Cronbach Alpha was employed the reliability. The result showed that there were five instrument constructs for implementating e-learning. The content validity using the Aiken index indicated a valid item. The validity of the instrument construct was conducted using EFA with a KMO value of 0.751 and each item had an anti-image coefficient >0.5 which means the factor analysis requirements for future met. The fit model based on the CFA result showed the value of Chi-square (X^2) = 239.61, df = 179, P-value = 0.416, RMSEA = 0.000. The loading factor value was 0.41-0.89 (>0.30) which meant that the item was valid. The reliability of the instrument showed a value of 0.791 that all instruments developed were reliable

Pengembangan Bahan Ajar Kurikulum Merdeka pada Pembelajaran Tematik Berbasis Kontekstual Kearifan Lokal untuk Kelas 5 Sekolah Dasar

Teaching materials are prepared systematically and designed in accordance with applicable curriculum provisions. Currently, the education curriculum in Indonesia has changed to the Independent Curriculum. In the Independent Curriculum, a thematic approach is used in Education Units so that they can choose subject or thematic approaches freely based on students learning needs or based on local wisdom. The aim of this research was to develop valid independent curriculum teaching materials for contextually based of thematic learning of local wisdom for grade 5 elementary schools. This research was Research and Development (R&D) development research with a 4D development model, consist of Define, Design, Develop and Disseminate. The data collection techniques used were interviews, assessment sheets and questionnaires. The subjects in this research was 10 class V students of SD Negeri 006 Sekip Hulu Rengat. The data analysis technique used to analyze quantitative data on validator assessment sheet instrument used the Aiken index. The research results obtained from the media expert validation test were 0.94 (very valid), the material expert validation test was 0.87 (very valid), the student response questionnaire was 89% (very practical) and the teacher response questionnaire was 90% (very practical). The final results on the student test obtained an overall average of 95% and were categorized as very good so that the teaching material product was suitable for use.