Validity Of Items Research Articles

Development and Analysis Validation Instrument Critical Thinking Heat Concept (CTHT) Using Rash Model

This research aims to design and determine the validity and reliability of critical thinking skills instruments related to heat concepts using the Rasch model. This research uses 4D research and development methods. The research subjects or validation trials were 193 Depok City High School students majoring in Mathematics and Natural Sciences who had studied heat concepts and content validation was carried out with six expert lecturers. Content validity data analysis used Aiken V Microsoft Excel calculations with a validity limit value of < 0.78 and construct validity and reliability used the Rasch model. The results of data analysis show that the content validity of the instrument is valid and suitable for use with several revisions and expert input, while the results of content validity show a validity level of 43.21% with all valid items in the fulfilled category, while the Pearson and item reliability values show a value of 0.62 is in the sufficient category and 0.92 is in the very special category. The results of the statistical analysis trial showed that the instrument was significant and became a benchmark for further research in the application of students' critical thinking skills in learning.

Comparison of Physical Education Learning Motivation between The Science Department and The Social Sciences Department

This study aims to determine whether there are differences in motivation to study physical education between science majors and social studies majors at SMA Negeri 1 Subang. The research method used is non-experimental (ex post facto) with a comparative design, namely the research is directed to compare one sample group with another group. In this study, researchers wanted to compare the level of motivation to learn science majors with social studies majors at SMA Negeri 1 Samarinda. The population in this study were students of class XII IPA and XII IPS SMA Negeri 1 Samarinda, totaling 364 students with a sample taken of 20% of the population, namely 69 respondents. The instrument used in this study was a motivational questionnaire which was tested for validity and reliability by the author with the results of 25 valid items out of 27 existing item items and a reliability level of 0.902. In this study, the hypothesis was tested using the independent sample t-test formula with a result of 0.002 < 0.05, so with these results there was a significant difference between the motivation to study physical education majoring in science and social studies at SMA Negeri 1 Samarinda (exceeding the classical completeness standard). The results of this research show that animated learning media can improve responsiveness and science learning outcomes in special sports classes.

An Achievement Test in Mathematics in the Modern World Course: The Standardization Process

This study aimed to construct and standardize an achievement test in Mathematics in the Modern World (MMW) course. Achievement test evaluates a student’s performance after a given period of instruction. Using the instrumentation research design, the data were gathered among 273 tertiary students of Notre Dame University enrolled during the second semester of Academic Year 2020-2021. Among these, 38 pilot tested and 213 tested the reliability of the instrument. This study further utilized the following: a 4-point Likert scale for the validation of the instrument, difficulty value and discrimination index formulas for the analysis of each item, and KR20 reliability for internal consistency. Furthermore, a test manual for the MMW achievement test was also established. The preliminary total number of Items before MMW teachers’ validation was 42 items covering the topics for the first 12 hours of the MMW Syllabus. These items were validated through Aiken’s Item Validity method which resulted in the acceptance of 42 items. After rigorous processes, it resulted in the acceptance of 34 items for the MMW achievement test. The instrument’s average validity is 0.935, and the reliability is 0.701 which means that this tool has high validity and acceptable reliability.

The Relationship Between Dominance and Cyber Dating Abuse in Dating as Early Adults

Technology has various applications, including communication with partners. However, cyber dating abuse can negatively impact relationships. This behavior victimizes partners through online media and can stem from dominance in the relationship. Early adulthood is a time when individuals begin to engage in more intimate romantic relationships, which may increase the risk of cyber dating abuse. This correlational quantitative study aims to determine the relationship between dominance and cyber dating abuse in early adults who are dating. The sample consisted of 255 early adults who are dating and was selected using accidental sampling. The study employed the dominance and cyber dating abuse scale instruments for data collection, each comprising of 27 valid items. The reliability coefficient values for the dominance and cyber dating abuse scales were 0.913 and 0.970, respectively. The data was analyzed using Spearman Rho with a significance value (p) of 0.000 and a correlation coefficient (r) of 0.709. The analysis results indicate that dominance falls within the moderate category, while cyber dating abuse falls within the low category. Therefore, we can conclude that the hypothesis stating “There is a relationship between dominance and cyber dating abuse in early adults who are dating” is accepted. In other words, the higher the dominance in the relationship, the higher the cyber dating abuse in early adults who are dating, and vice versa

Hubungan Antara Gaya Kelekatan Dewasa Dengan Toxic Relationship Pada Mahasiswa Bimbingan dan Konseling yang Berpacaran

This study is a correlational quantitative research. The study aims to find out the relationship between adult attachment style and toxic relationship in dating Guidance and Counseling students and to find out how high the level of adult attachment style and toxic relationship level in dating Guidance and Counseling students. The subjects totaled 102 students. Data collection used the adult attachment style scale with 62 valid items with a reliability test value of 0.971 and the toxic relationship scale with 37 valid items with a reliability test score of 0.999. The results showed that there was a negative relationship between adult attachment style and toxic relationship with a high level of significance with a value of r -0.712 and p < .001. The level of adult attachment style of dating students is classified as high with a percentage of 43%. The level of toxic relationships in students who are dating is classified as low with a percentage of 52%. Based on these results, it can be seen that the higher the level of adult attachment style, the level of toxic relationships tends to decrease, and vice versa

Hubungan antara Pengalaman sebagai Korban Cyberbullying dengan Kepercayaan Diri pada Mahasiswa Program Studi Bimbingan dan Konseling

This research uses correlative quatitaive research. The sample in this study amounted to 65 students of the Guidance and Counseling Study Program. The data collection technique used in this research is by distributing questionnaires using a google form link with a Likert scale statemen. Data collection uses a cyberbullying experience scale with 34 valid items with a reliability test value of 0.952 and a self-confidence scale with 40 valid items with a reliability test value of 0.970.The results in this study prove: 1) There is a negative relationship with a Pearson Correlation correlation value of -648 with a significance level of 0.000. 2) The level of cyberbullying experience in Guidance and Counseling Study Program students is classified in the high category with a percentage of 38%. 3) The level of self-confidence in students of the Guidance and Counseling Study Program shows 2 levels of categories, namely the low category with a percentage of 32% and the high category with a percentage of 31%.

PORTRAIT OF STUDENTS’ MISCONCEPTIONS USING FOUR-TIER MULTIPLE CHOICE DIAGNOSTIC TEST ON ROTATIONAL DYNAMICS MATERIAL IN CLASS XI SENIOR HIGH SCHOOL

Misconception is a mismatch between the understanding of the concept known by students and the actual concept. Physics is a science that has several concepts. The profile of misconceptions on physics concepts must be identified so that students have an appropriate understanding of the concepts. The purpose of this research is to analyze students’ concept understanding and misconceptions of Rotational Dynamics material using a four-tier multiple choice diagnostic test. The type of research used is descriptive with qualitative and quantitative approaches. This research was conducted in one of the high schools in Medan in Grade XI IPA. The population in this research was grade XI students majoring in IPA. The research sample was obtained by using purposive sampling technique as many as 64 students of grade XI IPA 2 and XI IPA 3. Sampling based on certain criteria from population participants. The criteria are classes whose students have finished learning Rotational Dynamics material and have not been tested on Rotational Dynamics material. Data collection techniques in the form of diagnostic tests response questionnaires and interviews. The test used is a four-tier multiple choice diagnostic test that has been validated by experts. The diagnostic test consists of 18 valid items with a reliability of 0.912 including a very high category, good differentiating power, and moderate difficulty level. The results showed that students' concept understanding of Rotational Dynamics material was categorized as moderate with 44.88% of students understood the concept, 50.17% of students had misconceptions, and 4.95% of students did not understand the concept, and students' responses to the use of four-tier multiple choice diagnostic tests obtained 80% with good criteria.

Development of a long-term care service integration self-assessment tool

ABSTRACT The World Health Organization emphasizes the importance of providing integrated care for older people. Taiwan is the fastest aging country in the world. In 2016, Taiwan implemented the Long-Term Care Plan 2.0 (TLTCP 2.0), aimed at providing integrated long-term care (LTC) services in communities. However, LTC service agencies have not been able to evaluate the level of integrated care they provide due to the lack of an effective assessment tool. To address this need, this study sets out to develop an integration assessment tool, namely the Self-Assessment for Service Integration in Long-Term Care (SASI-LTC), which will allow LTC agencies to self-evaluate their current level of integration from multiple perspectives. The SASI-LTC was developed based on Evashwick’s framework, underwent two rounds of Delphi panels with twenty-six experts, and a pilot test with 243 valid questionnaires from administrators of Tier A agencies who are responsible for integrating LTC. The Delphi experts assessed the content with high levels of agreement using medians, the scale content validity index (SCVI) and item content validity index (ICVI). The SASI-LTC included four domains (inter-entity organization and management, integrated care coordination, integrated resources, and integrated information systems) with thirty items. The SASI-LTC showed good reliability (Cronbach’s α = 0.94) and good validity, and a confirmatory factor analysis showed a good model fit index [χ2/df = 1.38; RMSEA = 0.040; CFI = 0.963; SRMR = 0.049] in pilot testing. While the SASI-LTC is a useful and feasible tool for Taiwan’s LTC service agencies to evaluate their level of integration in providing LTC services, it could also be used in other countries with minor adjustments to localization of items related to financial integration.

Can Glamping be a Vacation to Help Dink Couples Relax and Maintain Close Relationships?

Glamping brings a glamorous tourism experience providing potential opportunities to escape from daily routines and maintain relationships during difficult/special times, such as the pandemic with travel restrictions or postpandemic travel concerns. It is innovative to explore the unique group of DINK (dual income, no kids) couples using glamping as context. This study examines the variations in closeness among DINK couples based on four individual attachment styles (i.e., secure, anxious, dismissive, fearful), and explores the relationships between closeness and subjective well-being. A pilot test with 118 valid responses was adopted to ensure the validity of items and feasibility of the study design. Utilizing attachment theory with four attachment styles, the main study analyzed 940 valid responses using confirmatory factory analysis, ANOVA, and multigroup path analysis. This study highlights that people with a secure attachment style have a significantly 1) higher level of closeness with their partner and 2) stronger relationship between closeness and subjective well-being compared to the other three attachment styles (i.e., anxious, dismissive, and fearful). The results suggest that glamping providers could improve glamping environments to be peaceful and comfortable to attract potential glampers who have higher anxiety (i.e., anxious and fearful attachment styles). Further, the results indicate that glamping could serve as a setting for couples??? therapy and to celebrate special events to enhance close relationships. These promoting/marketing strategies can benefit small glamping businesses develop their products and potentially draw different types of visitors.

Big Data Value Proposition in UK Facilities Management: A Structural Equation Modelling Approach

Big data analytics (BDA) has been introduced in the past few years in most industries as a factor capable of revolutionizing their operations by offering significant efficiency opportunities and benefits. To compete in this digital age, businesses must adopt a client-centric service model, founded on data delivering continuous value and achieving optimal performance, whilst also upgrading their own decision-making and reporting processes. This article aims to explore how UK FM organizations are currently capitalizing on BDA to drive innovation and ‘added value’ in their operations. The objective is to shed light on the initial BDA adoption efforts within the UK’s FM sector, particularly capturing the benefits experienced by FM organizations in relation to customer value and improved decision-making processes. Drawing upon exploratory sequential research including a qualitative stage with 12 semi-structured interviews and an industry-wide questionnaire survey with 52 responses, a novel fifteen-variable model for BDA outcomes was developed. Exploratory Factor Analysis (EFA) and a Higher-Order model using Partial Least Square Structural modelling (PLS-SEM) were used to validate the scale. The EFA output generated three dimensions with 14 items. The dimensions included Improved client value, FM business operations added value, and Improved efficiency added value. Furthermore, the results of PLS-SEM confirmed the validity of the scale items and the reflective–formative measurement model. The findings suggest that the contemporary digitization trend offers the FM service the unique opportunity to develop a smarter, client-centric strategy resulting in more personalized services and stronger customer relationships. Furthermore, efficient resource management and planning powered by analytics and data-driven insights emerge as a key driver for competitive differentiation in the field. As one of the first studies to develop and validate scale items measuring specific dimensions of BDA adoption outcomes, the study makes significant contributions to the literature.

Hubungan Penerimaan Kepuasan Body Image Dengan Kepercayaan Diri Pada Siswa-Siswi SMP Negeri 1 Wonogiri

This research uses correlative quantitative research, with the subject of students of Junior High School Negeri 1 Wonogiri. The sample in this study amounted to 80 samples. The process of collecting data by distributing questionnaires directly using google forms with statements that use a likert scale. On the body image satisfaction acceptance scale there are 33 valid items with an Alpha Cronbach reliability index of 0.788. The self-confidence scale has 36 valid items with an Alpha Cronbach reliability index of 0.911. The data analysis technique used is descriptive categorization technique, normality test, linearity test, hypothesis test and correlation test.The results in this study show: (1) there is a significant positive relationship between the variables, (2) the level of body image satisfaction acceptance in the moderate category with a percentage of 43%, (3) the level of self-confidence is classified in the high category with a percentage of 50%, (4) there are 2 items in the body image satisfaction acceptance scale that are identified as low with a percentage of 6%, so they are used as guidance topics, (5) there are no items in the self-confidence scale that are identified as low to be used as guidance topics.

A scoping review of the development and validation procedures of 59 supervision measures published between 1984 and 2023

ABSTRACT The authors undertook a scoping review of the development and validation procedures of 59 supervision measures from 1984 to 2023, following Ellis et al.’s (2008) guidelines. During item development phases, 43 (73%) measures were developed based on theoretical foundations and approximately half utilized initial item pools and expert reviews. Regarding item validation, about half (50%) underwent initial validations by their developers. However, only eight (14%) measures were subjected to cross-sample validation, and two (3%) measures were properly examined with cross-cultural samples. Our results highlighted the overarching trends across these supervision measures and discussed implications for their future use and research.

Patient satisfaction and value based purchasing in hospitals, Odisha, India.

To examine how a general inpatient satisfaction survey functions as a hospital performance measure. We conducted a mixed-methods pilot study of the Hospital Consumer Assessment of Health Providers and Systems survey in Odisha, India. We divided the study into three steps: cognitive testing of the survey, item testing with exploratory factor analysis and content validity indexing. Cognitive testing involved 50 participants discussing their interpretation of survey items. The survey was then administered to 507 inpatients across five public hospitals in Odisha, followed by exploratory factor analysis. Finally, we interviewed 15 individuals to evaluate the content validity of the survey items. Cognitive testing revealed that six out of 18 survey questions were not consistently understood within the Odisha inpatient setting, highlighting issues around responsibilities for care. Exploratory factor analysis identified a six-factor structure explaining 66.7% of the variance. Regression models showed that interpersonal care from doctors and nurses had the strongest association with overall satisfaction. An assessment of differential item functioning revealed that patients with a socially marginalized caste reported higher disrespectful care, though this did not translate into differences in reported satisfaction. Content validity indexing suggested that discordance between experiences of disrespectful care and satisfaction ratings might be due to low patient expectations. Using satisfaction ratings without nuanced approaches in value-based purchasing programmes may mask poor-quality interpersonal services, particularly for historically marginalized patients. Surveys should be designed to accurately capture true levels of dissatisfaction, ensuring that patient concerns are not hidden.

A valid and reliable self-peace scale with indicators of love, care and fearlessness for adolescent drug users

Self-peace is a crucial component for individuals/teenagers/students to live happily and recover from drug use. However, self-peace isn't wholly owned by individuals affected by drug use or recovering from drugs. Peace counsellors measure self-peace as a form of the addiction counsellor's role in the growth of self-peace due to drug use. This research aims to develop a valid and reliable self-peace scale. The research method uses a sequential exploratory mixed method from the qualitative data analysis process supported by quantitative data. The research targets were three expert validators and N=151 subjects among students/individuals/adolescents. Qualitative descriptive analysis compiles grids and statement items and provides expert input in developing the self-peace scale. Quantitative data analysis from the expert assessment with Aikan-V and instrument testing with confirmatory factor analysis will be used to determine the validity and reliability of the self-peace scale. The results of the data analysis compiled a blueprint of the peace scale (sub-aspects of caring, courage and love) and 12 statement items that were included in the very feasible category (Aikan-V ≥0.888). Validity of statement items with 12 valid statement items with factor loading ≥0.5, KMO=0.793 ≥0.50, reliability score 0.842 (high criteria). School counsellors can use student problem assessments to analyze student problems and needs. Counsellors, psychologists and researchers can use the self-peace scale to determine the development of an individual's self-peace to recover from drug use with four answer choices. The analysis results can be applied to further intervention in peace counselling. Keywords: self-peace, scale, validity, reliability

Perancangan Instrumen Go-Green Movement Inventory dalam Konteks Gerakan Go-Green

The purpose of this research was to examine the content validity, inter-rater reliability, item validity, and item reliability of the Go-Green Movement Inventory (GGMI) instrument developed for high school students. The instrument development process utilized the Research & Development (R&D) method by Borg and Gall in Sugiyono (2019), up to the fourth stage. Prior to testing the instrument with 148 high school students, validation was conducted by 5 experts comprising two university lecturers and three high school teachers. The research findings indicate that the content validity analysis of the Go-Green Movement Inventory (GGMI) instrument for high school students is valid, as evidenced by Vhitung > Vtabel, specifically 0.89 > 0.87. Inter-rater reliability analysis yielded a score of 0.79, categorized as moderate. Item validity analysis revealed that out of 30 statement items, 2 items were rejected: item number 13 and 30, while the rest were accepted. Item reliability analysis showed a person reliability value of 0.80, indicating good consistency in student responses, and an item reliability of 0.96, indicating excellent quality of individual items. The Cronbach's Alpha coefficient was 0.83, indicating good overall interaction between respondents and item statements.

DEVELOPMENT OF THE FACTUAL, CONCEPTUAL AND PROSEDURAL QUESTIONS ON THE MOVING MATERIALS OF CLASS VIII SMP

The students' knowledge of Physics Science material, especially in the subject of the motion of objects, is still below the expected KKM standard. Motion material is the basis or prerequisite for understanding further science material related to object motion material in class VIII to class IX. So far, there has never been an assessment related to the abilities of students' knowledge dimensions. This research focuses on assessing faktual, konseptual and prosedural knowledge according to the IC issued by the Ministry of Education and Culture. This type of research is development research using the ADDIE (Analyze, Design, Development, Implementation, Evaluation) development model. The purpose of this research is to describe the process of developing factual, conceptual and prosedural knowledge questions and to find out the dimensions of students' knowledge on the material motion of objects. The data obtained in this research is in the form of qualitative and quantitative data. Empirical validity analysis of 14 multiple-choice items and essays yielded the characteristics of the questions consisting of validity of 13 (92.8%) valid items, reliability of items with Cronbach's alpha 0.630 on 8 multiple-choice items and Cronbach's alpha 0.638 on 5 essay items greater than the r table value of 0.6, the level of difficulty is 64,3% items with moderate criteria, the discriminating power is 28,57% very good, 28,57% good questions, and 28,57% sufficient.

Kognitive Interviews als Methode der Inhaltsvalidierung von Fragebogenitems zur Erfassung kognitiver Aktivierung im Englischunterricht der Grundschule

Student and teacher feedback on instructional quality is considered a tried and tested source of data. However, Lenske (2016) demonstrates that students at primary level often fail at understanding and interpreting questionnaire items on instructional quality – student activation, in particular – as intended. These findings emphasize the need for explicitly addressing issues of content validity in student questionnaires. Studies on the content validity of teacher ratings of instructional quality have not been conducted yet. This paper presents a qualitative study investigating the content validity of newly constructed items on cognitive activation in English language teaching at primary level. Cognitive interviews were conducted with nine primary English language teachers and 39 fourth year students to explore how they process questionnaire items on cognitive activation. The interview data was analyzed using qualitative content analysis. Thus, the study replicates Lenske’s (2016) approach and adapts it to teachers as a new target group. The findings show that both groups of participants misinterpreted more than half of the items each. Building on these findings, the paper suggests strategies for ensuring the content validity of items.

ADAPTATION AND VALIDATION OF THE INDONESIAN VERSION OF THE HEALTH BELIEF MODEL INSTRUMENT FOR PARENTS

Children are a crucial population requiring COVID-19 vaccination. With the global rollout of COVID-19 vaccines, the increasing number of unvaccinated children and adolescents has raised concerns. To was translated, adapted, and validate the Health Belief Model instrument for parents of children aged 6–11 years regarding COVID-19 vaccination in the Indonesian language. Cross-cultural translation and adaptation were conducted according to international standards. The instrument testing process, according to Beaton et al., (2020), involves five stages: forward translation, synthesis of the translation results, back translation, review of the back translation, and readability testing. Respondents were purposively selected from the parents of children aged 6–11 years. Face and content validity were achieved for the Indonesian version of Health Belief Model for parents of children aged 6–11 years. The validity of each statement item was assessed using Pearson Correlation with a significance level of 0.05 and 193 respondents, resulting in an r table value of 0.1406. The constructs within the Health Belief Model were deemed valid based on the Pearson Correlation values, as the coefficient values were greater than the r-table value (r > 0.1406; p < 0.05). The constructs in the Health Belief Model were also reliable, with a Cronbach’s alpha value of 0.657. The culturally adapted Indonesian version of the Health Belief Model instrument for parents of children aged 6–11 years regarding COVID-19 vaccination is considered valid and reliable for use in research among the parent population of children aged 6–11 years in the context of COVID-19 vaccination.

ENHANCING PROBLEM-SOLVING SKILLS THROUGH NUMERACY INSTRUMENT DESIGN: INCORPORATING PANDEGLANG’S LOCAL WISDOM IN GEOMETRY CONTENT

Problem solving is a crucial aspect of the education curriculum, as it reflects the skills expected to be possessed by students. Indicating that the majority of students face difficulties in this process. Studies also indicate that numeracy literacy plays a significant role in enhancing mathematical problem-solving skills. This research aims to develop a numeracy literacy assessment that integrates Pandeglang Regency's local knowledge, with a particular emphasis on geometry, to enhance the mathematical problem-solving abilities of Grade IX. This study fits into the Tessmer formative research model, which is related to the category of development research. The study involved 35 ninth-grade students from MTsN 2 Pandeglang as participants. Various tools were used to gather data, such as validation sheets, interview guidelines, and numeracy literacy tests inspired by local knowledge in the Pandeglang Regency. The analysis process included assessing these tools' effectiveness, reliability, and precision through expert assessments and statistical methods. The study's conclusions show that the developed test's quality comprises moderate difficulty for each of the three items, good validity, and satisfactory item discrimination.

Adaptation of Interpersonal Support Evaluation List (ISEL-12) for Mothers of Children Aged 3-6 Years in Indonesian Context

Adaptation of psychological instruments is very important because of differences in culture and context. This study aims to adapt the Interpersonal Support Evaluation List (ISEL-12) in an Indonesian context. Initial steps include back-to-back translation, focus group discussions, expert assessments, and pilot studies. From this procedure, the number of items obtained is 12 which is the original ISEL-12 version, there are five revised items according to the context of cultural groups and parenting activities of mothers with children of early child age (3-6 years). The twelve final questions were tested on 533 mothers with an average age of 34.5 years from several regions in Indonesia. Construct validity tests are performed using EFA and CFA. The analysis showed good validity and reliability (Cronbach's alpha: 0.920) and item loading factors ranging from 0.398-0.816 by showing that the three-factor model was suitable, with values based on RMSEA=0.079, CFI=0.923, TLI=0.911 and GFI=0.918. The conclusion is that ISEL-Ind also has 3 aspects in forming social support for mothers who have children in early childhood, namely, tangible support, belonging support and appraisal support. Keyword: Mother’s; Social Support; ISEL