Validity Of Items Research Articles

Mapping design stages and methodologies for developing STEM concept inventories: a scoping review

BackgroundConcept inventories (CIs) have become widely used tools for assessing students’ learning and assisting with educational decisions. Over the past three decades, CI developers have utilized various design approaches and methodologies. As a result, it can be challenging for those developing new CIs to identify the most effective and appropriate methods and approaches. This scoping review aimed to identify and map key design stages, summarize methodologies, identify design gaps and provide guidance for future efforts in the development and validation of CI tools.MethodsA preliminary literature review combined theoretical thematic analysis (deductive, researcher-driven) focusing on specific data aspects, and inductive thematic analysis (data-driven), using emerging themes independent of specific research questions or theoretical interests. Expert discussions complemented the analysis process.ResultsThe scoping review analyzed 106 CI articles and identified five key development stages: define the construct, determine and validate content domain; identify misconceptions; item formation and response processes design; test item selection and validation; and test application and refinement. A descriptive design model was developed using a mixed-method approach, incorporating expert input, literature review, student-oriented analysis, and statistical tests. Various psychometric assessments were employed to validate the test and its items. Substantial gaps were noted in defining and determining the validity and reliability of CI tools, and in the evidence required to establish these attributes.ConclusionThe growing interest in utilizing CIs for educational purposes has highlighted the importance of identifying and refining the most effective design stages and methodologies. CI developers need comprehensive guidance to establish and evaluate the validity and reliability of their instruments. Future research should focus on establishing a unified typology of CI instrument validity and reliability requirements, as well as the types of evidence needed to meet these standards. This effort could optimize the effectiveness of CI tools, foster a cohesive evaluation approach, and bridge existing gaps.

Pengaruh Stres Kerja, Pengembangan Karir dan Kepribadian terhadap Komitmen Organisasional: Studi pada RSUD Dr. Gondo Suwarno Ungaran Kabupaten Semarang

The research aims to analyze the influence of work stress, career development and personality on organizational commitment at RSUD Dr. Gondo Suwarno Ungaran, Semarang Regency. The type of data used is primary data, namely data obtained directly from original sources in the form of questionnaires. The population of this study were employees at RSUD Dr. Gondo Suwarno Ungaran. Sampling was carried out using a purposive sampling technique, namely a sampling technique using certain criteria, so that a sample of 315 respondents was obtained. The data collected was analyzed using factor analysis to test the validity of the question items, test reliability using Cronbach Alpha, and test hypotheses using multiple linear regression. The research results show that the work stress variable has no effect on organizational commitment, the career development variable has a positive and significant effect on organizational commitment, and the personality variable has a positive and significant effect on organizational commitment.

Cultural adaptation and validation of the Sinhala version of the spiritual needs assessment for patients (S-SNAP) questionnaire

BackgroundSpiritual support for patients and caregivers of critically ill patients is associated with improved quality of life. This aspect, however, is not incorporated into the current care pathways in Sri Lanka. The Spiritual Needs Assessment for Patients (SNAP) questionnaire, comprised of 3 domains: psychosocial, spiritual and religious, gives a platform for clinicians to assess the spiritual needs of those patients. This study presents the results of validation of the Sinhala version of the SNAP (S-SNAP) questionnaire.MethodsThe SNAP was translated from English to Sinhala using the standard forward and backward translation process. After verifying the content validity, unambiguity and clarity of items in a focused group discussion, and a pilot study, the pre-final version was tested among 267 volunteers with cancer selected from three state-run cancer care institutions. Data were analysed for internal consistency and item-total correlations. Factor analysis was done using Varimax rotation with Kaiser normalization. A Scree plot was also made to determine the number of factors.ResultsThe mean (SD) age of subjects was 63.2 (11.4) years. The total S-SNAP score ranged from 22 to 88 (maximum 88). The overall Cronbach’s alpha was 0.94 while item-total correlations varied from 0.26 to 0.87. Total SNAP score showed inverse correlations with age, Charleson Comorbidity index and Barthel index while a positive correlation was seen with the Karnofsky performance status scale (p < 0.05). Kaiser-Meyer-Olkein value of 0.92 (P = < 0.001) for Bartlett’s test indicated adequate sampling and non-linearity of factors. The scree plot showed a four-factor structure explaining 76% variation. Meaning of life and relationship with a supernatural being and religious rituals are loaded as 2 different factors. Worries, fears and forgiveness are grouped as the third factor while relaxation, coping and sharing feelings are loaded separately.ConclusionsThe S-SNAP is a reliable and valid tool to assess spiritual suffering among patients with cancers conversant in the Sinhala language.

Development of Assessment Instruments with a Contextual Approach to Determine the Profile of Conservation Education and Learning Independence on Biodiversity

Conservation education is one of the noble values that must be preserved and students can maintain the sustainability of biodiversity around them. This study aimed to develop an assessment instrument to determine the profile of conservation education and learning independence on biodiversity. This type of research is R D with a 4-D model. The population of the study is all students of grade 10 of State Senior High School 1 Godean and the samples used are grade 10D and 10F. The data collection technique used a five-question essay instrument sheet to determine conservation education and a Guttman scale questionnaire instrument to determine learning independence. The analysis technique used descriptive quantitative and qualitative. The results of this study were that the instrument was said to be good with revisions according to the construct validator. The validity of the question items showed that the essay questions were said to be valid, reliable, had a discriminatory power between good enough, and the difficulty level ranged from easy to moderate according to the empirical validator. The value of students' conservation education fell into the good category with a complete value achievement of 73%. Students' learning independence is also classified as very high, because all indicators are dominated by very high indicators. These results indicate that the profile of conservation education and learning independence of students at State Senior High School 1 Godean is classified as good and very high

Strengthening the Multiple-Choice Assessment: Improving Item-Writing Skills of Physician Assistant Educators.

Physician assistant (PA) educators are tasked with the challenging privilege of ensuring future PAs are knowledgeable and competent to practice medicine. Most enter academia without formal education in providing education. They learn as they go-a treacherous and steep learning curve. This study provides PA educators literature and skills to bolster the strength and validity of multiple-choice examination items to measure learner progress and identify knowledge gaps. Skills can be improved at the level of the individual educator and program or institution. Approaching item writing and item revision in a stepwise, evidence-based manner can improve the quality of the items, strengthening multiple-choice examinations. This process can yield improved assessments of students' medical knowledge and competence. This study aims to provide the PA educator with techniques to improve their item-writing skills.

Development and reliability and validity testing of a medication literacy scale for medical college students

BackgroundIrrational drug use has become a global problem threatening human health. As future health professionals, medical college students’ medication literacy (ML) is critical. Their mastery of medication-related knowledge will directly affect public medication safety in the future.MethodsThe initial scale was developed through a literature review and was modified through expert consultation and student interviews to form the initial scale with 14 items. In 2020, a questionnaire survey was conducted among students in a medical college for item analysis, reliability test, validity test and other analyses.ResultsThe total Cronbach’s α coefficient was 0.826 and split-half reliability was 0.852. The Cronbach’s α coefficients for functional medication literacy, communicative medication literacy, and critical medication literacy were 0.901, 0.858, and 0.851, respectively. The item-level content validity index (I-CVI) ranged from 0.833 to 1.000 (≥ 0.78). Factor analysis of 14 items showed that KMO = 0. 852(> 0.7) and Bartlett’s spherical test p < 0.001, indicating that the data are very suitable for factor analysis. Three principal axis factors were extracted by principal component analysis, and the total variance interpretation rate was 69.031% (> 40%). The confirmatory factor analysis identified a three-factor model and showed goodness of fit indices for the scale: The χ²/df = 2.623, The Goodness of Fit Index (GFI) = 0.905, The Comparative Fit Index (CFI) = 0.950, Normed Fit Index (NFI) = 0.922, Tucker-Lewis index (TLI) = 0.938, and The Root Mean Square Error of Approximation (RMSEA) = 0.078.ConclusionA new scale for evaluating the medication literacy of Chinese medical college students was preliminarily developed, demonstrating good reliability and validity. Itcan be used as a preliminary measurement tool for assessing medical students’ medication literacy. However, due to the limitations of this study, the practical application of the scale needs to be further examined in a larger sample and should be refined in future studies.

Validity and reliability of the physical fitness test instrument for retired martial art athletes

Background and Study Aim. Developing exercise programs to maintain the fitness and health of retired athletes is crucial as a preventive measure against common health problems in this population. Equally important is the creation of an exercise evaluation tool to assess the effectiveness of these programs. This study aims to test the validity and reliability of a physical fitness test instrument for retired martial arts athletes. Material and Methods. This study used an evaluation approach with data collected through tests and measurements. A total of 147 subjects participated. For validity testing, there were 35 retired male martial arts athletes and 37 retired female athletes. For reliability testing, there were 36 retired male and 39 retired female martial arts athletes. The instruments used included body mass index (BMI) measurements with digital scales, flexibility measurements with the sit-and-reach test, muscle strength measurements with a leg and back dynamometer, and cardiovascular endurance measurements with the Cooper test. Validity was assessed using a concurrent validity approach. Reliability was tested using the test-retest method. The Pearson product-moment correlation was used for validity analysis, while Cronbach's alpha was used to assess reliability. The JASP software was used for the analysis. Results. For male athletes, the r-values for each test item exceeded the r-table value of 0.275, confirming the validity of the body mass index (BMI), sit-and-reach test, leg and back dynamometers, and the Cooper test. Similarly, female athletes demonstrated r-values above the r-table value of 0.267, confirming the validity of all test items. The reliability of each item was confirmed by Cronbach’s alpha values, which were above the 0.7 threshold for both male and female athletes. The Cronbach's alpha value for BMI was 0.998 for both male and female athletes, indicating excellent reliability. Other test items, such as flexibility and muscle strength, also showed strong reliability, with Cronbach’s alpha values ranging from 0.742 to 0.985. Conclusions. The study highlights the importance of developing valid and reliable instruments to assess the physical fitness of retired martial arts athletes. Such instruments are essential for monitoring the effectiveness of training programs aimed at maintaining the health and fitness of retired athletes. The findings of this research confirm the value of structured fitness tests. These tests effectively evaluate key physical components such as body composition, flexibility, muscle strength, and cardiovascular endurance.

Are you really satisfied in life? Developing a scale on life satisfaction

Purpose This study attempted to measure life satisfaction and developed a scale to measure its dimensions with the required psychometric properties (validity and reliability). In today’s scenario, organizations are focusing on life satisfaction by helping employees to maintain their work-life balance. Therefore, this paper aims to develop a robust scale of life satisfaction. Design/methodology/approach The methodology consists of three broad stages: item generation, scale development, and validity. Using the sample of 198 working executives, this study used the exploratory factor analysis (EFA) and concluded the four dimensions of life satisfaction: work satisfaction, family satisfaction, societal satisfaction and self-satisfaction. Findings The results provide academicians and practitioners with new insight and dimensions of life satisfaction. The result of this study shows that life satisfaction has societal satisfaction, family satisfaction, job satisfaction and self-satisfaction dimensions. Practical implications This study will provide practitioners with new dimensions to measure life satisfaction. They can help employees achieve life satisfaction across four different factors. This will enable more employee satisfaction, an increase in retention rate and an increase in employee performance. Furthermore, this study provides implications from a policy perspective to design the business policy by considering life satisfaction as an important part of formulating and implementing human resource policies. Originality/value This study is unique in terms of exploring the dimensions of life satisfaction in a structured manner and establishing the psychometric properties as construct, content, and criterion validity along with reliability. This scale can be further used in future research to measure the life satisfaction construct.

The Effect of Using Open the Box Type Wordwall Educational Game on Students' IPAS Cognitive Learning Outcomes

The purpose of this study was to determine whether there is an effect of using the open the box type wordwall educational game on the cognitive learning outcomes of IPAS students at SDN Palumbonsari 1, East Karawang District. This study used a quantitative method of pre-experiment type with a one group pretest posttest design. The population in this study were all fourth grade students of SDN Palumbonsari 1, totaling 135 people. The sampling technique used purposive sampling technique, so the sample in this study was class IV A with a total of 46 people. Data collection techniques using multiple choice tests as many as 30 items before and after treatment. Then carried out feasibility testing with validity test obtained 20 valid items, reliability test obtained r11 0.73, differentiator test and difficulty level. Data analysis techniques using descriptive statistical analysis and inferential statistics. Then the statistical hypothesis test was carried out with the paired sample t-test test obtained a Sig (2-tailed) value of 0.001 &lt; 0.05, meaning that H0 was rejected and H1 was accepted. So it can be concluded that there is an effect of using the open the box type wordwall educational game on the cognitive learning outcomes of IPAS students at SDN Palumbonsari 1.

Psychometric properties of the variants of the Chinese UCLA Loneliness Scales and their associations with mental health in adolescents

Loneliness is a pervasive and distressing emotional experience that affects individuals of all ages and can have significant consequences for both physical and mental health. The UCLA Loneliness Scale (UCLA-LS) is widely used to assess the subjective feelings of loneliness, but concerns have been raised about its structure and applicability in diverse cultural contexts. This study analysed the reliability and validity of the five Chinese versions of the UCLA-LS in a representative sample of 2,643 adolescents and young adults with Chinese as their first language in Hong Kong. The results showed high internal consistency across all versions and content validity for most items. Factor analysis revealed a two-factor structure for the longer versions and a unidimensional structure for the shorter versions. However, the fit statistics suggested that the models did not meet good fit criteria, indicating item loading or model specification requires further review. The scales demonstrated strong associations with mental health conditions such as depression and anxiety, as well as psychosocial factors like hopelessness and aggression. Notably, the 8-item version’s total scores were associated with mental health and psychological attributes comparable to those of the 20-item version, suggesting its potential suitability as a screening tool in population settings. Future research is needed to improve the generalisability of these scales to other Chinese populations, particularly for items with lower content validity.

Development and Validation of a Patient-Reported Outcome Measure of the Impact of Chronic Hand Eczema on Health-Related Quality of Life: the Hand Eczema Impact Scale (HEIS).

Chronic Hand Eczema (CHE) is an inflammatory skin disease that causes significant impact on health-related quality of life (HRQoL). The Hand Eczema Impact Scale (HEIS) is a new patient-reported outcome(PRO) measure designed to assess the impact of CHE on key domains of HRQoL. This study aimed to develop and evaluate content and psychometric validity of the HEIS. The HEIS was initially developed on the basis of a literature review and concept elicitation interviews. Qualitative cognitive debriefing interviews (n = 20) were conducted with patients with CHE to assess relevance and understanding of items, response options, and recall period. Psychometric properties (item performance, dimensionality, reliability, validity, responsiveness, and estimation of meaningful change thresholds) were then assessed using data (n = 258) from a phase 2b trial (NCT03683719). Cognitive debriefing confirmed all items were understood and relevant to patients. Inter-item correlations (all > 0.50) and confirmatory factor analysis (factor loadings ≥ 0.80) supported unidimensionality of the HEIS score, and mostly provided support for the HEIS Proximal Daily Activity Limitations (PDAL) score, with only one item loading below the prespecified threshold. Item properties and previous qualitative work supported retaining this item in the total score but removed from the HEIS PDAL domain. Internal consistency (Cronbach's alpha ≥ 0.89) and test-retest reliability (intra-class correlation coefficient ≥ 0.79) results were very strong. Strong correlations with concurrent measures (0.66-0.87) and significant differences between severity groups (p < 0.001) supported construct validity. Large effect sizes for mean change scores in participants that improved and significant differences between groups indicated ability to detect change. Anchor-based analyses supported within-individual responder definitions of ≥ 1.3 points for improvements in both HEIS score and HEIS PDAL score (covering three items) and of ≥ 1.5 points for HEIS embarrassment with the appearance of hands (Emb) score (covering two items). The 9-item HEIS is the first CHE-specific PROmeasure developed and validated according to regulatory guidance for assessment of the impact of CHE on key domains of HRQoL. This article provides evidence of strong content and psychometric validity and shows improvements of ≥ 1.3 points in HEIS score and HEIS PDAL score, and improvements of ≥ 1.5 points in HEIS Emb score represent clinically meaningful, important changes. NCT03683719.

Development and validation of the NCC-BC-A scale to assess patient-reported outcomes for breast cancer patients in China.

The commonly used international patient-reported outcome scales for breast cancer were developed before the advent of multiple targeted therapies and immunotherapies, rendering them potentially insufficient for current clinical practices. Therefore, it is necessary to develop a specific patient-reported outcome scale tailored for breast cancer patients in China to optimize the management model for these patients. A comprehensive literature search was performed in the PubMed, Embase, Wanfang, and CNKI databases to extract dimensions and items for a potential patient-reported outcome scale. The Delphi method was used to modify, add, subtract, and adjust the language of items until the experts reached a consensus on the first draft. This draft was further refined using a cognitive test and a presurvey. The optimized scale was used for a formal survey, and the items were further analyzed and screened using metrics such as the coefficient of variation, correlation coefficient, internal item consistency, factor analysis, reliability, and validity. A total of 10,954 articles were analyzed, and 237 were used to create a pool of 277 patient-reported outcome items. Through two rounds of Delphi expert consultation, the experts' authority coefficients were 0.739 and 0.826. After a cognitive test, several items were adjusted to enhance understanding. Further adjustments were made following a presurvey of 200 advanced breast cancer patients, resulting in a 38-item patient-reported outcomes scale, termed NCC-BC-A. In the national formal survey, 588 advanced breast cancer patients participated. Principal component analysis showed good consistency among the items and sufficient difference between the dimensions. The results were normally distributed with good variation. The Cronbach's α coefficient of the scale was 0.925 and the test-retest reliability was 0.9041. The NCC-BC-A scale has high validity and reliability. It comprehensively considered the characteristics of systemic treatment for breast cancer, and the specific context within China. Its implementation may help clinicians to pay more attention to quality of life of breast cancer patients and to optimize the system for managing this condition.

델파이 기법을 활용한 강의평가 문항 개발 연구: K 대학의 강의평가 사례를 중심으로

Objectives The purpose of this research is to analyze references and previous researches related to lecture evaluation system, and to develop survey items for lecture evaluation system of K universities. Methods To achieve this purpose, the expert panel of professors among K university was formed, and conducted Delphi method from July 1 to December 29, 2023 to develop a measurement tool. Results Through two rounds of item validity verification by three experts, a total of 10 items were extracted. The research findings extracted four items in lecture planning and operation, including class planning, adherence to class time, interaction, and flexibility of the class; three items in lecture content and methods, including the delivery of lecture content, effectiveness of teaching methods, and appropriateness of learning materials; two items in evaluation, including the fairness of evaluation methods and post-evaluation guidance; and one item in lecture satisfaction. Conclusions The result of this research can provides verificated lecture evaluation tools, and suggests that universities should develop validated and reliable evaluation tools for various educational programs including lectures to offer customized curriculum to students.

Tingkat Keterampilan Sosial Siswa Kelas 7 SMP Negeri 15 Yogyakarta Tahun Ajaran 2023/2024

This study aims to determine the level of social skills of 7th grade students of SMP Negeri 15 Yogyakarta in the 2023/2024 school year and to find out the low items to be proposed as guidance topics. This type of research is descriptive quantitative with the subjects in this study are 7th grade students in the 2023/2024 school year. Determination of the sample from the population was carried out using calculations made by Issac and Michel with an error of 10%. Data collection was carried out using a social skills scale with 46 valid items with a Cronbach alpha reliability index of 0.945 which is in the very strong category. The scale is arranged based on 5 (five) aspects, namely cooperation, assertiveness, responsibility, empathy, and self-control. The data analysis technique used descriptive statistics, using the SPSS Ver. 25. With the results, most of the 7th grade students of SMP Negeri 15 Yogyakarta in the 2023/2024 school year have high social skills. The results showed that in 166 students, 35% of students had a very high level of social skills, 55% of students had a high level of social skills, and 10% of students had a moderate level of social skills. There are no low items on the social skills scale that will be proposed as guidance topics.

Electronic Health (eHealth) Literacy and Self-Care Behaviors—Results from a Survey of University Students in a Developing Country

eHealth literacy (eHL) is directly linked to disease prevention, health promotion, and improved healthcare outcomes. The objectives of this study are to assess undergraduate university students’ knowledge and perceived skills of finding, appraising, and applying electronic health information to health-related problems, as well as to assess the association of eHL with physical, psychological, and emotional self-care. Methods: The measurement model, comprising four correlated factors based on the 28 valid items from two reliable and valid tests, the ‘eHealth literacy scale (eHEALS)’ and ‘the self-care assessment tool (SCAT)’, was estimated using confirmatory factor analysis (CFA) among a sample of 1557 undergraduate university students in Pakistan. Results: The mean value of the eHEALS ranges between 2.90 and 3.33, indicating that the majority of the respondents had moderate levels of eHL skills. Female respondents and respondents from urban areas have greater levels of perceived eHL skills compared with their male and rural counterparts. The CFA model fit indices show that the goodness of fit values are acceptable: x2 = 7.727, p = 0.000; RMSEA = 0.065; TLI = 0.930, CFI = 0.936, IFI = 0.936, GFI = 0.890, NFI = 0.928, RFI = 0.920, PGFI = 0.754. Conclusion: Electronic health (eHealth) literacy has a strong positive association with physical, psychological, and emotional self-care. However, perceived eHL skills among undergraduate university students are moderate, making them potentially susceptible to health risks. Implications: Our study has several practical implications. Its findings can be used to devise eHealth literacy programs for developing relevant skills among undergraduate university students based on their identified needs.

A novel approach to measure perceived customer centricity in the passenger airline industry: Index development and validation

This study addresses a significant gap in current research by developing and validating a comprehensive index for measuring perceived customer centricity in the passenger airline industry. The index was derived using a rigorous scale development methodology based on three surveys with a total of 963 participants. The process involved construct definition, item generation, and item validation through exploratory and confirmatory factor analyses. The final measurement index comprises 19 items across four dimensions (Customer Care & Experience, Communication & Product, Sustainability, and Value) and demonstrates strong discriminant and convergent validity, providing a reliable tool for assessing customer perceptions. Therefore, this research introduces the first validated measure of perceived customer centricity specifically designed for the airline industry and offers practical insights for airline managers, enabling them to identify specific areas where customer perceptions fall short and to make targeted improvements. Additionally, the index serves as an alternative to the industry-wide adopted Net Promoter Score (NPS). It extends current literature by providing an industry-specific scale and offers a practical instrument for enhancing customer-centric strategies in real-world applications, thereby fostering long-term, mutually beneficial relationships. Additionally, it provides empirical evidence of the multidimensional nature of customer centricity and offers a validated tool that can be applied in future research to explore customer perceptions and their impact on airline performance, thus satisfying both practical and academic needs.

ChatGPT's quality: Reliability and validity of concept inventory items.

The recent advances of large language models (LLMs) have opened a wide range of opportunities, but at the same time, they pose numerous challenges and questions that research needs to answer. One of the main challenges are the quality and correctness of the output of LLMs as well as the overreliance of students on the output without critically reflecting on it. This poses the question of the quality of the output of LLMs in educational tasks and what students and teachers need to consider when using LLMs for creating educational items. In this work, we focus on the quality and characteristics of conceptual items developed using ChatGPT without user-generated improvements. For this purpose, we optimized prompts and created 30 conceptual items in kinematics, which is a standard topic in high-school level physics. The items were rated by two independent experts. Those 15 items that received the highest rating were included in a conceptual survey. The dimensions were designed to align with the ones in the most commonly used concept inventory, the Force Concept Inventory (FCI). We administered the designed items together with the FCI to 172 first-year university students. The results show that ChatGPT items have a medium difficulty and discriminatory index but they overall exhibit a slightly lower average values as the FCI. Moreover, a confirmatory factor analysis confirmed a three factor model that is closely aligned with a previously suggested expert model. In this way, after careful prompt engineering, thorough analysis and selection of fully automatically generated items by ChatGPT, we were able to create concept items that had only a slightly lower quality than carefully human-generated concept items. The procedures to create and select such a high-quality set of items that is fully automatically generated require large efforts and point towards cognitive demands of teachers when using LLMs to create items. Moreover, the results demonstrate that human oversight or student interviews are necessary when creating one-dimensional assessments and distractors that are closely aligned with students' difficulties.

Utilization of Computer-Based Testing Technology to Optimize Cognitive-Based Assessment Literacy in the Learning of Islamic Elementary School Students

The focus of 21st-century learning is on developing students' critical thinking, real-world application of knowledge, mastery of information technology, communication, and collaboration skills. Therefore, it is important to integrate information technology into the learning process and assessment of learning outcomes. This research aims to explore how Computer-Based Testing (CBT) can enhance the quality of cognitive assessment procedures based on literacy and improve learning evaluations for students at Islamic Elementary School. This study adopted a qualitative case study design and was conducted at Islamic Elementary School Al Wathoniyah 10 East Jakarta in the second semester of the 2023/2024 academic year. The researcher used interviews, observations, and documentation as data collection methods. The findings of this research show that literacy-based cognitive assessment using CBT can optimize the quality of learning evaluation. Teachers and students are accustomed to using information and communication technology devices in learning activities. There are five stages of the procedure in literacy-based cognitive assessment using CBT to optimize the quality of learning evaluation, including the planning stage, item question development stage, validation stage, implementation stage, and evaluation stage. The investigative conducting procedure truly optimizes the quality of learning evaluation. Islamic Elementary School Al Wathoniyah 10 utilizes CBT, which has literacy-based characteristics. CBT used in learning evaluation is equipped with meaningful stimuli and various forms of questions. The questions in CBT are made as similar as possible to the national assessment questions. The educational report results in the 2023 national assessment, especially in the cognitive domain, have shown improvement. The literacy and numeracy skills of students at Islamic Elementary School Al Wathoniyah 10 have achieved good and moderate results. Both have obtained top rankings nationally.

Medication Literacy Test for Older Adults: psychometric analysis and standardization of the new instrument.

Low medication literacy is prevalent among older adults and is associated with adverse drug events. The Medication Literacy Test for Older Adults (TELUMI) was developed and content validated in a previously published study. To evaluate the psychometric properties and provide norms for TELUMI scores. This was a cross-sectional methodological study with older adults selected from the community and from two outpatient services. Descriptive item-analysis, exploratory factor analysis (EFA), item response theory (IRT), reliability, and validity analysis with schooling and health literacy were performed to test the psychometric properties of the TELUMI. The classification of the TELUMI scores was performed using percentile norms. A total of 344 participants, with a mean age of 68.7years (standard deviation = 6.7), were included; most were female (66.6%), black/brown (61.8%), had low schooling level (60.2%) and low income (55.2%). The EFA pointed to the one-dimensional structure of TELUMI. A three-parameter logistic model was adopted for IRT. All items had an adequate difficulty index. One item had discrimination < 0.65, and three items had an unacceptable guessing index (< 0.35) and were excluded. The 29-item version of TELUMI had excellent internal consistency (KR20 = 0.89). There was a positive and strong association between TELUMI scores and health literacy and education level. The scores were classified as inadequate medication literacy (≤ 10.0 points), medium medication literacy (11-20 points), and adequate medication literacy (≥ 21 points). The results suggest that the 29-item version of TELUMI is psychometrically adequate for measuring medication literacy in older adults.

경찰 효과성 측정 및 타당성 연구

The purpose of this study is to identify and validate how police effectiveness, one of the key variables in procedural justice theory, is measured. Police effectiveness is an instrumental measure of whether the police are successful in deterring and solving crime, and some research suggests that the more positively citizens perceive police effectiveness, the more willing they are to cooperate with the police. However, unlike procedural fairness and police legitimacy, the effect of police effectiveness on the dependent variable, police cooperation, is not consistent. For this purpose, we reviewed domestic and foreign studies centered on the police effectiveness variable, and revised and modified the items used in Sunshine &amp; Tyler(2003)'s study to verify their validity. The results of a survey of 539 adult men and women living in Seoul with Korean nationality from October to November 2022 were used in the study, and validity was verified through reliability analysis, exploratory factor analysis, and confirmatory factor analysis. The results of the analysis showed that the eight items used in the study are appropriate tools for measuring police effectiveness. This study is significant in that it validated the validity of a police effectiveness measurement tool, presented a unified standardized questionnaire in Korea, and explored the possibility of its utilization. On the other hand, since the performance of police activities as perceived by citizens is likely to differ by the field of police activities, this study suggests that it is necessary to prepare detailed criteria to appropriately measure it, as well as to conduct future studies such as repeated validation and further development of items with high validity and reliability.