Item Fit Research Articles

A Psychometric Evaluation of the Dysphagia Handicap Index Using Rasch Analysis.

Background/Objectives: The Dysphagia Handicap Index (DHI) is commonly used in oropharyngeal dysphagia (OD) research as a self-report measure of functional health status and health-related quality of life. The DHI was developed and validated using classic test theory. The aim of this study was to use item response theory (Rasch analysis) to evaluate the psychometric properties of the DHI. Methods: Prospective, consecutive patient data were collected at dysphagia or otorhinolaryngology clinics. The sample included 256 adults (53.1% male; mean age 65.2) at risk of OD. The measure's response scale, person and item fit characteristics, differential item functioning, and dimensionality were evaluated. Results: The rating scale was ordered but showed a potential gap in the rating category labels for the overall measure. The overall person (0.91) and item (0.97) reliability was excellent. The overall measure reliably separated persons into at least three distinct groups (person separation index = 3.23) based on swallowing abilities, but the subscales showed inadequate separation. All infit mean squares were in the acceptable range except for the underfitting for item 22 (F). More misfitting was evident in the Z-Standard statistics. Differential item functioning results indicated good performance at an item level for the overall measure; however, contrary to expectation, an OD diagnosis presented only with marginal DIF. The dimensionality of the DHI showed two dimensions in contrast to the three dimensions suggested by the original authors. Conclusions: The DHI failed to reproduce the original three subscales. Caution is needed using the DHI subscales; only the DHI total score should be used. A redevelopment of the DHI is needed; however, given the complexities involved in addressing these issues, the development of a new measure that ensures good content validity may be preferred.

Piloting Rasch model scoring of the National Eye Institute Visual Function Questionnaire in uveitis

IntroductionThe National Eye Institute Visual Function Questionnaire (NEI VFQ) is a common patient-reported outcome measure (PROM) in uveitis trials. Its psychometric properties using state-of-the-art scoring based on Rasch models, a latent trait model that improves accuracy of PROMs assessment, has not yet been investigated.MethodsThe study participants were recruited online from uveitis patient organizations, where individuals self-reported their uveitis diagnosis and visual acuity level. These participants then completed the NEI VFQ-25. The visual function (VF) and socioemotional (SE) subscales were psychometrically analysed in terms of item fit, targeting, internal consistency, dimensionality, and differential item functioning (DIF), using Rasch models. Criterion validity was examined based on associations between NEI VFQ person measures and recent visual acuity (VA) levels.ResultsNinety-nine participants recruited online from uveitis patient organizations (68 women, 31 men; mean age 50 ± 15 years; 46.5% self-reported receiving systematic therapy for uveitis, 0.6% NEI VFQ-25 missing data) were included. The mean difficulty of items was lower than the average person ability. None of the items demonstrated misfit to an extent that would induce noise into the measurement. The consistency metrics person reliability and person separation index of the subscales were 0.85 and 2.34 (NEI VFQ-VF), 0.86 and 2.52 (NEI VFQ-SE), respectively. There was no evidence of multidimensionality and none of the items showed DIF by gender. The differences between item and person measures were 1.44 (NEI VFQ-VF) and 1.03 (NEI VFQ-SE). NEI VFQ-25 person measures were significantly lower in participants with visual impairment (all p values ≤ 0.007).ConclusionRasch model-based scoring of the re-engineered NEI VFQ-25 demonstrates acceptable internal consistency, item fit and construct validity for assessing two key domains of quality of life in individuals self-reporting uveitis. The PROM was targeted at a higher level of difficulty than present in our heterogeneous sample.

Development and validation of the Dermatology Social Comparison (DSC) Scale.

Social comparison, the process of evaluating one's characteristics in relation to others, influences individuals' self-perception and behavior. However, instruments are scarce for assessing social comparison in the medical setting. Our aim was to develop and validate a new scale for assessing social comparison. Seven statements were developed, encompassing the perceived normality of having rashes, the tendency to compare their situation with others, and the emotional response when seeing someone better or worse off than themselves. The instrument was piloted in 15 patients for readability and face validity, then prospectively validated using modern psychometric methods in 1,053 adult patients with eczema or psoriasis from three tertiary dermatological centers in Singapore. Of 1,053 adult patients, 802 (76.2%) had eczema, and 251 (23.8%) had psoriasis. Exploratory factor analysis (using a 70% sample split) showed a single factor model comprising three questions (Eigenvalue: 1.4). Confirmatory factor analysis with the remaining 30% of the sample confirmed an excellent model fit. Cronbach's alpha was 0.7, and inter-item correlations ranged from 0.42 to 0.46. In the Rasch analysis, item fit statistics and item characteristic curves showed appropriate discrimination between response options, although reliability was suboptimal with a person separation reliability of 0.63. Comprising 3 questions, the newly derived social comparison scale showed acceptable psychometrics as a measure of social comparison for clinical and research purposes in dermatology. Its brief nature likely results from its brevity and applicability to conditions beyond eczema and psoriasis, which warrants further investigation.

Examining the Psychometric Properties of the Czech Versions of Anti-Fat Attitudes Questionnaire (AFA) and Beliefs About Obese Persons Scale (BAOP)

Abstract: Purpose: The study aimed to evaluate anti-fat attitudes and beliefs among Czech adolescents and develop a Czech version of the Anti-Fat Attitudes Questionnaire (AFA) and Beliefs About Obese Persons Scale (BAOP). Methods and Participants: A total of 3,345 Czech adolescents aged 11–19 years completed sociodemographics, AFA, and BAOP. Results: The confirmatory factor analysis confirmed a three-factor solution and adequate factor validity for AFA. For BAOP, our data did not support the one-factor solution. The bifactor solution that accounted for the negatively formulated items fit, however, the data well. We also found both questionnaires to be invariant by sex. Age was inversely associated with BAOP and AFA Fear of Fat; higher ages were associated with higher AFA Dislike subscale scores. Girls scored higher on AFA Fear of Fat and boys on Dislike and Willpower. Limitations : Only Czech adolescents were included as participants, which could limit the applicability of the results to other age groups or cultural contexts. Furthermore, the use of self-report measurements introduces the potential for response biases. Conclusion: The Czech versions of both questionnaires demonstrated acceptable psychometric properties, but further research is needed to explore the wording effect for BAOP.

Development of a rapid tool for screening financial toxicity based on the comprehensive score for financial toxicity

ObjectiveThis study aimed to use item response theory (IRT) to develop and validate a short version of the Chinese COmprehensive Score for financial Toxicity (COST-S-C) in patients with cancer. MethodsA total of 500 patients with cancer participated in the survey. Confirmatory factor analysis (CFA) was used to assess the factor structure of the COST-S-C. A two-parameter IRT model was used to examine the item fit of the COST-S-C. Item discrimination, item characteristic curves (ICCs), item information curves (IICs), and item fit were estimated. Differential item functioning (DIF) was assessed for participants’ gender and age. Reliability, convergent and discriminant validity was examined as well as estimating the optimal cut-off points of the COST-S-C. ResultsThe CFA results supported the bi-factor structure of the COST-S-C. The IRT analysis findings revealed that several items showed problems with the ICCs, providing little information in terms of IICs as well as poor discrimination. Item 5 showed a negligible DIF problem with age. A valid 3-item COST-S-C scale and its optimal cut-off point was developed. ConclusionsThe COST-S-C is a valid and quick screening tool used to distinguish patients with cancer who report significant financial toxicity in various medical settings.

Psychometric evaluation of the Decision Support System (DSS) for municipal nurses encountering health deterioration among older adults

BackgroundA valid and reliable tool is crucial for municipal registered nurses (RNs) to make quick decisions in older adults who show rapid signs of health deterioration. The aim of this study was to investigate the psychometric properties of the Decision Support System (DSS) among older adults in the municipal healthcare system.MethodsFirstly, we utilized the Rasch dichotomous model to analyze the DSS assessments (n=281) that were collected from municipal RNs working with older adults in the municipal healthcare system. We examined the properties of the DSS in terms of its unidimensionality, item fit, and separation indices. Secondly, to investigate inter-rater agreement in using the DSS, four experienced municipal RNs used the DSS to assess 60 health deterioration scenarios presented by one human patient simulators. The 60 DSS assessments were then analyzed using the ICC (2,1), percentage agreement, and Cohen κ statistics.ResultsThe sample of older adults had a mean age of 82.8 (SD 11.7). The DSS met the criteria for unidimensionality, although two items did not meet the item fit statistics when all the DSS items were analyzed together. The person separation index was 0.47, indicating a limited level of separation among the sample. The item separation index was 11.43, suggesting that the DSS has good ability to discriminate between and separate the items. At the overall DSS level, inter-rater agreements were good according to the ICC. At the individual DSS item level, the percentage agreements were 75% or above, while the Cohen κ statistics ranged from 0.46 to 1.00.ConclusionsThe Rasch analysis revealed that the psychometric properties of the instrument were acceptable, although further research with a larger sample size and more items is needed. The DSS has the potential to assist municipal RNs in making clinical decisions regarding health deterioration in older adults, thereby avoiding unnecessary emergency admission and helping to alleviate emergency department overcrowding.

Spanish validation of the short version of the racing and crowded thoughts questionnaire (RCTQ-13)

BackgroundThe Racing and Crowded Thoughts Questionnaire (RCTQ-13) is the most widely used specific scale for the measurement of racing thoughts, but there is currently no Spanish version that allow the evaluation in Spanish-speaking patients. The objective of this study is to translate, adapt, and validate the RCTQ-13 in a Colombian population with affective disorders.MethodsThe questionnaire was translated and back-translated, and corrections were implemented following a pilot test to improve comprehensibility. We included patients with Bipolar I Disorder and with Major depressive disorder seen in three centers in the city of Medellín, Colombia. We evaluate structural validity with confirmatory factor analysis, internal consistency, and test-retest reliability. Construct validity was also assessed with the comparison between euthymic, maniac, and depressive episodes and the correlation with worry, rumination, and mania scales. Responsiveness was measured 1 month after the first evaluation. Based on item response theory (IRT), we also estimated item difficulty, discrimination, and fit using a generalized partial credit model.ResultsTwo hundred fifty subjects were included. Confirmatory factor analysis revealed that the three-factor structure of the scale was appropriate. Internal consistency was adequate for the entire scale (Cronbach’s alpha = 0.95, 95% CI: 0.94-0.96) and for each factor. Test-retest reliability was good (intraclass correlation coefficient = 0.82, 95%IC: 0.70-0.88). For construct validity, we observed differences between patients with different types of affective episodes, a moderate positive correlation with the Penn State Worry Scale (r = 0.55) and the Ruminative Response Scale (r = 0.42), and a low negative correlation with the Young Mania Rating Scale (r = − 0.10). Responsiveness was proved to be adequate. Under IRT, the response thresholds for the response options are organized for all items. The infit was adequate for all items and the outfit was acceptable.ConclusionsThe Spanish version of the RCTQ-13 is a reliable, valid, and responsive scale and can be used for the clinical assessment of the construct of racing and crowded thoughts in patients with the spectrum of affective disorders in whom this experience can be expressed with different nuances. Further research is needed to expand the relationship with rumination and worry.

A Survey on Fashion AR using Hand Gesture

Fashion AR using hand gestures is a dynamic fusion of technology and style that is reshaping the fashion industry. This innovative concept employs augmented reality and gesture recognition to enable users to virtually try on clothing and accessories, fostering a highly interactive and personalized shopping experience. By making intuitive hand movements, users can mix and match outfits, visualize how different styles complement their unique body shapes.Through the use of computer vision and gesture recognition, individuals can effortlessly navigate and manipulate digital wardrobes. By employing intuitive hand gestures, users can select, mix, and match virtual outfits, enabling them to experiment with diverse styles and discover their unique fashion preferences. This interactivity not only fosters a greater sense of engagement with fashion but also reduces the uncertainties associated with online shopping by providing a more accurate representation of how different clothing items fit and look on one's body.Furthermore, this technology is reshaping the landscape of fashion retail. It reduces the need for physical store visits, making shopping more convenient and accessible while minimizing the environmental footprint of the industry. AR fashion with hand gestures is an exciting and promising development that promises to democratize fashion, encourage sustainability, and redefine the way we express ourselves through clothing and accessories. Keywords - Virtual Try, Unity, Augmented Reality, image processing, hand gestures

A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses.

Language proficiency assessments are pivotal in educational and professional decision-making. With the integration of AI-driven technologies, these assessments can more frequently use item types, such as dictation tasks, producing response features with a mixture of discrete and continuous distributions. This study evaluates novel measurement models tailored to these unique response features. Specifically, we evaluated the performance of the zero-and-one-inflated extensions of the Beta, Simplex, and Samejima's Continuous item response models and incorporated collateral information into the estimation using latent regression. Our findings highlight that while all models provided highly correlated results regarding item and person parameters, the Beta item response model showcased superior out-of-sample predictive accuracy. However, a significant challenge was the absence of established benchmarks for evaluating model and item fit for these novel item response models. There is a need for further research to establish benchmarks for evaluating the fit of these innovative models to ensure their reliability and validity in real-world applications.

Attitudes towards technology and their relationship with pro-environmental behaviour: Development and validation of the GATT scale

Both behavioural changes and technological advances are needed to mitigate climate change and solve environmental issues. While optimistic attitudes towards technology can help to increase public support for these technological advances, they could also attenuate the perceived necessity for pro-environmental behaviour change. This is problematic, as an overreliance on technological solutions at the cost of behavioural changes could decrease the probability of meeting established climate change mitigation targets. Across three studies in Switzerland (n1 = 552, n2 = 547, n3 = 549), we introduce and validate a 15-item survey instrument to measure general attitudes towards technology (GATT), namely techno-pessimistic, techno-optimistic, and techno-fix attitudes. Confirmatory factor analysis confirms the robustness of the instrument and models based on Item Response Theory indicate acceptable item fit indices. We then investigate how these different attitudes relate to pro-environmental behavioural intentions. Our results show that techno-fix attitudes are negatively associated with behavioural intentions, while techno-optimistic and techno-pessimistic attitudes are positively associated with behavioural intentions through an increase in climate change concern. To foster engagement in pro-environmental behaviour, we recommend strengthening techno-optimistic instead of techno-fix narratives, by highlighting the importance of individual behaviour changes for achieving climate change mitigation.

Evaluating the quality of life impact of recurrent urinary tract infection: Validation and refinement of the Recurrent UTI Impact Questionnaire (RUTIIQ).

Recurrent urinary tract infection (rUTI) has significant negative consequences for a wide variety of quality of life (QoL) domains. Without adequate validation and assessment of the unique insights of people living with rUTI, clinical results cannot be fully understood. The Recurrent UTI Impact Questionnaire (RUTIIQ), a novel patient-reported outcome measure of rUTI psychosocial impact, has been robustly developed with extensive patient and clinician input to facilitate enhanced rUTI management and research. This study aimed to confirm the structural validity of the RUTIIQ, assessing its strength and bifactor model fit. A sample of 389 adults experiencing rUTI (96.9% female, aged 18-87 years) completed an online cross-sectional survey comprising a demographic questionnaire and the RUTIIQ. A bifactor graded response model was fitted to the data, optimizing the questionnaire structure based on item fit, discrimination capability, local dependence, and differential item functioning. The final RUTIIQ demonstrated excellent bifactor model fit (RMSEA = 0.054, CFI = 0.99, SRMSR = 0.052), and mean-square fit indices indicated that all included items were productive for measurement (MNSQ = 0.52-1.41). The final questionnaire comprised an 18-item general "rUTI QoL impact" factor, and five subfactor domains measuring "personal wellbeing" (three items), "social wellbeing" (four items), "work and activity interference" (four items), "patient satisfaction" (four items), and "sexual wellbeing" (three items). Together, the general factor and five subfactors explained 81.6% of the common model variance. All factor loadings were greater than 0.30 and communalities greater than 0.60, indicating good model fit and structural validity. The 18-item RUTIIQ is a robust, patient-tested questionnaire with excellent psychometric properties, which capably assesses the patient experience of rUTI-related impact to QoL and healthcare satisfaction. Facilitating standardized patient monitoring and improved shared decision-making, the RUTIIQ delivers the unique opportunity to improve patient-centered care.

Validation of the satisfaction with life scale for Korean older adults using item response theory.

As Korea is rapidly becoming an aging society, people are increasingly interested in the life satisfaction of the older adults. Therefore, the need for a tool that can precisely measure the life satisfaction of the older adults in Korea is also increasing. In this study, SWLS, which has been widely used to measure life satisfaction, was applied to Korean older adults. This study analyzed the life satisfaction of the older adults using item response theory that can supplement the limitations of existing research methods. Data from 3543 older adults who responded to the 2021 Korean Happiness Survey. As a result of the analysis, it was found that the goodness of fit of item 5 exceeded the standard value, and item 4 functioned differentially between the young-old and old-old. Based on the results of this study, it presented an empirical basis for the application of SWLS to the older adults.

Comparing learning outcomes of two collaborative activities on random genetic drift in an upper-division genetics course

Abstract Background Random genetic drift is a difficult concept for biology undergraduates to understand. Active learning activities in a collaborative setting have the potential to improve student learning outcomes compared to traditional lectures alone and have been shown to help foster success for underrepresented students. However, few activities in this content area have been evaluated for effectiveness in improving student outcomes using peer-reviewed instruments backed by evidence of their validity and reliability. Our aim in this study was to use the Genetic Drift Instrument (GeDI) to evaluate and compare student learning gains in an upper division genetics course in which two different genetic drift activities, a faculty-developed collaborative exercise and a commercially published lab tutorial, were administered in an active-learning classroom with students working in small groups. Methods The GeDI was administered in both pre- and post-testing in two semesters (n = 95 and 98 students), with the semesters differing in which activity was assigned. Instrument dimensionality, person and item fit, and reliability were evaluated using Rasch analysis. Hierarchical Linear Models (HLMs) with two-way interactions were fitted to assess whether being in a certain Intervention Type, Race/ethnicity, Gender, or First Generation Status affected learning gains. HLMs with three-way interactions were used to assess whether the activities benefited students of all backgrounds equivalently. Results We found that the GeDI demonstrated unidimensionality, with high item reliability and relatively low person reliability, consistent with previous studies. Both the faculty-developed activity and the commercially available lab tutorial were associated with significant learning gains on genetic drift concepts. Students in the SimBio group had higher learning gains but the difference in effect size was small. No significant differences in learning gains were found between students from different demographic groups, and both activities appeared to benefit students of different backgrounds equivalently. Conclusions The GeDI instrument could be improved by adding items that more consistently differentiate students of different ability levels, especially at high ability levels. The greater impact on learning gains in the SimBio group while statistically significant does not translate into actual meaningful differences in student understanding. While students of different background variables in the sample have equivalent learning gains and are benefitted equivalently by the different interventions, our interventions did not ameliorate inequities in genetic drift understanding as measured by the GeDI that were uncovered in pre-testing.

Development of the What Matters 2 Adults (WM2A) wellbeing measure for Aboriginal and Torres Strait Islander adults

PurposeAs wellbeing is culturally bound, wellbeing measures for Aboriginal and Torres Strait Islander peoples must be culturally relevant and grounded in Aboriginal and Torres Strait Islander values and preferences. We describe the development of a nationally-relevant and culturally grounded wellbeing measure for Aboriginal and Torres Strait Islander adults: the What Matters to Adults (WM2A) measure. MethodsWe used a mixed methods approach to measure development, combining Indigenist methodologies and psychometric methods. Candidate items were derived through a large national qualitative study. Think-aloud interviews (n = 17) were conducted to assess comprehension, acceptability, and wording of candidate items. Two national surveys collected data on the item pool (n = 312, n = 354). Items were analysed using exploratory factor analysis (EFA), and item response theory (IRT) to test dimensionality, local dependence and item fit. A Collaborative Yarning approach ensured Aboriginal and Torres Strait Islander voices were privileged throughout. ResultsFifty candidate items were developed, refined, and tested. Using EFA, an eight factor model was developed. All items met pre-specified thresholds for maximum endorsement frequencies, and floor and ceiling effects; no item redundancy was identified. Ten items did not meet thresholds for aggregate adjacent endorsement frequencies. During Collaborative Yarning, six items were removed based on low factor loadings (<0.4) and twelve due to conceptual overlap, high correlations with other items, endorsement frequencies, and/or low IRT item level information. Several items were retained for content validity. The final measure includes 32 items across 10 domains (Balance & control; Hope & resilience; Caring for others; Culture & Country; Spirit & identity; Feeling valued; Connection with others; Access; Racism & worries; Pride & strength). ConclusionsThe unique combination of Indigenist and psychometric methodologies to develop WM2A ensures a culturally and psychometrically robust measure, relevant across a range of settings and applications.

Development & psychometrics of the SOLID-S – An inventory assessing software security culture in software development companies

Software security is a crucial requirement for most of the software used nowadays. Besides specialized knowledge of engineers and developers, organizational culture can contribute to software security to a great extent if specific cultural dimensions are in alignment with security. The purpose of this study is to develop and evaluate the SOLID-S, a six-dimensional inventory assessing this type of software security culture in software development companies. We present the iterative test development process of the inventory and examine its psychometric properties in an empirical study with N=327 participants by means of Item Response Theory. We identify the SOLID-S to have appropriate measurement qualities in terms of accuracy, fairness across subgroups, item fit and dimensionality. Results suggest that the inventory's subscales comply with the Partial Credit Model and, hence, raw sum scores of the subscales can be interpreted reliably. The SOLID-S can therefore be used for research, as a starting point for organizational change programs, or to evaluate the effectiveness of interventions aiming to improve security culture.

Adapting a self-efficacy scale to the task of teaching scientific reasoning: collecting evidence for its psychometric quality using Rasch measurement.

Besides teachers' professional knowledge, their self-efficacy is a crucial aspect in promoting students' scientific reasoning (SR). However, because no measurement instrument has yet been published that specifically refers to self-efficacy beliefs regarding the task of teaching SR, we adapted the Science Teaching Efficacy Belief Instrument (STEBI) accordingly, resulting in the Teaching Scientific Reasoning Efficacy Beliefs Instrument (TSR-EBI). While the conceptual framework of the TSR-EBI is comparable to that of the STEBI in general terms, it goes beyond it in terms of specificity, acknowledging the fact that teaching SR requires very specific knowledge and skills that are not necessarily needed to the same extent for promoting other competencies in science education. To evaluate the TSR-EBI's psychometric quality, we conducted two rounds of validation. Both samples (N1 = 114; N2 = 74) consisted of pre-service teachers enrolled in university master's programs in Germany. The collected data were analyzed by applying Rasch analysis and known-group comparisons. In the course of an analysis of the TSR-EBI's internal structure, we found a 3-category scale to be superior to a 5-category structure. The person and item reliability of the scale proved to be satisfactory. Furthermore, during the second round of validation, it became clear that the results previously found for the 3-category scale were generally replicable across a new (but comparable) sample, which clearly supports the TSR-EBI's psychometric quality. Moreover, in terms of test-criterion relationships, the scale was also able to discriminate between groups that are assumed to have different levels of self-efficacy regarding teaching SR. Nonetheless, some findings also suggest that the scale might benefit from having the selection of individual items reconsidered (despite acceptable item fit statistics). On balance, however, we believe that the TSR-EBI has the potential to provide valuable insights in future studies regarding factors that influence teachers' self-efficacy, such as their professional experiences, prior training, or perceived barriers to effective teaching.

Making it Short: Shortening the Comprehensive Inventory of Mindfulness Experiences Using Ant Colony Optimization

ObjectivesThe Comprehensive Inventory of Mindfulness Experiences (CHIME) comprises 37 items over eight domains and was validated in German and English languages using Rasch methodology. However, the length of the scale might limit its application due to the response burden it places on participants, especially in studies that examine additional constructs. This study aimed to develop a short but comprehensive CHIME version using cutting-edge methodology.MethodAnt colony optimization was applied to optimize and reduce item content of individual CHIME facets and create 24-item (CHIME-S) and 16-item (CHIME-XS) versions. We used data collected in New Zealand (n = 512), and in the USA, which included two independent samples (n = 605 and n = 210). The construct validity of the newly developed CHIME-S and CHIME-XS was established by correlating its scores with measures of mindfulness, affect, and distress.ResultsOverall, the ant-colony algorithm identified a stable solution which included 3 best fitting items per facet CHIME short form (CHIME-S) and the 2 best-fitting items CHIME-XS (16 items). This solution was successfully replicated across all samples and the scale demonstrated acceptable confirmatory factor analysis fit and good internal consistency, and correlated with measures of mindfulness, distress, and affect in expected directions.ConclusionsThe CHIME-S and CHIME-XS are reliable and valid short-scale versions that can be used for assessment of total mindfulness and its facets in a comprehensive way. Future research efforts are invited to validate the CHIME-S and CHIME-XS across different cultures and sample populations, aiming at establishing robustness of the measure.

Antibiotic knowledge assessment questionnaire in undergraduate pharmacy students: A Rasch analysis of validity evidence

Background: Antibiotic knowledge is crucial for undergraduate pharmacy students who are future healthcare professionals. However, a valid and reliable instrument to assess their knowledge is scarce. This study aimed to develop and validate an Antibiotic Knowledge Assessment Questionnaire (AKAQ). Methods: The AKAQ had three domains and 29 items, encompassing general antibiotic knowledge, antibiotic resistance, and antibiotic stewardship. Rasch analysis was used to assess psychometric properties, including validity parameters (item and person fit and structural validity), reliability (person and item reliability, Cronbach’s Alpha value), item-person interaction, and item bias, using differential item functioning (DIF) based on tems. Results: This study included 500 undergraduate pharmacy students from 90 Indonesian universities. The validity of the questionnaire was demonstrated, except for one item. Person means infit and outfit for MNSQ were 1.02 and 0.95, whereas ZSTD were 0.11 and 0.08, respectively. Items means infit and outfit for MNSQ were 1.01 and 0.96, while ZSTD were 0.11 and -0.23. Item and person reliabilities were acceptable at 0.99 and 0.68. Cronbach’s alpha reliability was acceptable at 0.71. Two items were biased by term. Conclusion: The AKAQ is a valid, reliable, and standard instrument for assessing the antibiotic knowledge levels of undergraduate pharmacy students.

Cognitive load scale in learning formal definition of limit: A rasch model approach

Constructing proofs for the limit using the formal definition induces a high cognitive load. Common assessment tools, like cognitive load scales, lack specificity for the concept of limits. This research aims to validate an instrument tailored to assess cognitive load in students focused on the formal definition of limits, addressing the need for diverse strategies in education. The research employs a quantitative survey design with a Rasch model approach, utilizing a data collection instrument in the form of a questionnaire. Subsequently, the data are analyzed by focusing on three aspects: (1) item fit to the Rasch model, (2) unidimensionality, and (3) rating scale. A total of 315 students from three private universities in Banten participated as research respondents. The findings of this study affirm the validity of the cognitive load scale centered on the formal definition of limit, meeting the stringent standards set by Rasch modeling. Additionally, the results of the study provide evidence of the scale’s adherence to the monotonic principle of the Rasch model. These outcomes contribute to a comprehensive understanding of cognitive load in the context of learning formal definition of limit, providing a solid foundation for instructional design and assessment strategies.

Assessing the Performance of a Nutrition Knowledge Questionnaire With a Low Socioeconomic Status Population Using Rasch Analysis.

Parents and preschool teachers play a key role in shaping children's dietary behaviors. Knowledge of nutrition and healthy dietary choices is a key component to improve dietary habits and reduce the prevalence of obesity and associated co-morbidities. Using valid and reliable instruments is necessary for accurate assessment of knowledge to tailor interventions and measure effectiveness specific to the population of interest. The objectives of this paper are to (1) identify potential gaps in the baseline nutrition knowledge among parents and teachers using a previously validated questionnaire prior to a preschool obesity prevention intervention; and (2) assess the instrument's reliability and construct validity for a low socioeconomic status population using a post hoc Rasch analysis. Participants included 177 parents and 75 teachers who participated in a Head Start intervention study. Knowledge scores, instrument reliability, and item fit and difficulty were assessed using a Rasch analysis; t-tests were used to determine differences in scores between parents and teachers. Parents answered 38% of questions correctly while teachers correctly answered 46% of the questions. Adequate item fit and reliability were indicated for Sections 1 and 2 of the Nutrition Knowledge Questionnaire (NKQ). Section 3 demonstrated less adequate reliability. The items were found to adequately and reliably define the unidimensional measures of the three components of knowledge represented in this instrument, providing evidence of construct validity. However, Rasch measures indicated the NKQ overall was difficult for participants. Recommendations for improving the instrument for nutrition education/intervention and research practice areas related to obesity and obesity-related conditions are addressed.