McDonald's Omega Coefficient Research Articles

Desempeño psicométrico del Índice de Bienestar General WHO-5 en adolescentes escolarizados

Antecedentes. El Índice de Bienestar (WHO-5) es un instrumento para medir bienestar general o síntomas depresivos en diferentes contextos y poblaciones. No obstante, el desempeño psicométrico de los instrumentos necesita revisión periódica. Objetivo. Revisar algunos indicadores del desempeño psicométrico del WHO-5, dimensionalidad y consistencia interna, en adolescentes escolarizados de Santa Marta, Colombia. Se diseñó un estudio metodológico en el que participaron 1.462 estudiantes de décimo y undécimo grado de colegios oficiales y privados, quienes diligenciaron el WHO-5. Se incluyeron estudiantes entre 13 y 17 años (M=16,0; DE=0,8), 60,3% de sexo femenino, y 55,3% de décimo grado. Se calculó la consistencia interna mediante los coeficientes de alfa de Cronbach y omega de McDonald y se llevó a cabo un análisis factorial confirmatorio (AFC) para corroborar la dimensionalidad. La consistencia interna mostró valores alfa de y omega de McDonald de 0,82. En el AFC se corroboró la estructura unidimensional del WHO-5 al observarse indicadores de bondad de ajuste dentro de los parámetros esperados (chi cuadrado=34,41; gl=5; p=0,001; RMSEA=0,063 (IC90% 0,044-0,084); CFI=0,988; TLI=0,975 y SRMR=0,018). El WHO-5 muestra alta consistencia interna y estructura unidimensional para la exploración de bienestar general en adolescentes escolarizados. Se necesita corroborar estos hallazgos en poblaciones con otras características demográficas.

Confirmatory Factor Analysis and Internal Consistency of the Suicidal Ideation Scale of the Center for Epidemiological Studies Depression Among Colombian Adolescents.

The current study tested the one-dimensionality of the Center for Epidemiological Studies Depression Scale for Suicidal Ideation (CES-D-SI) and its reliability among high school students in Santa Marta, Colombia. A total of 1,462 tenth and eleventh-grade students from public and private schools completed the CES-D-SI. The students were between 13 and 17 years (M = 16.0, SD = 0.8), 60.3% were female, and 55.3% were in the tenth grade. A confirmatory factor analysis (CFA) was conducted, and the chi-square, root mean square error of approximation (RMSEA), comparative fit index (CFI), Tucker-Lewis index (TLI), and standardized root mean square residual (SRMR) statistics were calculated. The internal consistency of the dimension was calculated using Cronbach's alpha and McDonald's omega coefficients. The results of the CFA were as follows: chi-square = 26.51, df =2, p = .001; RMSEA = .092; 90% confidence interval = .063-.124; CFI = .983; TLI = .950; and SRMR = .019. Cronbach's alpha coefficient was .75, and McDonald's omega coefficient was .77. As conclusions, the scale exhibited a unidimensional structure similar to that in other studies and presented good reliability values. Hence, its use is recommended to screen suicidal ideation in school-aged adolescents in Santa Marta, Colombia.

Validity of the patient health questionnaire-2 (PHQ-2) for the detection of depression in primary care in Colombia

BackgroundThe PHQ-2 is a screening test for major depressive disorder (MDD) derived from PHQ-9, which has shown to be useful in the detection of cases of clinical significance in previous studies. The psychometric properties of PHQ-2 in the Colombian population are unknown. MethodsPHQ-2 were assessed in 243 patients in general medical consultations using the Mini-International Neuropsychiatric Interview (MINI) as the gold standard. Internal consistency, convergent validity and criterion validity were calculated by analyzing the Receptor Operating Characteristics (ROC) and the area under the curve (AUC). ResultsCronbach's alpha and McDonald's omega coefficients were 0.71. Spearman's rho coefficients for correlations with PHQ-9 and HADS-D scores were 0.63 and 0.59 (p<0.01). AUC was 0.89. The optimal cut point was ≥2 with the following indicators: sensitivity 0.87 specificity 0.74; Youden index 0.60; PPV 0.47; NPV 0.95; (LR+) 3.24; (LR-) 0.18 (95% CI 0.09-0.37). Kappa coefficient between PHQ-2 and MINI for depression was .458 and 0.46 for HADS-D. LimitationsSince this study was done with people attending hospital, which could has implications for the prevalence of depression, affecting the validity indicators of the instrument. ConclusionsPHQ-2 show an acceptable test performance in the context of the study. However, the test could yield a considerable amount of false positives that would require specialized evaluation to establish a reliable diagnosis.

Psychometric Testing of the Chinese Version of the Coping and Adaptation Processing Scale-Short Form in Adults With Chronic Illness.

BackgroundAdaptive capacity may serve as an indicator of the individuals’ coping behaviors toward illness management and may contribute to day-to-day living with chronic illness and improved quality of life. Practical and well-constructed instruments for measuring adaptation have not been adequately explored. An English 15-item Coping and Adaptation Processing–Short Form (CAPS-SF) for assessing adaptation has been created and validated in line with the underlying tenets of Coping and Adaptation Processing theory, but there is no applicable Chinese version.MethodsThe CAPS-SF was translated and culturally adapted into simplified Chinese. Among Chinese adults with chronic illness, 81 patients were selected for cultural adaptation and 288 patients were approached for psychometric testing. Content validity was evaluated by an expert panel. Construct validity was tested by confirmatory factor analysis. Concurrent validity and predictive validity were analyzed by Spearman correlation coefficient. Reliability was assessed by internal consistency and test–retest coefficients. Floor/ceiling effect was calculated.ResultsAdequate content validity was ensured by the expert panel. A four-factor structure (resourceful and focused, self-initiated and knowing-based, physical and fixed, and positive and systematic) describing individuals’ coping strategies was identified and verified. Concurrent validity and predictive validity were demonstrated by strong correlations with the confrontation of coping mode (r = 0.46) and a quality-of-life measure (r = 0.58). The McDonald’s omega coefficient of total scale was 0.82. Split-half reliability and test–retest reliability were 0.87 and 0.87. No floor/ceiling effect was present.ConclusionThe Chinese version CAPS-SF is a theoretically based and culturally acceptable instrument with sound psychometric properties. Further studies are advocated to refine its four-factor structure.

Estructura factorial y consistencia interna de la escala de somnolencia de Epworth

Introducción. En comparación con la polisomnografía (PSG), la escala de somnolencia de Epworth (ESE) tiene propiedades clinimétricas limitadas, por tanto es necesario revisar su estructura factorial.Objetivo. Revisar la estructura factorial (dimensionalidad) y la consistencia interna de la ESE en un grupo de pacientes a los que se les realizó PSG en Santa Marta, Colombia.Materiales y métodos. Se realizó una investigación para medir las propiedades clinimétricas de la ESE. La muestra estuvo compuesta por 684 adultos entre 18 y 64 años (media=43.2, desviación estándar=13.4) que habían completado los 8 ítems de dicha escala. 440 eran hombres y 244, mujeres. Para probar la estructura factorial se usó el análisis factorial confirmatorio (AFC) y para computar la consistencia interna, los coeficientes omega de McDonald y alfa de Cronbach.Resultados. La estructura de factores fue unidimensional y explicó el 42% de la varianza. En cuanto al AFC, los coeficientes de bondad de ajuste fueron insatisfactorios: χ²=146.47 (gl=20, p=0.001), RMSEA=0.096 (IC90%: 0.082-0.111), CFI=0.902, TLI=0.863 y SMSR=0.047. Los coeficientes omega de McDonald y alfa de Cronbach fueron ambos de 0.80 (IC95%: 0.78-0.82).Conclusiones. La ESE presentó una estructura unidimensional limitada, por lo que es necesario revisar el constructo de somnolencia excesiva o refinar su estructura factorial, pues es posible que con ello se obtengan mejores indicadores en comparación con el mejor criterio de referencia para diagnosticar somnolencia diurna excesiva.

Análisis factorial confirmatorio del cuestionario de APGAR familiar

IntroductionIn Colombia, the family APGAR questionnaire is often used to evaluate family function. However, there is no confirmatory factor analysis (CFA) to corroborate the proposed one-dimensional structure in Colombian adolescent students. ObjectiveTo perform CFA on the APGAR family questionnaire in high-school students of Santa Marta, Colombia. MethodA total of 1462 students of tenth and eleventh grade of official and private schools completed the family APGAR questionnaire. Students between 13 and 17 years old (M=16.0, SD=0.8) were included, of which 60.3% were female, and 55.3% were tenth grade students. The χ2, RMSEA, CFI, TLI and SMSR were estimated in the CFA. The internal consistency of the dimension was calculated with Cronbach alpha and McDonald omega coefficients. ResultsIn the CFA the indexes were χ2=9.11, df=5, P=.105; RMSEA=.024 (CI90%, .000-.048), CFI=.998, TLI=.996, and SMSR=.009. Cronbach alpha coefficient was .819 and McDonald omega, .820. ConclusionsThe one-dimensional structure of the APGAR family scale is confirmed in high-school students of Santa Marta, Colombia. This questionnaire is reliable and valid for the measurement of family function in school-aged adolescents.

Measurement of Metacognition: Adaptation of Metacognitive State Inventory in Spanish to Mexican University Students

&lt;p style="text-align:justify"&gt;Some of the most important skills of university students is to develop the capacity to resolve problems posed by their communities, which implies that students become independent, autonomous and self-regulated. Also they need to be capable of monitor, asses and modify their learning through their own process of metacognition, this way they can develop the required knowledge and improve their learning. To analyze it, the objective of this research is to evaluate the psychometric properties of the Metacognitive State Inventory in Mexican university students. For this reason, the Metacognitive State Inventory was applied to 908 students. To confirm a second order hierarchy model with four first order factors, confirmatory factor analysis was used (CFA).Four items were eliminated to obtain a better model fit. Internal consistency was accessed through McDonald's omega coefficient. In this way, evidence of the construct validity and reliability of the instrument was provided. The Inventory of the Metacognitive State was correlated with the CEVEAPEU Questionnaire, obtaining significant positive correlations between both instruments, thus providing certainty of convergent validity.&lt;/p&gt;

University Student Engagement Inventory (USEI): Transcultural Validity Evidence Across Four Continents.

Academic engagement describes students’ involvement in academic learning and achievement. This paper reports the psychometric properties of the University Student Engagement Inventory (USEI) with a sample of 3992 university students from nine different countries and regions from Europe, North and South America, Africa, and Asia. The USEI operationalizes a trifactorial conceptualization of academic engagement (behavioral, emotional, and cognitive). Construct validity was assessed by means of confirmatory factor analysis and reliability was assessed using Cronbach’s alpha and McDonald’s omega coefficients. Weak measurement invariance was observed for country/region, while strong measurement invariance was observed for gender and area of graduation. The USEI scores showed predictive validity for dropout intention, self-rated academic performance, and course approval rate while divergent validity with student burnout scores was also evident. Overall, the results indicate that the USEI can produce reliable and valid data on academic engagement of university students across the world.

Validity and reliability of the satisfaction scale for outpatient care users in Peru

To assess the psychometric properties of a scale to measure the satisfaction of individuals seeking services at outpatient clinics (ESCOMA) in public healthcare centers in Peru. We carried out a study based on a dataset from Questionnaire 1 of the National Health Users Satisfaction Survey (ENSUSALUD) 2016. ENSUSALUD applied an initial scale of 19 items constructed based on bibliographic review, expert judgment and a pilot study. We first performed an exploratory factor analysis (EFA) in two random subsamples to assess the scale's internal structure. We then developed a confirmatory factor analysis (CFA) using robust maximum likelihood estimation. Lastly, we analyzed measurement invariance and assessed reliability using McDonald's Omega Coefficient (ω). : We randomly divided 13,814 observations into two subsamples for the EFA. Based on this analysis, we selected a best-fitting CFA model, which comprised three factors and 18 items. We found acceptable goodness-of-fit indices for the CFA (CFI = 0.945, TLI = 0.937, SRMR = 0.036). The three resulting factors were a) administrative processes, b) infrastructure and c) medical care. We found strong invariance for age, sex, educational level and area of residence, and partial invariance for type of institution. All reliability coefficients indicated adequate fit (0.86<ω<0.92). The ESCOMA demonstrates validity, reliability, and measurement invariance at different levels of care in a nationally representative Peruvian sample.

Assessment of Burden Among Family Caregivers of Schizophrenia: Psychometric Testing for Short-Form Zarit Burden Interviews.

Objective: Although various short forms of Zarit Burden Interview (ZBI) have been developed, there is a lack of standard psychometric testing and comparison among them. The study aims to examine the psychometric properties of ten short versions of the most frequently used ZBI among a sample of schizophrenia caregivers and to find the one with the best performance.Methods: Cross-sectional door-to-door survey of ZBI-22 and a series of validated instrument data from 327 family caregivers of schizophrenia patients in a Chinese rural community were conducted from October 2015 to January 2016. Reliability was assessed using McDonald's omega coefficient (ω). Validity including concurrent validity, known group's validity, and criterion validity were assessed by Spearman correlations and Mann-Whitney U tests. Overall discrimination ability was evaluated using the area under the receiver operating characteristic curve (AUC).Results: Reliability was generally good for all short forms (ω = 0.69–0.84), except for the Gort ZBI-4 (ω = 0.58), which is acceptable considering its small item numbers. Concurrent validity was good across all various ZBI forms with significant negative correlations with patient's function (r = −0.34 to −0.48, p < 0.01), as well as significant positive correlations with caregiver's depression (r = 0.49–0.65, p < 0.01), and anxiety symptoms (r = 0.45–0.58, p < 0.01). Known groups' validity (carers with disease vs. without disease; carers being parents vs. spouse vs. others) showed inconsistent results among various short forms. Criterion validity was generally good for all short forms with significant positive correlations with Family Burden Interview Schedule (r = 0.67–0.75, p < 0.01), except for the Higginson ZBI-1(r = 0.57, p < 0.01). Discriminative ability was also good for all short forms (AUC range: 0.85–0.99), with various cutpoints proposed. Among all ten short forms, the Ballesteros ZBI-12 and the Gort ZBI-7 outperformed others with almost equally good performance in comprehensive psychometric testing.Conclusions: This study provides support for the reliability, validity, and discriminative ability of the ten various short forms of ZBI for use among schizophrenia family caregivers, with the Ballesteros ZBI-12 and the Gort ZBI-7 endorsed as the best ones.

Psychometric approach of the revised illness perception questionnaire for oral health (IPQ-R-OH) in patients with periodontal disease.

The purpose of this study was to evaluate the psychometric properties of the validated Spanish version of the Illness Perception Questionnaire Revised for Oral Health (IPQ-R-OH) in patients with periodontal disease. We used the IPQ-R-OH, a 36-item self-report scale. This study was carried out using data from 517 patients with periodontal disease attending the dental clinic at the Universidad Cooperativa de Colombia, Pasto, Colombia. A three-parameter logistic model (3PL) for polytomous response was calculated to evaluate a model of individuals' responses. The McDonald's Omega (Ω ≥ 0.60) coefficient and composite reliability were used to determine the internal consistency. Confirmatory factor analysis (CFA) was conducted to examine the fit of the hypothesized seven-factor model, and the configural invariance was tested to estimate the structure in each sex group. The slope, location, and guessing parameters determined reasonable accurate items according to item response theory analysis. The internal consistency coefficients of each factor ranged from 0.62 to 0.93 (McDonald's Omega) and 0.66 to 0.87 (composite reliability). Confirmatory factor analysis indicated a seven-factor model (χ2S-B =2572.165; χ2S-B /(573)=4.489, P<0.01; non-normed fit index=0.950; CFI=0.950; root means square error of approximation=0.055 (90% confidence interval [0.052 - 0.059]); standardized root mean residual=0.080 and Akaike information criteria=1426.165. The seven factors loaded similarly to the original IPQ-R scale. Multigroup CFA analysis results supported factor invariance across the sex groups. These findings suggest that the IPQ-R-OH has adequate reliability and construct factorial validity; therefore, it could be a valuable instrument in screening illness perceptions in patients with periodontal disease.

Measuring chronic condition self-management in an Australian community: factor structure of the revised Partners in Health (PIH) scale.

To evaluate the factor structure of the revised Partners in Health (PIH) scale for measuring chronic condition self-management in a representative sample from the Australian community. A series of consultations between clinical groups underpinned the revision of the PIH. The factors in the revised instrument were proposed to be: knowledge of illness and treatment, patient-health professional partnership, recognition and management of symptoms and coping with chronic illness. Participants (N=904) reporting having a chronic illness completed the revised 12-item scale. Two a priori models, the 4-factor and bi-factor models were then evaluated using Bayesian confirmatory factor analysis (BCFA). Final model selection was established on model complexity, posterior predictive p values and deviance information criterion. Both 4-factor and bi-factor BCFA models with small informative priors for cross-loadings provided an acceptable fit with the data. The 4-factor model was shown to provide a better and more parsimonious fit with the observed data in terms of substantive theory. McDonald's omega coefficients indicated that the reliability of subscale raw scores was mostly in the acceptable range. The findings showed that the PIH scale is a relevant and structurally valid instrument for measuring chronic condition self-management in an Australian community. The PIH scale may help health professionals to introduce the concept of self-management to their patients and provide assessment of areas of self-management. A limitation is the narrow range of validated PIH measurement properties to date. Further research is needed to evaluate other important properties such as test-retest reliability, responsiveness over time and content validity.

Developing a Scale for Quality of Using Learning Strategies

This study aims to develop a measurement tool to measure the quality of using learning strategies. First, the quality of using learning strategies was described based on the literature. The 32 items in the 5-point Likert scale were then administered to 320 prospective teachers, and they were analysed with exploratory factor analysis using unweighted least squares method and promax rotation technique. The four-factor 15 items formed were applied to another study group of 203 prospective teachers. Of the models tested for the factorial structure of the scale in this data set using confirmatory factor analysis (CFA), the four-dimensional structure displayed perfect fit with the data. It was found that the Cronbach's Alpha coefficient calculated for the whole scale and for the sub-dimensions in the first sample rose and reached a good level of internal consistency and that the McDonald's omega coefficient calculated yielded coefficients close to these values. In this way, a valid and reliable measurement tool was developed to measure the quality of using learning strategies in this framework.

Perceived Benefits of Nature Questionnaire: Preliminary Results

Abstract This study aimed to develop a new instrument to assess the perceived benefits of interacting with nature: the 11-item Perceived Benefits of Nature Questionnaire (PBNQ). The questionnaire was developed based on literature review and content analysis, and its reliability was explored with exploratory and partial confirmatory factor analyses in a test-retest study. PBNQ proved to be a reliable inventory with two factorial structure and McDonald's omega coefficient of 0.90. By operationalizing a construct representing the perceived benefits of nature exposure, we might not only extend our understanding of the underlying individual differences which make us who we are but, if this belief in the benefits of nature is a significant predictor of the extent to which a person actually benefits from nature, by promoting it in people we can improve their well-being and overall health outcomes resulting from nature exposure. Key Words: Perceived benefits—Questionnaire development—Nature.