Internal Consistency Indices Research Articles

Development of the 12-Item Social Media Disinformation Scale and its Association With Social Media Addiction and Mental Health Related to COVID-19 in Tunisia: Survey-Based Pilot Case Study.

BackgroundIn recent years, online disinformation has increased. Fake news has been spreading about the COVID-19 pandemic. Since January 2020, the culprits and antidotes to disinformation have been digital media and social media.ObjectiveOur study aimed to develop and test the psychometric properties of the 12-item Social Media Disinformation Scale (SMDS-12), which assesses the consumption, confidence, and sharing of information related to COVID-19 by social media users.MethodsA total of 874 subjects were recruited over two phases: the exploratory phase group had a mean age of 28.39 years (SD 9.32) and the confirmatory phase group had a mean age of 32.84 years (SD 12.72). Participants completed the SMDS-12, the Internet Addiction Test, the COVID-19 Fear Scale, and the 10-item Perceived Stress Scale. The SMDS-12 was initially tested by exploratory factor analysis and was subsequently tested by confirmatory factor analysis.ResultsThe test supported the three-factor structure. In addition, no items were removed from the measurement scale, with three factors explaining up to 73.72% of the total variance, and the items had a lambda factor loading ranging from 0.73 to 0.85. Subsequently, confirmatory factor analysis confirmed the robustness of the measure by referring to a wide range of goodness-of-fit indices that met the recommended standards. The construct validity of the scale was supported by its convergent and discriminant validity. The reliability of the instrument examined by means of three internal consistency indices, and the corrected item-total correlation, demonstrated that the three dimensions of the instrument were reliable: Cronbach α values were .89, .88, and .88 for the consumption, confidence, and sharing subscales, respectively. The corrected item-total correlation ranged from 0.70 to 0.78. The correlation of the instrument’s dimensions with internet addiction and mental health factors showed positive associations.ConclusionsThe SMDS-12 can be reliably utilized to measure the credibility of social media disinformation and can be adapted to measure the credibility of disinformation in other contexts.

Psychometric properties of the ProficiencyIn+E rubric: Self-evaluation of teaching skills

The aim of this article is to present the results of the empirical validation of the PROFICIENCyIn + E rubric for teacher self-evaluation, which allows us to know to what extent primary and secondary teachers consider themselves competent in eleven of the key competencies that have been identified through the review of the literature. The rubric has an online format and digital access through a learning management system aimed at schools. After completing it, teachers receive a personalized report on their competence profile. The reliability results show acceptable indices of internal consistency and empirical validation through the Multidimensional Non-Metre Scaling (PROXSCAL) procedure, suggesting that the rubric is an effective tool to evaluate teaching skills in non-university teaching. The use of this tool offers real opportunities for self-improvement and reflection amongst teachers related to their competencies and how to plan their professional development.

Development and Validation of a Food Literacy Assessment Tool for Community-Dwelling Elderly People.

Food literacy refers to the knowledge, skills, and attitudes required for individuals to choose foods that promote health. As the rate of diet-related diseases increases, food literacy is becoming more important. However, there are no tools available to evaluate food literacy among the Korean elderly. We derived 547 questions from a literature review and, after three rounds of Delphi surveys, selected 33 preliminary questions. We calculated the content validity ratio of the questions and applied a face validity procedure. We then selected 32 questions, assessed their validity, and distributed them as a questionnaire to 205 elderly people. We then conducted exploratory factor analysis (EFA) to determine the validity of the questionnaire and used an internal consistency index (Cronbach’s α coefficient) to determine reliability. Based on the factor analysis, 13 questions were selected, distributed among three factors, and evaluated using the Kaiser–Meyer–Olkin (KMO) and Bartlett sphericity tests. The factor analysis showed that KMO was 0.872, which is a highly acceptable score, and the Bartlett sphericity test was χ2 = 1,374.69 at p = 0.00. The food literacy questionnaire developed in this study will likely be helpful for improving the healthcare of elderly people.

Design and validation of the animal welfare scale: Emotional education of children to prevent abuse

It is important to have reliable instruments that can evaluate the attitude towards animal welfare of elementary school students. The abuse or mistreatment of children towards vulnerable groups deserves full attention, therefore we emphasize that animals constitute a vulnerable group that needs further studies. This is a descriptive, cross-sectional and correlational study aimed to validate the design of a scale that measures the attitude towards animal welfare (ABA) in 100 students from fourth to sixth grade of elementary school. It includes children between 9 to 12 years old residents of communities in the state of Sonora, Mexico. The factor analysis yielded two factors that explain 39.32% of the total variance with a Keizer-Meyer-Olkin (KMO) index of 0.86 and high internal consistency index for the total scale (0.90) and the subscales. Additionally, the confirmatory factor analysis produced an adequate practical and statistical fit in the covariance model and the second order model. The covariance analysis also evidenced convergent and divergent validity. Comparison analyzes by groups showed that sex and school grade do not influence attitudes in favor or against the animal species. Finally, we found that older children living in an extended family develop better attitudes in favor of animal care and protection.

Psychometric properties of the Insomnia Severity Index in a sample of family dementia caregivers

Study objectivesFamily caregivers of people with dementia frequently report sleep problems that are linked to depressive and anxious symptoms. However, data are needed regarding the psychometric properties of specific measures of sleep problems in caregiving populations. The aim of this study is to analyse the psychometric properties of the Insomnia Severity Index (ISI; Morin, 1993) in a Spanish dementia caregiver sample. Methods271 participants took part in face-to face interviews where, along with sociodemographic variables, caregivers' sleep problems, depressive and anxious symptoms were measured. The psychometric properties of the ISI were analysed through Confirmatory Factor Analysis (CFA) and analysis of the internal consistency and convergent and criterion validity. ResultsThe Spanish version of the Insomnia Severity Index showed adequate indices of internal consistency (Cronbach's alpha = 0.78) in our sample of family caregivers of people with dementia. A one-factor structure provided a better fit to the data than two- and three-factor structures. The ISI was significantly associated with lower sleep quality, less average sleep time per day and lower self-perception of vitality, as well as with higher depressive and anxious symptoms. Differences in ISI scores were found between people with and without depressive and anxious symptoms. Statistically significant gender-based differences in sleep problems were also found, with female caregivers showing higher sleep problems. ConclusionsThe ISI is a reliable and valid instrument to assess the subjective severity of sleep problems in the family dementia caregiver population and may be a useful instrument in intervention and research settings. Additional evidence was also provided of the importance of considering sleep problems in the studied population.

Inventory construction to track cognitive profiles compatible with intellectual disability, ADHD, and dyslexia in children between 6 to 11 years old

IntroductionThe most frequent complaints from children referred to psychiatry and psychologist are related to academic and attentional impairments, or developmental delay, which are shared by many conditions.ObjectivesTo develop an inventory that evaluates cognitive functions of children between 6 to 11 years old to track cognitive profiles compatible with Intellectual Disability, ADHD, and dyslexia to assist in differential diagnosis.MethodsIn study 1 (identification of the relevant constructs, operational definition, and items development), data were collected from parents of children and professionals who serve this population; articles, verification of screening instruments and identification of cognitive impairments by the DSM-5. In study 2, an analysis of judges with professionals was carried out, as well as a verification of the items’ clarity by the target population; In study 3, we looked for evidence of validity and precision indicators with a sample of 272 parents and 178 teachers of 72 children diagnosed with one of the three disorders and 207 that had no suspect of neurodevelopmental disorders.ResultsFor the parent version, the four-factor solution was the most appropriate, with the following Scales: Attention, Executive Functions, Intelligence and Oral Language. The final version for parents was composed of 60 items, with excellent internal consistency indices (coefficients> 0.90).ConclusionsROC curves expressed good sensitivity and specificity of the scales for each disorder. Future studies have to expand the sample size of children diagnosed with one of the three disorders so that new analyzes can be performed and the results can be generalizable to the population.DisclosureNo significant relationships.

Design and psychometric evaluation of the fathers\u2019 fear of childbirth scale: a mixed method study

BackgroundFear of childbirth is reported in 13% of fathers, and it may have adverse consequences for the fathers’ health as well as their families. To reduce the fear of childbirth in the expectant fathers, an appropriate screening tool is needed. Due to the lack of a valid and reliable questionnaire to measure fathers’ fear of childbirth, this study was conducted to develop the Fathers’ Fear of Childbirth Scale and evaluate its psychometric properties.MethodsThis mixed method study was conducted in two phases. In the qualitative phase (or item generation), semi-structured interviews were conducted with 20 expectant fathers, and a literature review was performed to generate the Fathers’ Fear of Childbirth Scale items pool. In the quantitative phase (or psychometric evaluation), reliability as well as face, content, and construct validity of this scale were evaluated. To establish construct validity, exploratory and confirmatory factor analyses were performed. Reliability was evaluated through internal consistency and composite reliability measures.ResultsThe primary version of Fathers’ Fear of Childbirth Scale contained 32 items, which were reduced to 17 items while establishing construct validity. Exploratory factor analysis extracted two factors, namely fear of childbirth process (12 items) and fear of hospital (5 items). These factors explained 50.82% of the total variance. Goodness of fit indices within the confirmatory factor analysis was acceptable. Internal consistency and composite reliability indices of all the factors were greater than 0.70.ConclusionThe Fathers’ Fear of Childbirth Scale has a suitable validity and reliability for assessing fear of childbirth in fathers. It is a simple report instrument that can be easily implemented by health care professionals.

Reliability and Validity of the Greek Version of the Oral Mucositis Weekly Questionnaire in the Head and Neck Cancer Context.

Oral mucositis is one of the most common treatment-induced adverse side effects in head and neck cancer patients. The purpose was to evaluate the reliability and validity of the Greek version of the Oral Mucositis Weekly Questionnaire-Head and Neck Cancer (OMWQ-HN). The data were retrieved from 72 head and neck cancer patients who were undergoing oral radiotherapy as monotherapy or in combination with chemotherapy and surgery. Data analyses included internal consistency reliability, criterion related validity, and cross-sectional validity. The OMWQ-HN demonstrated good criterion validity. Strong correlations were observed between OMWQ-HN with EORTC QLQ-C30 and EORTC QLQ-H&N35 that showed good concurrent validity. The tool has a strong internal consistency index with α = .92. The Greek version of OMWQ-HN is a reliable and valid instrument that can be used for the assessment of oral mucositis in this context.

Psychometric properties of the Caregiver Strain Questionnaire among Chinese parents of children with ADHD or ASD

BackgroundThere is an urgent need in clinical practice to measure the stress of parenting. The Caregiver Strain Questionnaire (CGSQ) was found to be useful to measure parenting stress, but it...

Instrument Development For Evaluating Students’ Employability Skills

An assessment on the level of employability skills of students is deemed necessary, given the employers’ need for skills that must be mastered by job seekers. The purpose of this study is to create an instrument that is able to assess the level of mastery of students’ employability skills. Instrument making was carried out through seven stages: composing of variable constructs, preparing of instrument lines, arranging the instrument items, conducting content validation, testing instrument, conducting the consistency analysis of items, and estimating the reliability coefficient of instruments. Based on the instrument making process, it has been found out that the construct of the measured employability skills variable includes the skills of communication, teamwork, problem-solving, and technology utilization. Subsequent stages were carried out procedurally and content validation was carried out until obtaining the expert approval. The process of analyzing the consistency of items and estimating the reliability coefficient of the instrument was conducted using the SPSS. The results of the consistency analysis of items with SPSS showed seven statement items that had an internal consistency index below 0.3. As a consequence, these items were not used for not representing the construct of the measured indicator. After doing the item consistency analysis, 49 good items were obtained and the instrument reliability coefficient was estimated. Based on the analysis results, the reliability coefficient of the instrument obtained the value of 0.905. As the results obtained were more than 0.7, the instrument was then stated to be reliable and could be used as a data collection tool.

Cross-cultural adaptation of the Arabic version of Self-Care Domain of Child Engagement in Daily Life and Ease of Caregiving for Children measures

PurposeTo cross-culturally adapt the Self-Care Domain of Child Engagement in Daily Life and the Ease of Caregiving for Children to Arabic language and Saudi culture and to examine the reliability of the Arabic version of both measures. MethodsA modified cross-cultural adaptation procedure was employed. A total 36 children with cerebral palsy (aged 1.5–11 years) and their parents participated in the pilot and final testing steps. A committee of 7 stakeholders evaluated cross-cultural equivalence of both measures. Cronbach’s alpha, intra-class correlation coefficient, and minimal detectable change were used to establish internal consistency, test-retest reliability, and distribution-based index, respectively. ResultsMinor linguistic, not cultural, adaptations were made in the Arabic version of both measures. Conceptual, item, semantic, and operational types of equivalences were supported. The Arabic version of Self-Care Domain of Child Engagement in Daily Life and Ease of Caregiving for Children demonstrated high internal consistency (0.97 and 0.91, respectively), excellent test-retest reliability (0.99 and 0.96, respectively), and appropriate minimal detectable change values (0.29, 0.43, respectively). ConclusionsThe Arabic version of Self-Care Domain of Child Engagement in Daily Life and Ease of Caregiving for Children are reliable and culturally appropriate for use with parents of children with cerebral palsy in Saudi Arabia.

EmoSocio: An open access sociometry-enriched Emotional Intelligence model

• Open release of EmoSocio as an EI model that represents emotional and social traits. • Blending of sociometric indexes with emotional intelligence traits. • Semantic alignment of constructs from dominant EI models. • Conceptualization and release of the EmoSocio model in the form of an ontology. • High internal consistency indexes and correlation with dominant EI models. Significant efforts have been allocated over the last thirty years towards the definition and measurement of the Emotional Intelligence (EI) construct. Several EI theories and models have been produced to support psychological assessment processes. However, barriers are identified for their wide adoption and exploitation by social scientists. The absence of a common structured format to represent concepts in EI models has resulted in lack of clarity and consistency, while hindering comparison, validation and extensive evaluation processes. Provision of open access to such models and measurement instruments has not been promoted so far, however, considered crucial for their wide adoption. Furthermore, the inclusion of indexes from the sociometry domain can facilitate participatory modeling by multidisciplinary scientists during the development of social and emotional training programs. To address these challenges, we propose EmoSocio, an open access Emotional Intelligence Model, built upon a detailed comparison and synthesis of the main constructs represented in widely accepted EI models and enriched with sociometric indexes at an individual and group level. Upon detailing the methodological approach followed for the development of the EmoSocio model, we present the EI and social constructs of the model, followed by an assessment of the EI part in terms of reliability and validity. EmoSocio is also represented in a semantically-enriched format in the form of an ontology. Our ambition is to provide an open access EI model that can be used by multidisciplinary scientists to evaluate psychological assessment processes and develop interventions, aiming to strengthen interpersonal and intrapersonal competencies.

Family Context Assessment to Promote Language and Reading Abilities in 6-Year-Old Children

Within a bioecological model, research works over the past decades have shown the significant influence of family micro systemic variables on child development. This study is aimed to test the factorial structure of the Haezi-Etxadi Family Assessment Scale (HEFAS-6), designed to detect protective family factors for language and reading development through the assessment of family context quality. The sample of this study consisted of 127 children aged 5 to 7 and their families. The factorial structure and the internal consistency of the data were analyzed. Results of the exploratory factor analysis (principal components with varimax rotation) showed the emergence of four factors: promotion of cognitive and linguistic development, promotion of socio-emotional development, family system strain and parental profile fostering child development. This structure was confirmed by confirmatory factor analysis. The internal consistency indices showed acceptable values. In conclusion, the tool shows good potential to assess the quality of the family context in the field of the promotion of reading and linguistic skills in educational, clinical and social intervention settings and through the implementation of evidence-based parenting policies.

Development and psychometric testing of nursing students\u2019 perceptions of clinical stressors scale: an instrument design study

BackgroundIn clinical environments, nursing students experience a range of stressors that can affect their health, learning, and quality of patient care. This study aimed to develop a Nursing Students’ Perceptions of Clinical Stressors Scale (NSPCSS) and to evaluate its psychometric properties.MethodsThis exploratory, sequential mixed-method study was conducted in 2 phases. In the qualitative (item generation) phase, NSPCSS items were generated using the data collected from semi-structured interviews and a literature review. In the quantitative (psychometric evaluation) phase, face, content, construct, convergent, and discriminant validity and reliability of the scale were tested. To evaluate construct validity, exploratory and confirmatory factor analyses were performed on the data collected from 430 nursing students. Reliability was also assessed through internal consistency and composite reliability.ResultsIn this study, 6 factors were extracted from 30 itemes through exploratory factor analysis: (1) instructor’s limited competence in clinical environments, (2) inappropriate clinical environment, (3) inadequate knowledge and skills, (4) inefficient education in clinical planning, (5) instructor’s inappropriate conduct, and (6) concerns about the characteristics of nursing career. These factors accounted for 58.8% of the total variance. The results of the confirmatory factor analysis suggested the goodness-of-fit indices was acceptable. Furthermore, the internal consistency and composite reliability indices of all factors were greater than 0.7.ConclusionsThe NSPCSS is a valid and reliable instrument for assessing clinical stressors among nursing students.

Evaluación de la investigación formativa: Diseño y validación de escala

The article presents the results of a study whose purpose was the design and validation of a scale to evaluate education research training. The study was based on the Item Response Theory (IRT) mathematical model, with adaptation to Guttman’s cumulative scale. The levels of scientific research were considered to conduct the study in the following phases: 1) exploratory phase (content validity) by means of theoretical sampling, semi-structured interviews, and focus groups; 2) descriptive stage (construct validity) through the Delphi method; 3) analytical phase (consistency); 4) explanatory stage (R & R analysis) through the application of the scale in mention. Nineteen professors-researchers, five graduates of the degree program, and 26 students of research training participated in the study. Theoretical-contextual argumentation, classification of reagents in hierarchical conglomerates, concordance measures, internal consistency indices, and stability analysis allowed to establish the validation of the scale. The execution of the scale through constructs, reagents, and binary differential indicators provides a valuable approach to evaluating research training processes, taking into account the dimensions of knowledge, doing, and being. In essence, the study’s findings seek to contribute to strengthening education research around its assessment.

Simulation effectiveness tool modified (SET-M): adaptation and validation for Brazil.

Objective:to adapt the Simulation Effectiveness Tool - Modified (SET-M) to Portuguese and to verify validity and reliability indexes.Method:methodological study using ISPOR, Confirmatory Factor Analysis, correlation between the adapted instrument/Simulation Design Scale - Student Version/Individual Practice Assessment and reliability (test-retest and internal consistency indexes). Convenience sample with a total of 435 Nursing undergraduate and graduate students.Results:Simulation Effectiveness Tool - Modified Brazilian Version obtained an average score between 2.36 to 2.94. The Confirmatory Factor Analysis had a factor load > 0.30 for 17 of the 19 items. Cronbach’s alpha ranged between 0.729 and 0.874. McDonald’s omega was 0.782. There was no correlation between Simulation Effectiveness Tool - Modified Brazilian Version and the Simulation Design or Individual Practical Assessment. There was a positive correlation between the Simulation Effectiveness Tool - Modified Brazilian Version and the participants’ age. The scores of the volunteers in the simulations were significantly higher than those of the observers in three domains.Conclusion:the SET-M Brazilian Version, maintaining the 19 items and four domains of the original scale, was made available for use in Brazil to evaluate the effectiveness of the simulation, recommending studies with different samples.

Development and psychometric testing of a Gastric Cancer Behavioural Risk Assessment Inventory (GC-BRAI).

Gastric cancer (GC) is one of the most common cancers worldwide. There is no disease-specific tool for GC risk assessment in research and practice settings within the Iranian sociocultural context. To develop and assess the psychometric properties of the Gastric Cancer Behavioral Risk Assessment Inventory (GC-BRAI) in GC patients in Northwest Islamic Republic of Iran. Face-to-face interviews were performed on a convenient sample of 175 GC patients and a purposive sample of 350 matched non-GC patients as a control group. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed to appraise the structure validity of GC-BRAI and examine its possible latent constructs. The designed instrument with its 5 latent factors indicated acceptable internal consistency (0.72), reliability (0.99) and fit indices (χ2/degrees of freedom = 2.24, root mean square error of approximation = 0.049, adjusted goodness of fit index = 0.91 and root mean square residual = 0.085). The identified components were specific nutritional behaviours, typical daily diet, routine heartburn-causing behaviours or foods in diet, daily use of rice and smoked foods, and tobacco smoking/alcohol consumption, which all indicated a significant association (P= 0.0001) with high-risk of GC. GC-BRAI can be considered a feasible tool to measure individual GC risk and a reliable data collection instrument in tailor-made risk reduction interventional programmes.

Validation of the Flow Scale Related to Physical Education in Arabic Language

Objective: Develop and test psychometric properties of the academic flow instrument in physical education. Methods: A total of 654 retained participants aged between 10 and 18 completed the four-dimensional Physical Education Flow Questionnaire (PHFLOW) (134 in the exploratory phase and 520 in the confirmatory phase). The participants in the first exploratory study were female (n = 69) and male (n = 65) attending primary school (n = 32.84%), college (40.30%) and secondary school (26.87% studies). The 520 have a mean age of 14.13 ± 2.61 years. Male students presented 52.7% of the participants (mean age 14.20; SD = 2.60), whereas 47.53% were female (mean age 14.03; SD = 2.63). The percentages of students are respectively: 33.1% (n = 172), 36.3% (n = 189) and 30.6% (n = 159) for primary, college and secondary. Results: The result of exploratory and confirmatory factor analysis, as well as the analysis of reliability through the internal consistency index proved the robustness of the measurement instrument. The concurrent validity of the instrument was satisfactory, on the one hand by a significant negative relationship between autotelic experience and PANAS negative affect, and on the other hand by a significant positive relationship between autotelic experience and PANAS positive affect. Conclusion: The PH-Flow scale can administer to assess academic flow in physical education.

Reliability and Validity of the Trunk Control Measurement Scale Among Children and Adolescents With Cerebral Palsy in Tanzania.

The aim of this study was to investigate the reliability and validity of the Trunk Control Measurement Scale (TCMS) among children with cerebral palsy (CP) who were living in Tanzania. Two physiotherapy trainees, each blinded to the other's test findings, independently administered the TCMS to 38 children with CP (16 female; M age = 7.2, SD = 4.8 years) twice over sessions separated by a 30-day interval. We assessed internal consistency and intra/inter-rater reliability using Cronbach's alpha and the Intraclass Correlation Coefficient (ICC), respectively. We examined measurement error through Standard Error of Measurement (SEM) and Minimal Detectable Change (MDC). We assessed construct validity with Spearman's correlation coefficient between the TCMS and both the Gross Motor Function Classification System (GMFCS) and the Manual Ability Classification System (MACS). We found a frank floor effect. Internal consistency (α = 0.945) and reliability indices were excellent for the total scale (ICC for intra-rater reliability = 0.985, inter- reliability = 0.997) and for each sub-scale score. We found low values of SEM (1.7 points) and MDC (4.8 points). Construct validity was supported by moderate and strong correlations between the TCMS and the GMFCS and MACS in this sample. We conclude that the psychometric properties of the TMCS support its clinical and research use for youth with CP in low-income settings.

Análisis de confiabilidad y validez del Cuestionario de Calidad de Vida, Satisfacción y placer (Q-LES-Q) en trabajadores de Salud Pública

El Cuestionario sobre calidad de vida: satisfacción y placer (Q-LES-Q) (Endicott, Harrison & Blumenthal, 1993; WHOQOL Group, 1995), ampliamente utilizado y reconocido por la comunidad científica, no ha sido revisado en población en Argentina. Por tal motivo este estudio se orientó a determinar la confiabilidad y validez de siete subescalas. Se trabajó con una muestra probabilística de 497 trabajadores de Salud pública ( 38 años; S 9,48). Los resultados señalaron índices de consistencia interna adecuados; por medio del análisis de componentes principales se detectaron algunas subescalas con estructura multifactorial, en tanto otras conservaron su estructura original. Por medio de rotación Oblimin se obtuvo una distribución de ítems coherente con los constructos teóricos, por lo que se concluyó que su uso en esta población sería pertinente