Construct Validity Of Scale Research Articles

Exploring dimensions of blended learning readiness: Validation of scale and assessing blended learning readiness in the context of TVET Bangladesh

In collaboration with Technical and Vocational Education and Training educators and academic librarians, this study attempts to develop and validate a blended learning readiness scale for Bangladeshi TVET students. This study also attempts to investigate the reliability of this validated scale by measuring six blended learning readiness dimensions. In this research, the Content Validity Index, Exploratory Factor Analysis, and Confirmatory Factor Analysis were used to establish the construct validity of the blended learning readiness scale. Questionnaires were circulated to the students of six Institutes of Marine Technology (N = 235) who went for a blended learning session for an entire semester. This study's result suggests a strong positive association between Bangladeshi polytechnic students' preparedness for blended learning and attitudes toward online learning, openness to new technology, and attitudes toward the face-to-face classroom. In contrast, significant negative correlations were found between blended learning readiness and basic skills in using technology, learning flexibility, and study management. This study also implied that gender and previous academic achievement is not strong predictor of measuring blended learning readiness in Bangladeshi Technical and Vocational Education and Training context. This blended learning readiness scale would help course designers, educators, librarians, and policymakers of Bangladesh to improve the quality of the blended learning environment by addressing the students' concerns about various blended learning components.

Reliability and Validity of Personal Stigma Scale Among University Students in Singapore.

The study aims to examine the reliability and validity of the Personal Stigma Scale and the intrapersonal variables that affect the personal stigma level towards depression among university students in Singapore. University students aged 18 to 24 years old who were literate in English were recruited using convenience sampling through online platforms. Participants' stigma towards depression was assessed using the Personal Stigma Scale. Each item of the scale was rated from 1 (strongly disagree) to 5 (strongly agree); higher scores indicate higher stigmatising attitudes. Internal consistency, divergent validity, construct validity, and test-retest reliability of the Personal Stigma Scale were evaluated, as were the intrapersonal variables that affect the personal stigma level towards depression. Personal stigma level was significantly lower in female participants, those from healthcare faculties, those with prior contact with healthcare professionals, those without mental health disorders, and those with loved ones with mental health disorders. Exploratory factor analysis revealed a three-factor structure. The Personal Stigma Scale was negatively correlated with the Depression Literacy Scale weakly and the Anxiety Literacy Scale moderately. Cronbach's alpha for internal consistency was 0.71 for the overall scale and 0.18 to 0.67 for subscales. Test-retest reliability coefficient was 0.74 at 2 weeks and 0.70 at 2 months. The Personal Stigma Scale is valid and reliable to measure self-stigma towards depression among university students in Singapore. Nonetheless, further studies are required to examine its factor structure, especially among various cultures and populations.

Development of Self-Regulation Scale for Adolescents

This study aims to develop the Self-Regulation Scale for Adolescents. EFA and CFA were conducted to test the scale's construct validity during the development process. In the EFA analysis, the scale has a total of 11 items and a one-dimensional structure; It was concluded that it explained 51% of the variance in self-regulation. As a result of the CFA analysis, it was concluded that the scale had a good fit (χ2 / Sd = 4.55; CFI = .93; TLI = .91; SRMR = .041; RMSEA = .089). To test the item discrimination of the scale, ICC was calculated for each item and it was concluded that the items had good discrimination. The gender measurement invariance of the scale was made and it was concluded that the scale measures the same construct in both men and women. Cronbach Alpha, McDonald Omega Reliability, and Combined Reliability (CR) values were calculated to test the measurement reliability. Cronbach Alpha coefficient was .90; McDonald Omega Confidence (ω) coefficient and CR value was .89 As a result, it was concluded that the Self-Regulation Scale for Adolescents had acceptable and satisfactory psychometric properties in measuring the self-regulation skills of high school students.

The Roswell eND scale: Brief, valid assessment of nicotine dependence adults seeking to discontinue e-cigarette use

BackgroundMost adults who regularly use e-cigarettes or Electronic Nicotine Delivery Systems (ENDS) desire to discontinue use. ENDS use can result symptoms of nicotine withdrawal and dependence which can make it more difficult to discontinue use. Brief, valid assessment of nicotine dependence among adults who use ENDS is needed to guide treatment for nicotine dependence in this group. We sought to develop a brief, valid instrument to measure nicotine dependence among adults seeking to discontinue ENDS in a busy Quitline. MethodsIn this cross-sectional design, we examined content, construct, and concurrent validity of the Roswell ENDS Nicotine Dependence Scale (Roswell eND Scale) and the Penn State E-Cigarette Dependence Index (Penn State eCDI). Participants who called the New York Quitline from November 2019 to June 2020 seeking to discontinue ENDS use were invited to participate. Construct validity was examined with exploratory and confirmatory factor analyses. Instrument and factor scores were then correlated with cotinine, a biomarker of nicotine exposure. ResultsAll participants (n = 209) were highly dependent and co-used combustible cigarettes to varying degrees. Both instruments demonstrated content validity and construct validity, however only the 5-item Roswell eND Scale demonstrated criterion-related validity by showing a significant positive correlation with salivary cotinine levels. ConclusionsThe 5-item Roswell eND Scale can briefly and effectively assess nicotine dependence among treatment-seeking adults who co-use ENDS and cigarettes. These preliminary psychometric findings have the potential to be generalizable to other adults seeking to discontinue ENDS use, many of whom currently or formerly smoked cigarettes.

MEASURING PROFESSIONAL KNOWLEDGE OF LATER LIFE DEPRESSION

Abstract Research linking behavioral health providers’ knowledge of later life depression to their clinical practices and patient outcomes is restricted by outdated measures. A multi-stage study was conducted to ameliorate this gap. Qualitative interviews with geropsychology content experts (N = 5) generated 49 true/false items capturing relevant concepts in later life depression, including brain health concerns. Additional content experts (N = 10) completed the questionnaire and a card sort task placing items into categories (Psychopathology, Assessment/Diagnosis, Treatment, Other) to understand measurement structure. This resulted in retention of 42 items. A random pool of licensed social workers (N=900) were mailed the survey packet with option to complete via return mail or online. This presentation will review scale psychometrics, reliability, and construct validity among MSWs from diverse clinical backgrounds. Associations between participant characteristics and knowledge of cognitive and other depressive symptoms will also be highlighted.

Preliminary development and validation of a peer mentoring needs assessment scale for novice nurse faculty

Mentoring is a vital tool in increasing job satisfaction and promoting retention of novice nurse faculty. The aim of this study is to establish the construct validity and internal consistency of a new Novice Faculty Confidence Scale for use in the mentoring of novice nurse faculty. This cross-sectional study was performed at an undergraduate nursing program in the Midwest. The Novice Faculty Confidence Scale was evaluated by six experienced faculty (at least 5 years of experience in the faculty role). Twenty-five items within the four domains of the nurse faculty role (teaching, service, scholarship, and personal support) were identified that could be positively impacted by a peer mentoring program. The items were rated for relevance by the experienced faculty members to establish content validity and internal consistency. The reliability was analyzed for internal consistency and validity was examined for construct validity of the items and the scale as a whole. The Novice Faculty Confidence Scale was found to have high construct validity and internal consistency. The item construct validity indices ranged from 0.5 to 1, producing a scale construct validity index/average of 0.85. Removing the items with an item construct validity index under 0.78 increased the scale construct validity index/average to 0.92 with a Cronbach's alpha of 0.95. This scale is a valid way to identify novice faculty mentoring needs related to the mentee's confidence in teaching, service, scholarship, and personal support.

Transcultural adaptation and psychometric validation of the Thai-Brief Resilient Coping Scale: a cross-sectional study during the coronavirus disease 2019 pandemic in Thailand

This study aimed to examine the transcultural adaptation, construct validity, and psychometric properties of the Thai-Brief Resilient Coping Scale (BRCS) among the general population and college students through the coronavirus disease 2019 (COVID-19) pandemic in Thailand. We invited the 4004 participants to complete sets of anchor-based measurement tools, including depressive symptoms, anxiety symptoms, perceived stress, well-being, and perceived social support. The scale factor structure of the Thai-BRCS was assessed using factor analysis, and nonparametric item response theory (IRT) analysis. The psychometric properties of the Thai-BRCS for validity (convergent and discriminant) and reliability (internal consistency and reproducibility) were assessed. Based on the construct validity testing, factor analysis, and nonparametric IRT analysis reaffirmed the unidimensionality with a one-factor structure of the Thai-BRCS version. For convergent validity, the scale was significantly correlated with all sets of anchor-based measurement tools (all P < 0.001). The discriminant validity was satisfactory with a group of medium and low resilience and the risk of adverse mental outcomes. For scale reliability, it revealed excellent internal consistency (alpha = 0.84, omega = 0.85) and reproducibility (intraclass correlation = 0.91). The Thai-BRCS version fulfills transcultural adaptation with satisfactory psychometric properties to measure psychological resilience in the Thai population during the COVID-19 pandemic.

Measuring left-behind children’s discrimination perception in China: the development of discrimination perceptions of left-behind children Scale

With the advancement of urbanization in China, there are millions left-behind children whose parents left home to support families, experiencing lot of discrimination. The study aims to develop a scale measuring left-behind children’s discrimination perceptions (discrimination perceptions of left-behind children, DPLC) in China and investigate the discrimination perceptions of left-behind children using the DPLC scale. The data for 105 left-behind children were used to measure the reliability and analyze the items of the DPLC scale in the pre-test. The data for 402 left-behind children were used to verify the construct validity and internal consistency of the DPLC scale and investigate children’ discrimination perceptions of left-behind in China. This study reports the development process of the DPLC scale and presents a valid scale for measuring discrimination perceptions of left-behind in the future.

Yale Food Addiction Scale 2.0 (YFAS 2.0) and modified YFAS 2.0 (mYFAS 2.0): Rasch analysis and differential item functioning

BackgroundFood addiction (FA) is a prevalent concern that may manifest as poorly controlled food consumption and promote overweight/obesity. Thus, having a well-established instrument for assessment may facilitate better prevention and treatment. The current study investigated the psychometric properties of two common measures of FA (i.e., the Yale Food Addiction Scale [YFAS] 2.0 and its modified version, mYFAS 2.0) using a robust statistical analysis (Rasch model).MethodsIn this cross-sectional study, the scales were sent to 974 students studying in higher education (60% females) in Taiwan through online media including email and social networks. Rasch modeling was used to assess dimensionality, difficulty level, and item misfit and hierarchy. Differential item functioning (DIF) was performed to examine consistency of the items across gender and weight status.ResultsRasch analysis indicated 3 items of the 35 items belonging to the YFAS 2.0 (8.6%) and none belonging to the mYFAS 2.0 were misfit. Unidimensionality and construct validity of both scales were supported by appropriate goodness-of-fit for diagnostic criteria. The person separation was 3.14 (reliability = 0.91) for the YFAS 2.0 and 2.17 (reliability = 0.82) for mYFAS 2.0, indicating the scales could distinguish participants into more than 3 strata. Only one substantial DIF was found for diagnostic criteria of “Failure to fulfill major role obligation” in the YFAS 2.0 across gender.ConclusionAccording to Rasch modeling, both the YFAS 2.0 and mYFAS 2.0 have acceptable construct validity in Chinese-speaking youth. Scoring methods using either diagnostic criteria or symptom counts for both the YFAS 2.0 and mYFAS 2.0 are supported by the present Rasch findings.

A New Scale for Measuring Identity Insecurity

ABSTRACT Although theory and research have discussed identity insecurity as a factor that influences intercultural communication behaviors, no reliable measure has been presented to capture this construct. This paper reports results from three studies designed to test and validate a new measure of identity insecurity. Study 1 (N = 173) included item generation and exploratory factor analysis, revealing five unidimensional identity insecurity factors, termed individual identity insecurity, public presentation insecurity, dissimilar others insecurity, reactive insecurity, and social identity insecurity. Study 2 (N = 524) confirmed this five-factor structure. Study 3 (N = 807) further examined the structure and construct validity of the identity insecurity scale. Results confirmed the five-factor solution obtained in Study 2 and revealed the measure had good construct, convergent, and discriminant validity. Thus, we conclude that the proposed new measure for identity insecurity has a clear factor structure, strong factor loadings, and good reliability and validity.

TRANSLATION AND VALIDATION OF GENDER MINORITY STRESS &amp; RESILIENCE SCALE

The purpose of the present study was to translate Gender Minority Stress &amp; Resilience Scale (GMSR; Testa, 2014) into Urdu language for construct validity of the scale for gender nonconforming individuals living in Pakistani culture. This purpose was accomplished in two phases. In the first phase, the GMSR Scale was translated in to Urdu language by following the steps of back translation method suggested by Brislin (1972).To establish the construct validity of GMSR Scale, data was collected in two phases, first from transgender community to determine convergent validity of the scale, in second stage from gender nonconformist individuals living in general population, a total of 420 gender nonconformist individuals, males(n =215) and females (n = 205) from different cities including Rawalpindi, Islamabad, Lahore, Gujrat, Sialkot and surrounding of these cities. Data was collected through snowball sampling from all these cities. Study participants were informed about the nature of the study and signed consent was obtained. Data was analyzed to establish construct validity of Urdu version of GMSR Scale. Results indicate that all scales and respective items of the Urdu version of original GMSR Scale show good fit. Reliability analysis through SPSS also indicated satisfactory values of Cronbach alpha. This study facilitated us to establish a valid and reliable measure for upcoming studies on Gender diversity and gender nonconformity in Pakistan using GMSR Scale. Keywords: Gender Diversity, Gender Nonconformity, Gender minority stress, resilience, Pakistan

Stereotypes Toward Voluntary Singlehood Scale: Development, Validity and Reliability

This study aims to develop a valid and reliable tool that measures stereotypes toward single people. To this end, in the first stage of the study, we conducted a qualitative study with 102 participants (M = 24.32, SD = 3.41) to reveal how individuals who prefer to remain single are perceived in society. Together with the findings of this qualitative study, we created the first form of the scale. We examined the scale's construct validity by exploratory factor analysis and confirmatory factor analysis. As a result of the exploratory factor analysis performed with a sample of 358 participants (M = .29; SD = 7.92), we found that the scale had a single factor structure consisting of 15 items explaining 56.5% of the total variance. This scale structure was confirmed by confirmatory factor analysis with another study group of 406 participants (M = 28.72, SD = 7.93). We tested the criterion-related validity of the scale with the Inönü Marriage Attitude Scale. The correlation coefficient calculated between the scores from the two scales was .40. The scale's reliability was examined using Cronbach's Alpha analysis and split-half test. The Cronbach's Alpha coefficient of the scale was .95. The correlation between the two halves of the test is .87. These findings provide evidence that the stereotypes scale for voluntary singles is a valid and reliable.

Exploring the validity of the body image scale with survivors of breast cancer: A cognitive interview approach.

The aim of this study is to explore the construct validity of the Body Image Scale for Cancer Questionnaire (BIS) using cognitive interviews. Twelve breast cancer survivors participated in a cognitive interview while completing the BIS. Each participant was asked to think-out-loud while answering items, and an interviewer asked probing questions relating to the participants' comprehension, example retrieval, certainty of answer and other decision-making factors. Interviews were audio recorded and transcribed, and the data were analysed deductively and inductively. The participants' interpretations of the questions varied significantly. Several participants perceived the phrasing of some questions to be leading. The participants were able to provide examples of how their physical, physiological and body function affected their body image. The participants expressed positive attitudes towards, and gratitude for their body, which was not captured by the questionnaire. At times, the participants felt uncertain in how to respond appropriately to specific items, and the participants found some items challenging to answer. Finally, the BIS included sensitive questions that elicited emotional reactions and discomfort for some participants. The findings of this study provide insight into, and suggestions for potential questionnaire revisions that may enhance the validity and relevance of the BIS for use with breast cancer survivors.

Psychometric Evaluation of the Nurses' Cancer Pain Management Competency Scale

BackgroundThere is lack of instruments for assessing nurses' comprehensive pain management competency. AimThis study aimed to assess the psychometric properties of the Nurses' Cancer Pain Management Competency Scale and to conduct a cursory survey of the pain management educational needs/resources of nurses caring for patients with cancer pain. MethodA convenience sample of 230 Korean nurses who met the eligibility criteria completed the researcher developed the Nurses' Cancer Pain Management Competency Scale and a pain management educational needs/resources survey. The Nurses' Cancer Pain Management Competency Scale was based on the pain management core competencies identified by Fishman et al (2013). Internal consistency was assessed using Cronbach's alpha, and construct validity was examined using exploratory factor analysis with varimax rotation. ResultsCronbach's alpha of the scale was 0.89. Nurse cancer pain management competency includes four factors, which accounted for 68.44% of the variance: the context of pain management, pain assessment and measurement, management of pain, and multidimensional nature of pain. Approximately 42% of nurses had no available protocols related to cancer pain management. Nurses preferred multi-component educational modalities, including simulation-based learning. ConclusionsFindings support internal consistency reliability and content and construct validity of the Nurses' Cancer Pain Management Competency Scale that can help examine pain management competency of nurses. Adopting an evidence-based clinical cancer pain management-related protocol and multi-component training programs are needed to achieve optimal cancer pain management competency in nurses.

Preliminary evidence for the factor structure, concurrent validity, and construct validity of the Roommate Relationship Scale in a college sample.

Roommate relationships are fundamental to the social environment of many emerging adults. However, no validated, widely used, measure of roommate relationship quality exists for examining the impact of these relationships on individual functioning and health. In this report, we present preliminary evidence of the factor structure, concurrent validity, and construct validity of the Roommate Relationship Scale (RRS) as a measure of roommate relationship quality using a sample of U.S. college students who participated in a multi-wave study. An exploratory factor analysis at the first wave, and confirmatory factor analyses (CFAs) with independent samples of new participants at each of two subsequent waves showed stable factor loadings and adequate fit. Moreover, the scale demonstrated good fit and reliability in a longitudinal multilevel CFA framework. The RRS significantly positively correlated with relationship length, self-esteem, extraversion, agreeableness, and conscientiousness, and negatively correlated with symptoms of anxiety and avoidant attachment style, indicating concurrent validity of the scale with respect to these constructs. Consistent with findings from other relationship types, self-reported RRS scores decrease longitudinally, both across and between semesters of academic life, indicating construct validity of the scale. We conclude that the RRS is useful for evaluating roommate relationship quality among U.S. college students, and hopefully beyond. Further research should validate the scale’s utility in other, more diverse, populations and refine its underlying generating psychological process.

P8.153: Confirmatory Factor Analysis of the Chinese Version of Selfmanagement Support Scale for Kidney Transplant Recipients

Objective: To explore the construct validity of the self-management support scale (SMSS) in kidney transplant recipients (KTRs) and determine its effectiveness in measuring kidney transplant recipients self-management support in China. Methods: A cross-sectional study was conducted on 265 renal transplant recipients who followed up at the outpatient department of three general hospitals from October 2020 to March 2021. Measurement tools include: self-designed general situation questionnaire and Self-Management Support Scale. We adopt confirmatory factor analysis to measure the construct validity of the SMSS. The data were analyzed by using AMOS Version 26. All the statistical tests were used two-sided test, with p < 0.05 as statistically significant. Results: (1) General data: the range of age was 21-76 years old, with an average of (46.00 ± 10.80) years. Men accounted for 73%. Most of them lived in cities and towns (85.5%), and used urban medical insurance payment (80.5%). (2) The confirmatory factor analysis model reached a good fit, with χ2 = 480.330, χ2/df= 2.332, p <.001; CFI = 0.901; TLI = 0.889; RMSEA = 0.071, with 90% confidence interval (0.063–0.079); SRMR = 0.065.; SRMR = 0.065. With all the composite reliability(CR) above 0.9 and all the average of variance extracted(AVE) above 0.6. Conclusion: In this first validation study of the instrument, the proposed model largely appears to approximate to a good fit. The SMSS can be used in the measurement of self-management support of renal transplant recipients. Keywords: kidney transplant recipients; self-management support; construct validity; confirmatory factor analysis.

Development of a multidimensional culturally and socially inclusive measure of factors that support resilience: Child Resilience Questionnaire-Child report (CRQ-C)—a community-based participatory research and psychometric testing study in Australia

ObjectiveDevelopment and testing of a comprehensive and social and culturally inclusive child-report measure of resilience factors supporting positive outcomes in the face of adversity.DesignThe measure is based on a socioecological...

Verbal hostility, corporal punishment, nonreasoning strategies, and directiveness in reflecting authoritarian parenting style

Parenting is classified into several types, one of which is authoritarian parenting. Verbal hostility, corporal punishment, nonreasoning / punitive strategies, and directiveness are characteristics of this parenting style. The construct validity and construct reliability of the authoritarian parenting scale, as well as the characteristics and indicators that reflect authoritarian parenting, are being investigated. This study included all students in class VIII at Yogyakarta’s state junior high schools X, Y, and Z, which totaled 524 students. This study’s sample size was 185 students. The sampling technique employs cluster random sampling. Data is gathered using an authoritarian parenting scale. The research instruments are distributed directly to the subject. Structural Equation Modeling (SEM) was used to analyze the research data in the SmartPLS 3.2.8 program. The data analysis results of this study show that the characteristics and indicators that reflect authoritarian parenting are valid and reliable. The most dominant aspect that reflects authoritarian parenting is corporal punishment, while directiveness is the weakest aspect that reflects authoritarian parenting. As a result, because the theory describing the construct of authoritarian parenting corresponds to empirical data obtained from the subject, the measurement model can be accepted.

THE ANALYSIS OF CONSTRUCT VALIDITY OF INDONESIAN CREATIVITY SCALE USING RASCH MODEL

This study was conducted to analyze the construct validity of the Indonesian creativity scale developed by the Integrated Services Unit for Guidance and Counseling Services at the Indonesia University of Education, Indonesia. The research sample was 500 elementary school students in Indonesia, with 22 samples in West Java, Indonesia. This study employed a quantitative approach and a descriptive method with a survey design as the research method. Data were analyzed using the Rasch model using Winstep version 5.1.4. The analysis results show that the interaction between respondents and items is included in the very good category. The respondent’s reliability value which shows the consistency of the respondent in filling out the instrument is included in the very good category. The reliability of the instrument shows that it is in the very good category. However, the unidimensionality of the instrument indicates that the instrument is still not perfect for measurement. In addition, four items do not meet the measurement standards, which have a logit value that is greater than the average value after being added to the standard deviation value, and some item which has a bias in the gender category. It is hoped that with the results of this study, the Indonesian creativity scale instrument can be evaluated and developed so that an accurate instrument is obtained in measuring the creativity of elementary school students.

Buttressing social return’s influence on travel behaviour

ABSTRACT With peer perceptions of vacation pictures on social media becoming firmly entrenched into the tourist psyche and the destination selection process, this paper buttresses the burgeoning research on social return’s influence on travel behaviour through additional theoretical development and empirical investigation. The paper assesses the cross-cultural construct and predictive validity of the Social Return Scale across the United States of America’s top-five international travel markets (Canada, Mexico, United Kingdom, Japan, and China) using a modified Theory of Planned Behaviour model grounded in Guttman’s means-end chain model and Kenrick’s Fundamental Motives Framework. Results confirm the scale’s superb validity providing researchers with the theoretical and empirical support to confidently utilize the Social Return Scale to measure the perceived social return of different travel experiences across different contexts and cultures.