Psychometric Properties Of Scale Research Articles

Exploring the Loss Aversion Scale's psychometric properties in Spain.

Loss aversion is a psychological construct defined as a tendency to value potential losses more than gains in a situation that requires decision-making. The Loss Aversion Scale (LAS, eight items) measures an individual's loss aversion to various situations. However, the generalization of its psychometric properties to different population groups is unknown. This study aimed to validate the LAS instrument for use among Spanish university adults. To this end, two studies were conducted: a content validity study calculating the substantive validity (N = 24) of the instrument's translation from original English to Spanish and a study of internal structure and association (N = 766) among Spanish university men and women aged 18-35. The analyses performed for each sample indicated that the instrument had adequate validity and reliability values as a one-dimensional measure; however, items 5 and 8 had to be removed. Their scores indicated moderate-magnitude correlations with social desirability. This article debates the study's limitations, practical implications, and future lines of research based on the results. The conclusion is that the Loss Aversion Scale instrument suits general Spanish population samples and requires probable methodological control concerning social desirability.

Assessing Inclusive School Leadership Practices in Malaysia: Instrument Adaptation and Validation

ABSTRACT School leadership practices that promote inclusion for students with special educational needs have received significant attention in the literature. However, few studies have examined the psychometric properties of scales to evaluate principals’ inclusive leadership practices in the Asian, specifically Malaysian, context. This study examined the dimensionality, reliability, and validity of a scale testing inclusive leadership in Malaysian schools. A total of 604 responses were collected from teachers working at 63 public primary and secondary schools in Kuala Lumpur, Malaysia. The study was conducted across two phases. In phase 1, the construct validity of the scale for Malaysian principals’ inclusive leadership practices was established using exploratory factor analysis. In phase 2, a confirmatory factor analysis was conducted to assess the dimensionality, reliability, convergent, and discriminant validity of the scale. Results supported a two-factor, 29-item scale. The scale may be utilised as a reliable and valid instrument for examining principals’ inclusive school leadership practices in the Malaysian context.

INVESTIGATION OF THE PSYCHOMETRIC PROPERTIES OF THE PLATE CLEARING TENDENCY SCALE (T-PCTS) IN TURKISH ADULTS

It is thought that the tendency to finish all the food on the plate (plate clearing tendency) is a behavior that can be frequently observed in individuals and may increase the frequency of obesity. It was aimed to examine the psychometric properties of the Plate Clearing Tendency Scale (PCTS), which was developed to evaluate individual differences in plate clearing tendency, in a sample of Turkish individuals. The study was conducted with 333 adults (32.7% male, 67.3% female) aged between 19 and 64 years (mean 32.4±11.5). Individuals completed the questionnaire online. Validity and reliability analyses were conducted for the Turkish version of the plate cleaning tendency scale (T-PCTS). Confirmatory factor analysis was used to evaluate the factor structure of the T-PCTS, and reliability analyses and Spearman correlations were also examined. The one-factor structure of the T-PCTS showed good model fit and had acceptable internal reliability (Cronbach alpha and McDonald Omega ≥0.70). No relationship was found between T-PCTS and food cravings and its sub-factors (p>0.05). A negative and non-significant relationship was found between total T-PCTS score and body mass index (r=-0.022, p>0.05). T-PCTS is a valid and reliable instrument for measuring plate clearing tendency in Turkish adults. The tendency to clean the plate was not affected by immediate situations that guide eating behavior such as food cravings. Considering that long-term negative eating behaviors are effective in the emergence of obesity, the tendency to clean the plate may be shaped by past eating behaviors and may provide a new perspective on obesity management.

#1204 Measuring needling experience: development and validation of the Needling Patient Reported Experience Measure (NPREM)

Abstract Background and Aims Most people on haemodialysis rely on having reliable access to their vascular system, often via surgically created arteriovenous fistula or graft. At the beginning of each dialysis session, needles must be inserted. While ‘needling’ is a key step, an annual UK survey shows that needling is one of the lowest scoring areas of reported experience for individuals receiving haemodialysis in a kidney centre or satellite unit. Qualitative research indicates that needling can be painful and cause anxiety. Although an emerging area of research, no validated measures exist which assess patient reported experience of needling. We aimed to develop a questionnaire which reliably measures needling experience. The Needling Patient Reported Experience Measure (NPREM) was developed over multiple phases consisting of qualitative interviews with patients, item generation involving a multidisciplinary expert group including experts by experience, cognitive interviewing and pilot testing. Here we report the results of the final validation phase. Methods Seven NHS kidney centres participated in the validation phase (aiming for 500 participants). Between February-April 2023, participants completed either online or paper versions of the questionnaire. A subset of participants (aiming for 80-120) completed a follow-up questionnaire pack (NPREM, Change of Circumstances) 2-4 weeks after the first to assess the reliability of the scale over time. Analyses included a full evaluation of the scale psychometric properties and factor analyses to assess dimensional structure. Correlations with other validated measures (Vascular Access Quality of Life [VASQoL], EuroQol 5 Dimension [EQ5D-5L], and Patient Activation Measure [PAM]) were used to assess the convergent and divergent validity of the NPREM. Results 468 people participated (sample characteristics: male 66%, mean age 66 years (SD 14), White 75%, access via fistula 95%, first access 76%), of which 99 completed the follow-up. Overall, the NPREM showed good internal consistency (Cronbach's alpha = 0.94) and moderate to strong inter-item correlations. Factor analyses indicated that needling experience was a unidimensional construct, with one strong, main factor. Follow-up scores were strongly correlated (r = 0.89) with participants’ initial NPREM responses, demonstrating high reliability. Evidence of convergent validity was seen in the strong correlations between the NPREM and 1) the VASQoL (r = 0.60) and 2) the Overall Needling Experience question (r = 0.79). NPREM did not correlate with the EQ-5D (r = −0.31), the EQ-5D overall health (r = 0.24) or PAM (0.17), demonstrating divergent validity. The research team reviewed all items and themes reaching a consensus on items included, resulting in the validated 28-item NPREM (v 1.0), across five themes of care (Communicating with the Team, My Fistula/Graft and Needling, Steps in Needling, Working Together, My Personal Experience) plus Overall Needling Experience. Conclusion These results indicate that the NPREM offers a robust needling-specific tool to measure patient experience in those receiving haemodialysis. It addresses a gap by offering a way for kidney care providers to assess needling experience, both as a whole and across themes of care, which may facilitate meaningful service improvements. When published, the NPREM will be publicly available and free to use.

Development and psychometric evaluation of the adjuvant endocrine therapy beliefs scale for breast cancer survivors.

Adjuvant endocrine therapy has a vital role in reducing breast cancer mortality. The beliefs in adjuvant endocrine therapy is a very important factor in the medication adherence of breast cancer survivors. Therefore, it is necessary to develop a standardized scale for assessment of adjuvant endocrine therapy. The purpose of this study was to identify the attributes of adjuvant endocrine therapy beliefs, and to evaluate adjuvant endocrine therapy beliefs scale psychometric properties. A hybrid model was applied to identify the concept of adjuvant endocrine therapy beliefs and measurement question were developed by the scale development process. Statistical analysis using validity analysis and Rasch analysis based on item response theory were performed. A total of 228 breast cancer survivors in South Korea participated in the study. The finally developed adjuvant endocrine therapy beliefs scale consisted of 22 items. The items extracted by 4 factors explained 59.72% of the total variance. The model fit showed an acceptable level. The adjuvant endocrine therapy beliefs scale was excellent in convergent and discriminant validity with reliability. This scale is expected to be practical and useful in identifying adjuvant endocrine therapy beliefs and developing intervention strategies to promote adjuvant endocrine therapy adherence. In addition, continuous education and support should be accompanied so that breast cancer survivors can maintain positive beliefs in adjuvant endocrine therapy adherence.

Development and Validation of the Jawline Subject Satisfaction Scale

Introduction: Research in aesthetic medicine commonly includes evaluations of subject satisfaction with treatment results. However, conventional analytic methods typically generate statistically imprecise ordinal scores. To overcome this limitation, researchers have begun employing the Rasch model, an analytical framework grounded in item response theory. The Rasch model permits scale modifications capable of enhancing measurement accuracy. This study focuses on using the Rasch model to evaluate a scale measuring subject satisfaction following aesthetic treatments to the jawline. Objective: To develop and validate a multiitem, self-administered questionnaire measuring patient satisfaction with aesthetic treatment of the jawline. Methods: A 10-item questionnaire [The Jawline Subject Satisfaction Scale (JS3)] was devised to measure subject satisfaction following aesthetic treatments of the jawline. Each question was responded to using a 5-point Likert scale, with response selections ranging from “very much satisfied” to “very much dissatisfied” or “strongly agree” to “strongly disagree.” The scale's psychometric properties (reliability and separation for items and persons, item and person fit statistics, and unidimensionality and local independence) were validated using a Rasch model based on a dataset collected from a sample of forty subjects. Results: The results of the Rasch analysis revealed high internal consistency of the JS3, with a person reliability estimate of 0.86 and an item reliability estimate of 0.96. The separation estimates for persons and items were 2.50 and 4.72, respectively, demonstrating the scale's ability to differentiate between high and low responders and validating the instrument's construct. All infit and outfit values fell within the established range (0.5-1.5), and the data fit the model of unidimensionality and local independence. Raw score transformations into logits were conducted, which were then converted to Rasch measurements. These measurements are available for use in practice for conducting standard statistical analyses evaluating treatment and/or group effects. Conclusions: The application of the Rasch model produced a valid and reliable scale (ie, JS3) for measuring satisfaction with the appearance of the jawline following aesthetic treatments.

Psychometric properties of the spatial skills self-efficacy scale: A validity and reliability study

The aim of this study was to develop a valid and reliable spatial skills self-efficacy scale for middle school students. To this end, the study sampled 5th-, 6th-, 7th-, and 8-grade students in the spring term of the 2021–2022 academic year. The data were collected from 1369 students for the pilot study and the validity and reliability analysis to investigate the psychometric properties of the scale. Twenty-five subject matter experts were asked for opinions and Lawshe's content validity ratio (1975) was used to measure the content validity of the scale. The results of the exploratory factor analysis conducted for the construct validity yielded a four-factor structure consisting of seventeen items, which accounted for 41.37 % of the total variance. The factor loadings of the scale items ranged from 0.41 to 0.75. When the fit indices of the model were examined as a result of Confirmatory Factor Analysis, it was determined that the firstorder multifactor structure were within the excellent or acceptable value ranges. The Cronbach's alpha coefficient was found to be 0.77 for the total scale. The results of the independent samples t-test for the upper and lower 27 % groups showed a significant difference between the groups for all scale items. The correlation coefficients of the subscales with one another and with the total scale showed significant positive moderate and high correlations. The test–retest reliability coefficients also showed significant positive moderate and high correlations. These results indicate that the Spatial Skills Self-Efficacy Scale is a measurement tool that produces valid and reliable measurements and can be used to determine the spatial skills self-efficacy of middle school students.

Study protocol for measuring stigmatization in persistent tic disorders: development and validation of the Tourette discrimination-stigmatization scale.

Persistent Tic Disorders such as Tourette Syndrome are common neurodevelopmental disorders that are highly stigmatized. Many individuals with Persistent Tic Disorders experience peer rejection, loneliness, and self-stigma. Experiencing stigmatization during childhood can influence the persistence of moderate-to-severe tics later in life. Additionally, these factors have been associated with increased suicidal ideation, suicide attempts, and psychiatric symptom severity. There is a need for interventions to reduce stigma and stigmatization in Persistent Tic Disorders. Before developing cost-effective interventions to mitigate stigma's profound downstream health impacts, a reliable measure of stigmatization must be created. The overarching goal of this research is to develop and validate the Tourette Discrimination-Stigmatization (TD-STIGMA) Scale. This paper presents the study protocol for developing and validating the TD-STIGMA Scale. The study is designed as a mixed methods study to develop the TD-STIGMA scale and evaluate its psychometric properties. The study uses a phased approach: (1) collection of narrative and thematic content data through in-depth qualitative interviews of stakeholders, (2) development of a novel TD-STIGMA self-report scale using the Delphi Method based on these results, and (3) completion of analyses to determine the scale's psychometric properties (confirmatory factor analysis, convergent, known-group, criterion validity, and test-retest reliability). This project will result in a personalized approach to stigma measurement about youth and young adults with Persistent Tic Disorders, which to date does not exist. There are several limitations. Comorbidities or spiritual or cultural beliefs may affect perceptions of stigma and are not directly assessed in this study. We will utilize institutional resources for community outreach to purposefully sample underrepresented minorities who may be at disproportionate risk of adverse outcomes. However, this may not be fully representative of the generalized tic population. The study team will be purposeful in maintaining participant engagement for study retention. Lastly, participants from a tertiary referral center may not fully represent the generalized tic community. However, we hope our broad recruitment strategy and virtual study visits will facilitate a diverse and inclusive sampling of the patient population.

Measuring social determinants of health in the All of Us Research Program

To accelerate medical breakthroughs, the All of Us Research Program aims to collect data from over one million participants. This report outlines processes used to construct the All of Us Social Determinants of Health (SDOH) survey and presents the psychometric characteristics of SDOH survey measures in All of Us. A consensus process was used to select SDOH measures, prioritizing concepts validated in diverse populations and other national cohort surveys. Survey item non-response was calculated, and Cronbach’s alpha was used to analyze psychometric properties of scales. Multivariable logistic regression models were used to examine associations between demographic categories and item non-response. Twenty-nine percent (N = 117,783) of eligible All of Us participants submitted SDOH survey data for these analyses. Most scales had less than 5% incalculable scores due to item non-response. Patterns of item non-response were seen by racial identity, educational attainment, income level, survey language, and age. Internal consistency reliability was greater than 0.80 for almost all scales and most demographic groups. The SDOH survey demonstrated good to excellent reliability across several measures and within multiple populations underrepresented in biomedical research. Bias due to survey non-response and item non-response will be monitored and addressed as the survey is fielded more completely.

Psychometric Properties of the Healthy Lifestyle Behaviors Scale in Portuguese Pregnant Women.

Pregnancy provides a privileged and opportune moment to implement interventions promoting healthy lifestyle behaviors and significantly improving perinatal outcomes. The Healthy Lifestyle Behaviors Scale (HLBES) can be used to assess health promoting behaviors, such as diet, physical activity, and mental health. This study aimed to examine the psychometric properties of the HLBES in Portuguese pregnant women. A methodological study was conducted on a convenience sample of 192 pregnant women receiving prenatal care. After cross-cultural adaptation, an exploratory factor analysis and internal consistency assessment were carried out to evaluate the psychometric properties of the scale. Data collected included the Healthy Lifestyle Beliefs Scale to assess the HLBES' criterion validity. Exploratory factor analysis with Varimax rotation yielded 2 subscales that explained 45.23% of the total variance. The scale revealed an overall internal consistency of 0.78 and a good criterion validity with the Healthy Lifestyle Beliefs Scale (r = 0.65, P < .01). Our results suggest that the HLBES is an instrument for reporting healthy lifestyle behaviors in Portuguese pregnant women; however, further studies are recommended. This scale can be used to not only describe healthy lifestyle behaviors in pregnant women but also to determine the effects of health promoting interventions.

Assessment of Teacher Motivation, Psychometric Properties of the Work Tasks Motivation Scale for Teachers (WTMST) in Spanish Teachers

The lack of motivation among teachers is of increasing concern. Consequently, identifying motivations for their teaching performance can help to improve the quality and effectiveness of educational systems. The aim of this article was to translate the Work Tasks Motivation Scale for Teachers (WTMST) into Spanish, an instrument aimed at exploring teachers’ motivation and analyzing its psychometric properties. A non-probabilistic sample of 369 teachers (71.3% women) with an age measurement of 44.93 years (SD = 9.58) was used. Exploratory factor analysis and confirmatory factor analysis were applied. The AFE suggested a first solution of four factors that explained 80.57% of the variance in the model. Likewise, a new factor analysis was generated with the extraction of a fixed number of factors indicated in the theoretical review, explaining 86.20% of the total variance. It was concluded that the WTMST is a scale that has evidence of validity and reliability, and that can be considered a valuable contribution to the evaluation of teacher motivation regarding specific tasks in Spanish-speaking populations.

Development and validation of a delirium care critical-thinking scale for intensive care unit nurses: A mixed-method study.

To develop a Delirium Care Critical-Thinking Scale for nurses caring for patients in the intensive care unit and examine the scale's psychometric properties. There is a tool to evaluate nurses' critical thinking skills to determine nursing competency when delirium care is required. This cross-sectional, mixed-methods study. The Delphi method was applied for collection and analysis of data during conceptualization and item generation of the tool (Phase I). Item analysis, assessment of validity and reliability of the scale (Phase II) involved 318 nurses recruited by convenience sampling from nine adult intensive care units in medicine and surgery at one medical centre. Confirmatory factor analysis assessed construct validity. Internal consistency and 2-week test-retest stability measured reliability. A Critical Thinking Disposition Inventory Scale examined concurrent validity. After three rounds, the Delphi method resulted in 31 scale items. Item analysis demonstrated construct reliability ranged from 9.23 to 16.18. Confirmatory factor analysis eliminated one item and extracted five factors: applying knowledge, confirming the problem and accuracy of information, reasoning logically, choosing appropriate strategies and remaining open-minded. Average variance extracted values of all factors indicated good convergent validity. Cronbach's α for internal consistency was .96 with good test-retest reliability. The correlation coefficient for concurrent validity was .301. The new Delirium Care Critical-Thinking Scale for intensive care nurses was demonstrated to be a reliable and valid tool for evaluating their ability to assess patients with delirium. This new scale could be used to assess outcomes of education interventions and the effectiveness of nursing care quality involving patients with delirium in intensive and critical care units. The COSMIN checklist was used as the reporting guideline for this study. None.

Psychometric Properties of Indonesian Version of Teacher Classroom Management Efficacy Scale

Teacher self-efficacy (TSE) in classroom management is an important predictor of teaching practice, but there are limited studies on the application in Asian countries, particularly Indonesia. Therefore, this study aimed to describe psychometric properties of Classroom Management Efficacy scale in Indonesian version. Psychometric properties of the scale were evaluated using a total of 582 Indonesian teachers, who served as participants. The results supported a bifactor model with high internal consistency, showing that the scale could be psychometrically sound measure of TSE in classroom management in Indonesian version.

Psychometric validation of the Arabic multiple sclerosis resiliency scale: Uncovering resilience factors in Lebanese MS patients for clinical and research advancements

BackgroundMultiple sclerosis (MS) is an autoimmune demyelinating disease that involves the central nervous system (CNS). Individuals with Multiple Sclerosis (MS) may experience difficulty adapting to their diagnosis as the unpredictable nature of the disease can be challenging to cope with. MethodsThe purpose of this study is twofold. First, we have culturally adapted and analyzed the Arabic version of the Multiple Sclerosis Resiliency Scale (MSRS) psychometric properties. Second, we aimed to explore resilience in a sample of Lebanese patients with MS in the face of the chronic disease and financial hardship that Lebanon is going through to evaluate their strengths and struggles. The sample consisted of 306 participants aged between 18 and 79 diagnosed with MS for at least one year. ResultsAfter examining criterion validity, construct validity, internal consistency, and test-retest reliability, the Arabic version of the MSRS exhibited good psychometric properties. The study also revealed that resilience increases with age and lower disability scores. Additionally, individuals with higher resilience levels displayed lower levels of depression. The research revealed that MS patients have high resilience, mainly relying on cognitive and emotional strategies, social support from family and friends, MS peer support, and spirituality. ConclusionThese findings highlight the importance of emotional coping strategies and social support in building resilience among MS patients.

Cross-cultural adaptation and psychometric evaluation of the “Modification of Hall’s professionalism scale for use with pharmacists”

BackgroundProfessionalism is the demonstration of behaviors that guide the actions of health professionals. In Pharmacy, its implementation is possible through assessment instruments for pharmacists, such as the “Modification of Hall’s Professionalism Scale for Use with Pharmacists”.ObjectiveTo translate the “Modification of Hall’s Professionalism Scale for Use with Pharmacists” into a Brazilian Portuguese version and evaluate its psychometric properties for pharmacists.MethodThe methodological process of this study took place in three stages: translation and cross-cultural adaptation of the instrument original version into a Brazilian Portuguese version; validation of the scale content through consensus among geographically distinct experts and, finally; examination of the scale psychometric measurement properties through a convenience sample of 600 Brazilian pharmacists. At this stage, construct validity was verified using Exploratory Factor Analysis (EFA) and reliability was examined by calculating the composite reliability.ResultsThe adapted instrument to a Brazilian Portuguese version demonstrated content validity with coefficients considered acceptable, above 0.8. The EFA demonstrated a structure supported by six factors and 39 items. The H index suggested high stability for all factors as well as composite reliability.ConclusionThe Brazilian Portuguese version of the instrument presented appropriate content validity coefficients and psychometric properties. This measure may be useful for future studies on professionalism regarding teaching strategies and assessment of this construct among pharmacists.

Psychometric investigation of the gamification Hexad user types scale with Brazilian Portuguese adolescents speakers

Gamification has been applied in different fields over the last years, impacting the development of technologies, services, and products towards a more game-like world. Albeit its success, some results indicated personal differences influencing the success of its application, leading to the creation of user models (e.g., Hexad), a way to represent user profiles in gamified environments. Even though a great effort has been made to create and discuss instruments to represent these user models, many of them lack investigation into their psychometric properties. At the same time, although gamification can be particularly interesting in engaging adolescents, few attempts analyzed instruments considering this population. Addressing this lack, in this study, we evaluated the psychometric properties of the gamification Hexad scale in Brazilian Portuguese considering a sample (N = 110) of adolescents aged between 13 and 16 years old. Through a quantitative study (i.e., confirmatory factor analysis and correlation), we analyzed the psychometric properties of the scale and the correlations between user types when using data collected from adolescents. Results demonstrated that the current version of the scale needs improvements to better assess the user types of the Brazilian adolescent population, especially regarding the Disruptor user type. Also, the user types presented fewer correlations when compared with the adult sample. At the same time that the results of this study can be used in the academy and industry as a source of measurement of user types from Brazilian adolescents, it also opens several possibilities for new studies in personalized gamification considering this population.

Protocol for the development and validation of a patient reported measure (PRM) of treatment burden in stroke.

Treatment burden is the workload of healthcare for people with long-term conditions and the impact on wellbeing. A validated measure of treatment burden after stroke is needed. We aim to adapt a patient-reported measure (PRM) of treatment burden in multimorbidity, PETS (Patient Experience with Treatment and Self-Management version 2.0), to create a stroke-specific measure, PETS-stroke. We aim to examine content validity, construct validity, reliability and feasibility in a stroke survivor population. 1) Adaptation of 60-item PETS to PETS-stroke using a taxonomy of treatment burden. 2) Content validity testing through cognitive interviews that will explore the importance, relevance and clarity of each item. 3) Evaluation of scale psychometric properties through analysis of data from stroke survivors recruited via postal survey (n=340). Factor structure will be tested with confirmatory factor analysis and Cronbach's alpha will be used to index internal consistency. Construct validity will be tested against: The Stroke Southampton Self-Management Questionnaire; The Satisfaction with Stroke Care Measure; and The Shortened Stroke Impact Scale. We will explore known-groups validity by exploring the association between treatment burden, socioeconomic deprivation and multimorbidity. Test-retest reliability will be examined via re-administration after 2 weeks. Acceptability and feasibility of use will be explored via missing data rates and telephone interviews with 30 participants. We aim to create a validated PRM of treatment burden after stroke. PETS-stroke is designed for use as an outcome measure in clinical trials of stroke treatments and complex interventions to ascertain if treatments are workable for patients in the context of their everyday lives.

Domains and Psychometric Properties of Scales Measuring Disaster Preparedness among General Population: A Systematic Literature Review.

There is no universal tool for measuring disaster preparedness in the general population. This study aimed to provide a summary of the domains and psychometric properties of the available scales that assess preparedness for disasters, or one of its main types, among individuals or households. This study is a systematic review of the literature on disaster preparedness tools. Studies published up to December 2022 were identified through a systematic search of four databases: Google Scholar, PubMed, Scopus, and Web of Science. Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) were used to review and evaluate the psychometric properties. The Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines were used to report this article. Twelve articles met the inclusion criteria. Among them, five scales measured general disaster preparedness, five measured earthquake preparedness, one measured flood preparedness, and one measured bushfire preparedness. The scales had a number of dimensions ranging from one to six. The most common item topics in the included scales were as follows: having an evacuation plan (n = 7), information source (n = 7), fire extinguisher (n = 6), and emergency kit (n = 5). The scales were rated sufficient for content validity (n = 10), structural validity (n = 5), internal consistency (n = 5), and test-re-test reliability (n = 6). One scale was checked for criterion validity and was rated as insufficient according to the COSMIN guidelines. The findings suggest the need to improve the psychometric properties of the scales, expand their contents, and develop scales relevant to target populations. This study provides useful information for researchers to develop comprehensive assessment tools and valuable sources of items for future scales.

Theory, Measurement, and Psychometric Properties of Risk and Protective Factors for Drug Misuse Among Adolescents Living on or near the Cherokee Nation Reservation

A team of tribe-based behavioral health specialists and university-based researchers partnered to implement a cluster randomized trial for the prevention of drug misuse among adolescents attending public high schools on or near the Cherokee Nation Reservation in northeastern Oklahoma. The conceptual framework, which guided intervention and measurement design for the trial, incorporates indigenous knowledge and worldviews with empirically-based frameworks and evidence-based practices. Our goal is to serve multicultural youth, families, and schools and to provide a model of effective strategies for wide dissemination. This paper presents the conceptual model, survey design, and psychometric properties of scales to measure risk and protective factors for substance misuse. The survey includes common measures drawn from the PhenX Toolkit on substance use patterns—adolescent module, measured with standard items from the Monitoring the Future (MTF) study and items harmonized across ten NIH-funded research projects with diverse samples of youth. In our trial, brief (20-minute) self-report questionnaires were administered to 10th grade students in fall 2021 (n = 919, 87% response rate) and spring 2022 (n = 929, 89% response rate) in 20 participating high schools on or near the Cherokee Nation Reservation. The sample primarily fell into the following three categories of race/ethnicity identification: only American Indian (AI-only, 29%), AI and another race/ethnicity (AI+, 27%), and only White (35%). Results indicate that risk and protective factor scales were reliably and validly measured with 10 scales and 10 subscales. There were minimal differences between youth who identified as AI only, AI+, and White only, especially for the main scales, which provide confidence in the interpretation of trial outcomes across demographic groups. Study results may not be generalizable to AI/AN youth who live and attend school in more homogenous reservation lands, or alternatively, live in large diverse metropolitan areas.

Examining measurement invariance of an ICT literacy self-efficacy scale across gender: a comparative study

PurposeDespite the ever-increasing importance of cultivating information, communication and technology literacy skills among college students, they have yet to be related to comprehensive measuring instruments. A glance at the empirical literature reveals that most pertinent scales have been confined to measuring Internet literacy skills, whereas educators in the 21st century advocate an inclusive conceptualization of ICT literacy. Such a comprehensive conceptualization embodies technical, critical, cognitive and emotional competencies. Additionally, more empirical evidence is needed to indicate gaps in testing measurement invariance of ICT literacy scales across genders or cultures. To that end, the current study aims to adapt and cross-validate an ICT literacy self-efficacy scale across gender by testing the measurement invariance using a multiple-sampling confirmatory factor analysis (MCFA). Furthermore, the current study aims to verify the ICT literacy self-efficacy scale's psychometric properties to establish its construct validity and understand the scale's underlying factorial structure.Design/methodology/approachThe current study has administered the scale to a cross-sectional sample of 3560 undergraduate students enrolled in six universities in the Sultanate of Oman.FindingsThe results have revealed that the ICT literacy self-efficacy exhibits satisfactory indices of construct validity. On the other hand, the results of MCFA demonstrate that the differences in the goodness of fit indices between the nested models and the baseline model were below the cut-off criterion of 0.01, indicating invariance. Therefore, the scale has proved to be amenable for comparing genders on their ICT literacy self-efficacy using an one-way multivariate analysis of variance.Originality/valueThe study has several implications for research and pedagogical practices. The study provides empirical evidence for establishing ICT literacy self-efficacy as a distinct high-domain construct of task-specific self-efficacy beliefs.