Evidence For Structural Validity Research Articles

Конструктивные функции мечты: от теоретической модели к эмпирической валидизации. Часть 2.

<p>The second part of the article presents an empirical investigation of the hypotheses concerning the positive functions of dreaming set forth in the first part of the article. Study 1 describes the development and validation of the Constructive dreaming Inventory (CDI). The bifactor four-factor ESEM model showed good agreement with empirical data: the questionnaire includes the Overall Constructive Dreaming Index and four specific scales (Dream Presence, Dream Value, Dream Absorption, and Belief in one’s Dream). CDI showed good evidence of structural and convergent validity and sufficiently high scale reliability (a>0.76) for research purposes. In study 2, we tested hypotheses about the correlation of the constructive dreaming (CD) intensity with a range of indicators of positive functioning. We discovered that CD has moderate connections with mental health and well-being, personal autonomy and self-determination, balanced time perspective, eudaimonic motives, and a more positive prognosis of one’s ability to reach one’s personal goals. The hypothesis about the positive associations of CD with the predominance of intrinsic aspirations over extrinsic ones was not proven. Nevertheless, the results suggested that dreams and dreaming play an important role in emotional and motivational regulation of mental activity.</p>

Structural Validity Evidence for the Oxford Utilitarianism Scale Across 15 Languages

Abstract: Background: The Psychological Science Accelerator (PSA) recently completed a large-scale moral psychology study using translated versions of the Oxford Utilitarianism Scale (OUS). However, the translated versions have no validity evidence. Objective: The study investigated the structural validity evidence of the OUS across 15 translated versions and produced version-specific validity reports. Methods: We analyzed OUS data from the PSA, which was collected internationally on a centralized online questionnaire . We also collected qualitative feedback from experts for each translated version. Results: For each version, we produced version-specific psychometric reports which include the following: (1) descriptive item and demographics analyses, (2) factor structure evidence using confirmatory factor analyses, (3) measurement invariance testing across languages using multiple-group confirmatory factor analyses and alignment optimization, and (4) reliability analyses using coefficients α and ω.

Virtual Reality and Serious Videogame-Based Instruments for Assessing Spatial Navigation in Alzheimer's Disease: A Systematic Review of Psychometric Properties.

Over the past decade, research using virtual reality and serious game-based instruments for assessing spatial navigation and spatial memory in at-risk and AD populations has risen. We systematically reviewed the literature since 2012 to identify and evaluate the methodological quality and risk of bias in the analyses of the psychometric properties of VRSG-based instruments. The search was conducted primarily in July-December 2022 and updated in November 2023 in eight major databases. The quality of instrument development and study design were analyzed in all studies. Measurement properties were defined and analyzed according to COSMIN guidelines. A total of 1078 unique records were screened, and following selection criteria, thirty-seven studies were analyzed. From these studies, 30 instruments were identified. Construct and criterion validity were the most reported measurement properties, while structural validity and internal consistency evidence were the least reported. Nineteen studies were deemed very good in construct validity, whereas 11 studies reporting diagnostic accuracy were deemed very good in quality. Limitations regarding theoretical framework and research design requirements were found in most of the studies. VRSG-based instruments are valuable additions to the current diagnostic toolkit for AD. Further research is required to establish the psychometric performance and clinical utility of VRSG-based instruments, particularly the instrument development, content validity, and diagnostic accuracy for preclinical AD screening scenarios. This review provides a straightforward synthesis of the state of the art of VRSG-based instruments and suggests future directions for research.

A Novel, Network-Based Approach to Assessing Romantic-Relationship Quality.

How should romantic-relationship quality be approached psychometrically? This is a complicated theoretical and methodological challenge that we begin to address through three studies. In Study 1a, we identified 25 distinct romantic-relationship categories among 754 items from 26 romantic-relationship-quality instruments with a weak Jaccard index (0.38), indicating that the scales' item content was extremely heterogeneous. Study 1b then demonstrated limited structure validity evidence in 43 scale-development-validation articles of 23 of these 26 instruments. Finally, Study 2 surveyed 587 French-speaking participants in a romantic relationship on romantic-relationship quality. Applying a network-based model, we identified four dimensions, three of which are central to relationship quality. The inferences were mostly limited to French-speaking, monogamous, heterosexual women. To resolve challenges detected in the literature, we recommend a multicountry qualitative approach, more diverse sampling, better definitions of romantic-relationship quality, and a dynamic-systems approach to measuring romantic-relationship quality.

How well do workplace-based assessments support summative entrustment decisions? A multi-institutional generalisability study.

Assessment of the Core Entrustable Professional Activities for Entering Residency requires direct observation through workplace-based assessments (WBAs). Single-institution studies have demonstrated mixed findings regarding the reliability of WBAs developed to measure student progression towards entrustment. Factors such as faculty development, rater engagement and scale selection have been suggested to improve reliability. The purpose of this investigation was to conduct a multi-institutional generalisability study to determine the influence of specific factors on reliability of WBAs. The authors analysed WBA data obtained for clerkship-level students across seven institutions from 2018 to 2020. Institutions implemented a variety of strategies including selection of designated assessors, altered scales and different EPAs. Data were aggregated by these factors. Generalisability theory was then used to examine the internal structure validity evidence of the data. An unbalanced cross-classified random-effects model was used to decompose variance components. A phi coefficient of >0.7 was used as threshold for acceptable reliability. Data from 53 565 WBAs were analysed, and a total of 77 generalisability studies were performed. Most data came from EPAs 1 (n = 17 118, 32%) 2 (n = 10 237, 19.1%), and 6 (n = 6000, 18.5%). Low variance attributed to the learner (<10%) was found for most (59/77, 76%) analyses, resulting in a relatively large number of observations required for reasonable reliability (range = 3 to >560, median = 60). Factors such as DA, scale or EPA were not consistently associated with improved reliability. The results from this study describe relatively low reliability in the WBAs obtained across seven sites. Generalisability for these instruments may be less dependent on factors such as faculty development, rater engagement or scale selection. When used for formative feedback, data from these instruments may be useful. However, such instruments do not consistently provide reasonable reliability to justify their use in high-stakes summative entrustment decisions.

Further refinement of the Patient-Reported Impact of Dermatological Diseases (PRIDD) measure using classical test theory and item response theory.

Existing dermatology-specific Patient-Reported Outcome Measures (PROMs) do not fully capture the substantial physical, psychological and social impact of dermatological conditions on patients' lives and are not recommended for use according to the COSMIN criteria. Most were developed with insufficient patient involvement and relied on classical psychometric methods. We are developing the new Patient-Reported Impact of Dermatological Diseases (PRIDD) measure for use in research and clinical practice in partnership with patients. To examine the factor structure of PRIDD, determine the definitive selection of items for each subscale, and establish structural validity and internal consistency through classical and modern psychometric methods. Two cross-sectional online surveys were conducted. Adults (≥ 18 years) worldwide living with a dermatological condition were recruited through the membership network of the International Alliance of Dermatology Patient Organizations (GlobalSkin). They completed the PRIDD questionnaire and a demographics questionnaire via an online survey. We examined missing data and distribution of scores for each item. The factor structure was assessed using confirmatory and exploratory factor analysis (Survey 1). Internal consistency was examined using Cronbach's α. Rasch measurement theory analyses were conducted, including iterative assessment of rating scale function, fit to the Rasch model, unidimensionality, reliability, local dependence, targeting and differential item functioning (DIF) (Surveys 1 and 2). Participants in Surveys 1 and 2 numbered 483 and 504 people, respectively. All items had ≤ 3% missing scores and all five response options were used. A four-factor model showed the best fit. PRIDD and all four subscales were internally consistent but showed some misfit to the Rasch measurement model. Adjustments were made to rectify disordered thresholds, remove misfitting items, local dependency and DIF, and improve targeting. The resulting 16-item version and subscales fit the Rasch model, showed no local dependency or DIF at the test level, and were well targeted. This field test study produced the final PRIDD measure, consisting of 16 items across four domains. The data triangulated and refined the conceptual framework of impact and provide evidence of PRIDD's structural validity and internal consistency. The final step in the development and validation of the PRIDD measure is to test the remaining measurement properties.

P66: A systematic review of measures of social connection for people living in long-term care homes

Background:Social connection is important for health, quality of life and care in long-term care (LTC) homes. However, research on how to improve social connection in LTC has been limited by lack of consensus on best approaches to measurement.Research Objective:We will present a systematic review of measures of social connection developed for use in LTC residents, which aims to identify all existing measures and evaluate their measurement properties including structural validity, internal consistency, reliability and construct validity.Method:We are following Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) systematic review methods. We searched multiple bibliographic databases from inception to November 2021 for studies that were conducted in LTC resident populations, quantified any aspect(s) of social connection, and reported at least one psychometric property for the measure(s) of social connection. We conducted a second targeted search in April 2022 based on our list of identified measures, supplemented with a list of measures used in previous research in this population. We are currently evaluating the measurement properties reported for each identified measure in accordance with COSMIN guidelines.Preliminary results of the ongoing study:We have identified 68 studies reporting on 35 measures used to assess multiple aspects of social connection in LTC homes. The majority (n=25) were measures of quality of life, wellbeing or life satisfaction, which included a social connection subdomain, whilst only 10 measures specifically target social connection. From our pooled evaluation of 20 measures to date, we have found that 20% (n=4) have sufficient evidence of structural validity, 15% (n=3) have sufficient internal consistency, 25% (n=5) have sufficient reliability, and 15% (n=3) have sufficient construct validity.Conclusion:Many measures have been used to assess social connection in LTC settings, but few are specifically designed for this purpose and they often have insufficient evidence for psychometric properties. This review will provide detailed evidence of the quality of these measures to enable future researchers to prioritise higher quality tools and will inform our development of a new person-centred social connection measurement tool for LTC residents in the Social Connection in Long-Term Care Home Residents (SONNET) study.

Seeking a better balance between efficiency and interpretability: Comparing the likert response format with the Guttman response format.

The Likert item response format for items is almost ubiquitous in the social sciences and has particular virtues regarding the relative simplicity of item-generation and the efficiency for coding responses. However, in this article, we critique this very common item format, focusing on its affordance for interpretation in terms of internal structure validity evidence. We suggest an alternative, the Guttman response format, which we see as providing a better approach for gathering and interpreting internal structure validity evidence. Using a specific survey-based example, we illustrate how items in this alternative format can be developed, exemplify how such items operate, and explore some comparisons between the results from using the two formats. In conclusion, we recommend usage of the Guttman response format for improving the interpretability of the resulting outcomes. Finally, we also note how this approach may be used in tandem with items that use the Likert response format to help balance efficiency with interpretability. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

High Subset Homogeneity Impairs Structural Validity of the Barratt Impulsiveness Scale

Abstract: Problems in providing evidence of structural validity of the Barratt Impulsiveness Scale (BIS) are addressed. As the German translation of a short version of the scale (BIS-15) included pairs of items with highly similar item statements, like the original English version, we hypothesized high subset homogeneity (HSH) as the source of these problems. HSH denotes a situation in which a subset of items shows a larger degree of homogeneity than the remainder of the items of the scale. In a sample of 287 university students, we investigated BIS data by means of confirmatory factor analysis (CFA) models including BIS factors only and models additionally including HSH factors. Whereas the models without HSH factors yielded model misfit, good model fit was observed for the models with HSH factors. These results suggested that BIS items basically showed structural validity, but this validity was impaired by HSH.

A Psychometric Study of a Trait and State Assessment of Sexual Pleasure – The Amsterdam Sexual Pleasure Inventory

ABSTRACT We studied the Amsterdam Sexual Pleasure Inventory’s (1.0) psychometric properties. The ASPI, a revised self-report battery designed to measure domains of state and trait sexual pleasure in diverse gender, sex, and relationship populations, is based on a recently proposed conceptual framework of sexual pleasure. We collected quantitative (n = 1371) and qualitative data (n = 637) using a cross-sectional multi-method design targeting the general (German-speaking) population. After pre-processing, we conducted analyses on a sample of n = 706 participants. The theory-based 5-factor exploratory structural equation model and the principal component analyses of the two general exploratory index-scales showed good and acceptable structural validity evidence respectively. Measurement invariance was confirmed separately for male and female participants and for those with sexually functional-scoring and dysfunctional-scoring levels. Coefficient omega indicated that all scales, except those of one facet, showed acceptable to very good internal consistency. The ASPI’s convergent and discriminant associations with sexological and psychological constructs demonstrated good overall construct validity. Participants understood the items as intended and felt that the ASPI covered relevant facets of sexual pleasure. The ASPI might help understand how individuals differ in experiencing sexual pleasure and how different contexts enable some people to experience pleasure while disadvantaging others.

Occupational Therapy Assessments of Cortical or Cerebral Visual Impairment: A Systematic Review.

Cortical or cerebral visual impairment (CVI), a leading cause of visual dysfunction in children across the globe, can result in delayed development of fine and gross motor skills, functional mobility, and socialization, which affects all areas of occupation. No assessments are recommended for occupational therapy practitioners working with children with CVI. To appraise the measurement properties and clinical utility of CVI assessments appropriate for use by occupational therapy practitioners. MEDLINE via PubMed, Scopus, and Web of Science. We followed the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines for systematic reviews of patient-reported outcome measures for relevant studies. A total of 590 records yielded 15 studies of the measurement properties of 12 assessment tools, 8 patient-reported outcome measures and 4 clinician-reported or performance-based outcome measures. We report on the quality of measurement properties of 10 of the 12 outcome measures. None had high-quality evidence of content validity, structural validity, or test-retest reliability. Most had indeterminate internal consistency as a result of a lack of confirmatory factor analysis. Three instruments demonstrated high quality and sufficient construct validity. On the basis of the COSMIN guidelines, all 12 outcome measures have the potential to be recommended but require further study before definitive recommendations can be made. What This Article Adds: This is the first systematic review of assessments of CVI feasible for use by occupational therapy practitioners. High-quality studies of measurement properties are lacking. Further examination of the measurement properties of outcome measures is required.

The Dark Informant-Rated Triad (DIRT)

Abstract: The “Dirty Dozen” is a popular, brief, self-report scale to capture individual differences in the Dark Triad traits (i.e., narcissism, Machiavellianism, and psychopathy). While the scale has good psychometric properties, there has not yet been an examination of informant ratings for this instrument, despite the apparent utility of informant ratings for providing an observer’s perspective on a target’s personality. We present evidence for the validity of an informant-rated version of the Dirty Dozen – the Dark Informant-Rated Triad (DIRT). Across two studies ( nstudy1= 281; nstudy2= 395 dyads), we found evidence for structural validity (i.e., a three-factor model fits the data well), as well as convergent, discriminant, and criterion-related validity of the DIRT, as well as strong self-informant agreement. We propose future research should examine sources of self-informant disagreement and the extent to which informant-reported Dark Triad trait scores may differ depending on the situation (work vs. home) or informant type (colleague vs. spouse).

Validity and internal consistency of four scales in patients with TMD: PHQ8, GAD7, PHQ15 and JFLS20.

The aim of this cross-sectional study was to explore the structural validity and internal consistency reliability of General Anxiety Disorder-7, Patient Health Questionnaire-8, 15 and Jaw Functional Limitation Scale-20 in patients with chronic pain of temporomandibular disorders. Validity and reliability were assessed in 129 patients diagnosed according to the diagnostic criteria for temporomandibular disorders. Structural validity was explored using factor analysis, and internal consistency by calculating Cronbach α. Confirmatory factor analysis revealed a suitable 2-factor model for Patient Health Questionnaire-8, with Cronbach α of 0.89, and 0.86. One and 2-factor models were suitable for General Anxiety Disorder-7, with overall Cronbach α of 0.93 for the 1-factor model, and 0.91 and 0.84 for both factors in a 2-factor model. A 4-factor solution was appropriate for Patient Health Questionnaire-15, with Cronbach α of 0.72, 0.57, 0.71 and 0.73 for each factor separately. Exploratory factor analysis was conducted to explore the factor structure of Jaw Functional Limitation Scale 20, and a 3-factor solution was appropriate. This study provides positive evidence of structural validity and internal consistency of these questionnaires in patients with pain of temporomandibular disorders. However, additional testing is required to explore further psychometric properties.

Instruments for assessing the spiritual needs of cancer patients: A systematic review of psychometric properties.

To identify available instruments for assessing cancer patients' spiritual needs and to examine their psychometric properties using the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) methodology. Cancer patients frequently have significant spiritual needs. The nurse plays an integral role in assessing the patient's spiritual needs as part of providing holistic care. It is crucial to assess these needs using appropriate and reliable instruments. A systematic review based on COSMIN methodology. Seven electronic databases (PubMed, EMBASE, CINAHL, Web of Science, ProQuest, CNKI and WANFANG) were systematically searched from inception until 14 February 2023. Two authors independently screened eligible literature, extracted data and evaluated methodological and psychometric quality. This systematic review was conducted following the PRISMA checklist. Sixteen studies have reported 16 different versions of the instruments. None of the instruments were properly assessed for all psychometric properties, nor were measurement error, responsiveness and cross-cultural validity/measurement invariance reported. All of the instruments failed to meet the COSMIN quality criteria for content validity. The quality of evidence for structural validity and/or internal consistency in five instruments did not meet the COSMIN criteria. Eventually, five instruments were not recommended, and 11 were only weakly recommended. Instruments to assess spiritual needs exhibited limited reliability and validity. The Spiritual Care Needs Scale is provisionally recommended for research and clinical settings, but its limitations regarding content validity and cross-cultural application must be considered in practice. Future research should further revise the content of available instruments and comprehensively and correctly test their psychometric properties. The review findings will provide evidence for healthcare professionals to select instruments for recognising spiritual needs in cancer patients. This study is a systematic review with no patient or public participation.

The Māori Cultural Embeddedness Scale (MaCES): Initial evidence of structural validity.

The purpose of this article is to introduce a self-report measure of cultural embeddedness for Māori (Māori Cultural Embeddedness Scale [MaCES]), which builds on theoretical and qualitative research on the concept. A total of 548 adults who self-identified as Māori responded to 49 items that were designed to measure aspects of Māori Cultural Values, Beliefs, and Practices. The data were analyzed using confirmatory factor analysis, and invariance was tested through multigroup confirmatory factor analysis. A total of six items were pruned from the measure for having low loadings on the latent factor, having ambiguous wording, and/or measuring contentious concepts. The remaining 43 items fit the data well when organized by three primary factors (i.e., Values, Beliefs, and Practices), further split into secondary subfactors. We also found that this nuanced subfactor model was invariant to sole/mixed identification as Māori, as well as growing up in urban or rural settings. We found evidence of structural validity for the MaCES, but ongoing validation, including convergent and divergent comparisons to other scales, is required in future work. The MaCES is a theoretically derived and statistically sound measure that offers significant research potential for exploring the various ways that embeddedness in Māori culture informs differential outcomes. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Exploratory examination of the scale structure of the Moorong Self-Efficacy Scale: Application of Rasch Measurement Theory

Objective: Exploratory application of the Rasch Measurement (RM) Model for evidence for reproducibility, conceptual/content validity, and structural validity of the Moorong Self-Efficacy Scale (MSES). Study Design: Secondary RM analysis of data collected in a randomized controlled trial comparing two exercise interventions for persons living with spinal cord injury (SCI). Setting: Community-dwelling persons living with SCI enrolled in an exercise study. Participants: Adults (n = 79) enrolled in the parent study had a traumatic SCI > 3 months prior, injury level C5 to T12. Interventions: Not applicable. Outcome measure: The original MSES is a 16-item measure of self-efficacy with a 7-level response scale for un/certainty which was developed for use with persons living with SCI. Results: We addressed item misfit, infrequent category endorsement, and category step disorder by removing two items and reorganizing the rating scale. Rating scale changes removed category 4 (Neutral), combined categories 1–3 (Very Uncertain, Somewhat Uncertain, and Uncertain) for all items, and further combined certainty categories for two items. Principal components analysis of the residuals indicated a possible second dimension with a first-contrast Eigenvalue of 2.4. However, the contrasted item groups had explained variance <10% and a dis-attenuated correlation = 0.92 indicating they measure the same underlying trait. The small sample size precluded examination of differential item functioning. Conclusions: Exploratory RM analysis of MSES produced a 14-item Rasch version which identified structural and content validity evidence concerns inherent in the original MSES. However, results could be biased by a small sample size and further study should examine the item content and rating scale structure with larger, more diverse samples of persons living with SCI.

Revisiting the academic self-concept transcultural measurement model: The case of Spain and China.

Modelling academic self-concept through second-order factors or bifactor structures is an important issue with substantive and practical implications; besides, the bifactor model has not been analysed with a Chinese sample and cross-cultural studies in the academic self-concept are scarce. Likewise, latent structure validity evidence using network psychometrics has not been carried out. The aim of this study is twofold: to analyse (1) the internal structure of ASC through the Self-Description Questionnaire II-Short (SDQII-S) in Chinese and Spanish samples using two approaches, structural equation modelling and network psychometrics conducting an exploratory graph analysis; and (2) the measurement invariance of the best model across countries and investigate the cross-cultural differences in ASC. The sample was composed by 651 adolescents. Seven models of ASC were tested. Results supported the multi-dimensional nature of the data as well as the reliability. The best-fitted model for the two subsamples was the three-factor ESEM model, but only the configural invariance of this model was supported across countries. The graph function shows that the school dimension appears more related to the verbal factor in the Spanish subsample and to the math dimension in the Chinese subsample. Likewise, the relationship between verbal and math factors in Spanish students is non-existent, but this connection is more relevant for Chinese students. These two differences may be behind the difficulty in finding invariance using SEM models. It is a question of the construct's nature, less related to analytical phenomena, and deserves deeper discussion.

I Know What to Do; I Can Do It; It Will Work: The Brief Parental Self Efficacy Scale (BPSES) for Parenting Interventions.

Parental self-efficacy predicts outcomes for parenting interventions for child behaviour problems, but there is a need for a brief measure that can be repeated over treatment and applies to a wide age range. The present study describes the development of such a measure, the Brief Parental Self-Efficacy Scale (BPSES). The psychometrics of the BPSES is presented across a wide age range from preschool to late adolescent in a sample comprised of four different intervention contexts. Evidence for structural validity, internal consistency, content validity, configural measurement invariance (equivalent factor structure) and test-retest reliability is presented alongside convergent validity against measures of parental self-efficacy, child behaviour problems, as well as self-report and observed parenting styles. Finally, lower levels of BPSES at baseline predicted increased disengagement from an intensive, individualised family therapy intervention for antisocial youth, while higher baseline levels predicted increased response to a group parenting programme for primary school aged children. The BPSES shows promise as a measure that can be used across a wide age-range, for a variety of parenting interventions for disruptive behaviour problems and which is sufficiently brief to be used as a routine outcome measurement during treatment.

Psychometric properties of self-reported instruments for occupational balance: A COSMIN-based systematic review

ABSTRACT Introduction Instruments being used currently to evaluate Occupational Balance (OB) are all self-report outcome measures which demand robust psychometric properties for precise assessment. This study aimed to systematically review the psychometric properties of the current OB instruments. Methods For this systematic review, COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidelines and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 were adopted. Peer-reviewed articles published between January 2010 and February 2021 were searched for in PubMed, Cochrane, Web of Science, and PsycINFO databases. Search terms were full names and abbreviations of the OB instruments: Life Balance Inventory (LBI), Meaningful Activity Wants and Needs Assessment (MAWNA), Occupational Balance Questionnaire (OBQ), and Occupational Balance-Questionnaire (OB-Quest). Results Of the 400 articles identified in a systematic database search, 12 studies from 10 articles were analysed. Five instruments, including the revised version of the OBQ (i.e., OBQ11), were analysed within the COSMIN taxonomy. The LBI demonstrated ‘high’ evidence for insufficient structural validity. The others demonstrated ‘moderate’ or ‘high’ evidence for indeterminate structural validity. Less than sufficient structural validity led to indeterminate internal consistency across five instruments, and their quality of evidence varied from ‘very low’ to ‘high’. The MAWNA and OBQ demonstrated ‘very low’ evidence for sufficient reliability. Conclusion OB instruments with psychometric properties of sufficient overall ratings supported by ‘high’ quality of evidence are unavailable. Further studies are required to clarify the concept of OB, to examine more diverse psychometrics of OB instruments, and to consolidate their robustness.

Development and validation of the AI attitude scale (AIAS-4): a brief measure of general attitude toward artificial intelligence.

The rapid advancement of artificial intelligence (AI) has generated an increasing demand for tools that can assess public attitudes toward AI. This study proposes the development and the validation of the AI Attitude Scale (AIAS), a concise self-report instrument designed to evaluate public perceptions of AI technology. The first version of the AIAS that the present manuscript proposes comprises five items, including one reverse-scored item, which aims to gauge individuals' beliefs about AI's influence on their lives, careers, and humanity overall. The scale is designed to capture attitudes toward AI, focusing on the perceived utility and potential impact of technology on society and humanity. The psychometric properties of the scale were investigated using diverse samples in two separate studies. An exploratory factor analysis was initially conducted on a preliminary 5-item version of the scale. Such exploratory validation study revealed the need to divide the scale into two factors. While the results demonstrated satisfactory internal consistency for the overall scale and its correlation with related psychometric measures, separate analyses for each factor showed robust internal consistency for Factor 1 but insufficient internal consistency for Factor 2. As a result, a second version of the scale is developed and validated, omitting the item that displayed weak correlation with the remaining items in the questionnaire. The refined final 1-factor, 4-item AIAS demonstrated superior overall internal consistency compared to the initial 5-item scale and the proposed factors. Further confirmatory factor analyses, performed on a different sample of participants, confirmed that the 1-factor model (4-items) of the AIAS exhibited an adequate fit to the data, providing additional evidence for the scale's structural validity and generalizability across diverse populations. In conclusion, the analyses reported in this article suggest that the developed and validated 4-items AIAS can be a valuable instrument for researchers and professionals working on AI development who seek to understand and study users' general attitudes toward AI.