Validity Of Scale Research Articles

Development and validation of a method for deriving MMPI-3 scores from MMPI-2/MMPI-2-RF item responses.

The Minnesota Multiphasic Personality Inventory-3 (MMPI-3; Ben-Porath & Tellegen, 2020a) was developed to expand the content coverage of the MMPI-2-Restructured Form (MMPI-2-RF; Ben-Porath & Tellegen, 2008/2011) and to update the test's norms to better represent the U.S. population. Because most MMPI-3 items were carried over from the MMPI-2-RF, most MMPI-3 scales can be either fully scored or prorated from the MMPI-2/MMPI-2-RF item pool. We describe development of a procedure for deriving MMPI-3 scores from MMPI-2/MMPI-2-RF protocols and examine the psychometric properties of prorated MMPI-3 scores across various samples. Following Tarescavage et al. (2016), who developed a method for prorating most MMPI-2-RF scores from the original MMPI, prorated MMPI-3 scales had to meet three criteria: (a) sufficient representation in the MMPI-2-RF item pool, (b) association with the full-length corresponding MMPI-3 scale at r ≥ .90 in multiple samples, and (c) comparable T score means and standard deviations in multiple samples. These criteria resulted in the exclusion of the three MMPI-3 non-content-based Validity Scales, as well as nine Specific Problems Scales, yielding 16 MMPI-3 scales that can be fully scored and 24 for which psychometrically comparable prorated score estimates can be derived from responses to the MMPI-2 or MMPI-2-RF item pools. Evidence of the psychometric functioning of the resulting scale scores and their comparability with the full versions of these scales across samples is presented and discussed. This procedure provides a means to study 40 of the 52 MMPI-3 scales using archival data obtained with older versions of the inventory. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Clinical validation of the Unesp-Botucatu pain scale in sheep undergoing orthopaedic surgery

Clinical validation of the Unesp-Botucatu pain scale in sheep undergoing orthopaedic surgery

Validation of the Chinese Maudsley three-item visual analogue scale to measure depressive symptoms in a youth population.

Existing self-rated depression measurement tools possess a range of psychometric drawbacks, spanning a range of validity and reliability constructs. The gold standard self-rated depression scales contain several variable items that are often non-specific, require respondents to have a certain level of language understanding and limited scoring options resulting in low sensitivity. The Maudsley three-item visual analogue scale (M3VAS) was developed to address these challenges. This study aimed to translate the M3VAS into Chinese and test its reliability and validity. First, both M3VAS scales (assessing current severity and change in severity) were translated according to a standardised protocol to finalise the Chinese version. Reliability and validity were then examined among 550 young people with moderate to severe depression (patient health questionnaire-9 (PHQ-9) score ≥15) in a cross-sectional opportunistic questionnaire survey. The content validity of each item (six items, across both scales) ranged from 0.83 to 1.00. Exploratory factor analysis denoted a total of two common factors, with a variance contribution rate of 64.34%. The total score correlated positively with the PHQ-9 total score (r = 0.241, P < 0.01). The Chinese version of the M3VAS had good reliability and validity values, and the confirmatory factor model fit well. The psychometric properties of the Chinese version of the M3VAS suggest that this scale can feasibly evaluate depression among young people in China.

Development and validation of the self-regulation of blood donation scale for blood donors

BackgroundBecause knowledge of blood donor motivation is crucial in guiding recruitment and retention efforts, the present study aimed at developing and validating a new scale as a multidimensional measure of blood donation motivation from the perspective of the self- determination theory. MethodsThis study was conducted in three phases from September 2022 to May 2023. The first phase involved developing a draft scale based on a literature review. In the second phase, face and content validity were performed. The third phase used a cross-sectional design to assess the construct validity and internal consistency of the initial scale following administration to blood donors with a history of at least one previous whole blood donation who visited the largest blood transfusion center in Iran. Of the 420 subjects who were recruited using a mixed sampling method, 343 who fully completed the initial version of the scale were subjected to an construct validity assessment using exploratory factor analysis with Equamax rotation and internal consistency using McDonald's omega coefficient. Main resultsThe initial version of the scale consisted of 30 survey items with both a content validity ratio and a content validity index of 0.99. Exploratory factor analysis identified 24 items; grouped in six regulation factors (non-regulation, external regulation, introjected regulation, identified regulation, integrated regulation, and intrinsic regulation). The factors demonstrated adequate internal consistency with ω values ranging from 0.60 to 0.79. ConclusionThe present study provides psychometric support for the newly developed questionnaire to evaluate donation motivation among blood donors in Iran or in other countries with similar language, and religious and cultural values.

How Spiteful Are We? Validation of the Spitefulness Scale in Spaniards.

Spitefulness has been defined as the willingness to cause some kind of harm to other people, even if this action does not bring any benefit and causes harm to herself. Given its relationship with a multitude of antisocial behaviors, interest in studying this trait has been growing and it was in 2014 when the first scale to measure it was validated: the Spitefulness Scale. This study aimed to examine the psychometric properties of its Spanish version. In a sample of 758 participants (M = 31.44; SD = 12.91; 72.80% female), the Spitefulness Scale, the Short Dark Triad, the Assessment of Sadistic Personality, the HEXACO-60, and the Global Assessment of Internet Trolling were administered. Results showed the unidimensionality of the scale, adequate reliability indices, and construct validity, evidenced by positive relationships with the Dark Tetrad traits and trolling behavior. Additionally, the analysis revealed significant gender differences, with males scoring higher on spitefulness. This Spanish validation allows us to establish a solid basis for cross-cultural comparisons. Understanding this trait, considered like the Dark Tetrad traits an antagonistic personality trait, has important implications for understanding the interpersonal and social dynamics. Given that spitefulness is closely related to aggressive behaviors, it is essential to study it to understand the underlying mechanisms of aggression and hostility in social interactions.

Development and validation of the Open-Source Automatic Bowel Preparation Scale.

Development and validation of the Open-Source Automatic Bowel Preparation Scale.

Validation of Hemispherectomy Outcome Prediction Scale in Treatment of Medically Intractable Epilepsy

The Hemispherectomy Outcome Prediction Scale (HOPS) was developed to aid both clinicians and patients in determining the chance of success after hemispheric surgery for medically refractory epilepsy. The original study generating HOPS had a multi-institutional, large cohort format yielding near perfect patient stratification. Evidence suggests that methodologies utilized to create such predictive models, including cross-validation as well as stratification utilizing the same data employed for model generation, may be at risk of an undesirable modeling phenomenon known as overfitting. We posed the question of whether overfitting may be influencing HOPS results and aimed for preliminary evidence of external validation with parameters from patients at our institution not included in the original HOPS study. We found HOPS to stratify our limited post-operative cohort adequately. However, the likelihood of complete seizure freedom among the patients predicted by HOPS to be at greatest chance of success was ~75%, about 20 points lower than in the original HOPS cohort. This reduction in absolute chance of success predicted by HOPS may represent some degree of overfitting. It will be informative to aim for external validation of HOPS utilizing patient cohorts entirely separate from those used for model generation. External validation of HOPS and similar models could optimize realistic prediction of success after intervention.

Development and validation of the Fall Risk Assessment Scale for patients in rehabilitation hospitals: A methodological study.

Falling is a serious threat for patient safety in hospitals. This study aimed to identify the risk factors of fall amongst rehabilitation patients and to use them for developing and validating the Persian version of Fall Risk Assessment Scale (FRAS). The current methodological study was conducted in two phases. In the first phase, based on the review of the literature and investigation of the medical records of 251 patients selected via purposive sampling, the risk factors of fall were extracted and the FRAS was developed accordingly. In the second phase, the face and content validities of the designed scale were determined by cognitive interview and Content Validity Index (CVI) and to evaluate the construct validity, known-groups comparison was performed. Its inter-rater reliability was analyzed using the weighted Kappa Coefficient (κ*). The study adhered to COSMIN guidelines. Fall was significantly associated with disease diagnosis, used medications, history of fall, cognitive impairments, and three items of the Functional Independence Measure (toilet transfer, bed transfer, and shoer transfer). The CVI of the scale was 0.94. The risk for falls group had a significantly higher perceived fall risk than the no risk for falls group, thus establishing known-group validity. Its weighted kappa coefficient was >0.85, its sensitivity was 73%, and its specificity was 82%. The valid and reliable FRAS may accurately assess the level of Fall Risk patients in Rehabilitation wards, helping to predict fall during hospitalization. So, enabling the planning and implementation of effective caring interventions.

Evaluating anxiety and self-confidence in nursing students: Adaptation and validation of the NASC-CDM scale for high-fidelity simulation training

BackgroundAnxiety and self-confidence impact performance and decision-making during high-fidelity simulation in nursing education. A validated tool to assess these factors is lacking. MethodsThe Nursing Anxiety and Self-Confidence with Clinical Decision-Making© scale (NASC-CDM) was translated, adapted for high-fidelity simulation and validated using a five-step approach. This included a Content Validity Index review by experts and pilot-testing with first-year nursing students. Construct validity and internal consistency were evaluated using Exploratory Factor Analysis and Cronbach's alpha. ResultsA total of 187 first-year nursing students participated. Exploratory Factor Analysis identified constructs for anxiety (two factors, 60.72% variance) and self-confidence (three factors, 61.22% variance). The tool demonstrated high internal consistency, with Cronbach's alpha values of 0.956 for anxiety and 0.955 for self-confidence. ConclusionThe 19-item Dutch Nursing Anxiety and Self-Confidence with Clinical Decision-Making for High-Fidelity Simulation scale is a valid and reliable instrument measuring anxiety and self-confidence in nursing students during high-fidelity simulation.

Psychometric Measurements of the Adherence to Refills and Medication Scales Among Patients With HIV/AIDS in Indonesia

ObjectiveThis study aimed to conduct a psychometric evaluation of the Adherence to Refills and Medications Scale (ARMS) among patients with HIV/AIDS in Indonesia. MethodsPsychometric analysis was conducted at 2 hospitals and 7 public health centers at the voluntary counseling and testing clinic. Content validity was measured by assessing the relevance and clarity of each ARMS item. Construct validity was also assessed. Reliability was evaluated using internal consistency and test-retest reliability. ResultsThis study involved 11 experts in the assessment of the content validity and 240 participants in the estimation of the construct validity. All ARMS items were generally considered easy to understand and relevant, with scale-level content validity index based on the average method (S-CVI/Ave) of 0.9 (>0.78) and item-level content validity index (I-CVI) in the range from 0.5 to 1 for the relevance level and S-CVI/Ave of 0.95 (>0.78) and I-CVI in the range from 0.8 to 1 for the clarity level. Two items (numbers 2 and 3) were revised based on experts’ suggestions to enhance comprehension. Confirmatory factor analysis supported 2 subscales: adherence to taking medications and adherence to refilling prescriptions. Good reliability was supported by internal consistency (Cronbach’s α 0.793) and test-retest reliability (intraclass correlation coefficient 0.722) for the overall adherence score. ConclusionsThe Indonesian version of ARMS is a valid and reliable medication adherence scale when used in Indonesian patients with HIV/AIDS.

Validation of the Internet entrepreneurial self-efficacy scale among Romanian technical students.

This study's aim is to evaluate the Romanian version of the Internet Entrepreneurial Self-Efficacy Scale (IESES), a new assessment scale for online entrepreneurial self-efficacy, and estimate its psychometric properties in a sample of engineering students (N = 644; 317 females). The scale was translated and adapted into Romanian through a forward-backward method. The factorial structure was investigated using Confirmatory Factor Analysis (CFA) and multigroup-CFA for gender invariance. The scale was associated with instruments that measure entrepreneurial intention both traditionally and in the online environment (Individual Entrepreneurial Internet Scale and Entrepreneurial Intention Questionnaire) and components from the Theory of Planned Behavior (attitudes, subjective norms and perceived behavioral control). McDonald's omega and Cronbach's alpha coefficients were used to assess reliability. Traditional statistics are complemented by network analysis. Results show that adequate matching items for the 3-factor model and complete gender invariance is maintained. The three factors are associated with the internet and traditional entrepreneurial intention, and the components from the theory of planned behavior (attitudes, subjective norms, and perceived behavioral control). Internal consistency is excellent because α and ω values range between 0.834 and 0.919. In addition, discriminant validity was demonstrated. The network analysis suggests the relevance of technology utilization in the self-efficacy of online businesses in the case of engineering students. Overall, findings enable us to conclude that the Romanian version of the IESES is a valid, accurate instrument that can be implemented to evaluate self-efficacy related to the successful execution of an online business.

Manufactured crisis

Abstract Based on correlational and factorial analysis of data collected from 384 middle and high school students in South Korea, Al–Hoorie et al. (2024) claimed the existence of a discriminant validity crisis within the L2 motivational self-system research tradition and advocated for abandoning research in this area. In this response, we critically examined the evidence presented, re-analyzed their data, and argued that their findings actually support the discriminant validity of the target scales. We also discussed issues related to the design and implementation of their study and refuted their assertion regarding a discriminant validity crisis in this field. Finally, we emphasized the necessity of prioritizing definitional validity in the ongoing methodological reforms of L2 motivation research.

Constructing an integrated model of tourism livestreaming acceptance: scale development and validation

ABSTRACT This research conceptualises tourism livestreaming as an innovation and conducts rigorous scale development of tourism livestreaming acceptance. Tourism livestreaming acceptance is identified as a four-dimensional construct, including acquisition, emotional connection, transformation, and recommendation, which collectively portray comprehensive acceptance. Moreover, the stimuli-organism-response framework serves as a theoretical model that reveals the ‘stimulus-catalytic-acceptance-realization’ influence framework. It is found that acquisition only positively affects offline travel behaviour but not online purchase behaviour, highlighting the differentiation of TLS acceptance dimensions. The results contribute to the enrichment of research on continuance and technology acceptance and provide diagnostic tools for timely prediction, supervision, and segmentation by managers.

Reliability and validity study of the Turkish version of the Schizophrenia Cognition Rating Scale (SCoRS-TR)

BackgroundSchizophrenia is characterized by significant dysfunction in cognitive domains. Despite its crucial role in prognosis, evaluating neurocognitive impairments is challenging in outpatient settings because of the time-consuming nature of neurocognitive assessments. SCoRS “Schizophrenia Cognition Rating Scale” is a scale that provides brief cognitive evaluation. This study aimed to establish the validity and reliability of the Turkish version of the “Schizophrenia Cognition Rating Scale” (SCoRS-TR) in patients with schizophrenia and examine the correlation between SCoRS and cognitive tests. MethodsData were collected from 130 patients with schizophrenia who met the DSM-5 criteria and 40 healthy controls. SCoRS rating, Positive and Negative Syndrome Scale (PANSS), and a neurocognitive test battery were administered. ResultsFindings indicated that SCoRS-TR is a reliable and valid scale for the Turkish population. The scale demonstrated strong internal consistency, with Cronbach's alpha values ranging from 0.937 to 0.940. High interrater reliability (ranging from 0.90 to 0.98) and test-retest reliability (ranging from 0.976 to 0.990) were observed. SCoRS-TR significantly discriminated patients from healthy controls (p<0.001). SCoRS-TR exhibited significant correlations to neurocognitive tests. DiscussionResults indicated that SCoRS-TR had significant reliability and validity scores that may be useful for evaluating daily life functioning related to cognitive dysfunction in patients with schizophrenia. This approach may be useful for neurocognitive evaluation and monitoring in clinical follow-up and outpatient settings.

Validity, Reliability, and Cultural Adaptability of the Arabic Cognitive Flexibility Scale (Ar-CFS) Among Saudi Arabians: A Two-Cohort Investigation.

Background/objectives: Cognitive flexibility is the mental skill that allows a person to shift between different ideas or concepts and think about several concepts simultaneously. A commonly used tool to assess cognitive flexibility is the Cognitive Flexibility Scale (CFS). This study focused on translating and validating the CFS into Arabic, given the lack of existing Arabic tools for assessing cognitive flexibility. Methods: Conducted at King Saud University, Riyadh, between April and June 2024, the study employed random sampling and involved 529 participants, including 419 students and 110 patients. Results: The average participant age was 25.8 years, with females making up 56.9% of the sample. Participants completed the Arabic CFS, along with the Emotion Regulation Questionnaire (ERQ) and the Perceived Stress Scale (PSS), at two time points 3-6 weeks apart. Reliability was evaluated through internal consistency (Cronbach's alpha = 0.8) and test-retest reliability (intraclass correlation coefficient = 0.82). Item analysis indicated that removing any single item did not significantly impact overall reliability, and inter-item correlations were strongest between items 4 and 6 (0.55) and items 6 and 7 (0.51). Validity was assessed through face, content, and construct validity, with factor analysis revealing a dominant single component accounting for 34.4% of the variance, confirming the scale's unidimensionality. Content validity indices for all items exceeded 0.9 in terms of relevance, importance, simplicity, and clarity. The Arabic CFS demonstrated good construct validity, showing significant correlations with the ERQ's reappraisal and suppression dimensions and the PSS. Conclusion: In conclusion, the Arabic version of the CFS is a valid and reliable tool for assessing cognitive flexibility in Arabic-speaking populations. This tool will be valuable in both clinical and research settings within Saudi Arabia, offering a robust instrument for evaluating cognitive flexibility.

Development and Validation of Spiritual Well-Being Scale in India: A Yogic Niyama Perspective.

This study developed and validated the niyama-based spiritual well-being scale (NSWBS) using a mixed-method approach. Niyama is one of the eight limbs of ancient Indian Ashtanga yoga philosophy. There are five niyamas: soucha (internal and external cleanliness and hygiene), santosha (happiness and contentment), tapas (austerity and discipline), swadhyaya (self-study, observation and self-introspection) and ishvara-pranidhana (believe and surrender to the God and cosmic power). Both deductive (using existing spiritual well-being scales) and inductive (focus group discussions) approaches were used to generate items. These statements were first subjected to content validity testing and pre-testing, which resulted in seventeen statements. The psychometric properties of generated items were analyzed with the help of three independent studies that utilized various statistical tests like exploratory factor analysis (EFA), confirmatory factor analysis (CFA), Cronbach's alpha, McDonald Omega, Average variance explained, and Fornell and Larcker criterion. The first study examined the factorial structure of the proposed scale. EFA yielded five factors: Internal and external health and purity, Self-discipline and rigour, Self-introspection and observation, Contentment and gratitude, and Belief in God and higher cosmic power. They explained 62.35% of the total variance. The CFA validated the five factorial structure of the scale. The second study established the proposed scale's internal consistency reliability, convergent, divergent, and predictive validities. Lastly, the third study evaluated and concluded the test-retest reliability of the scale. Overall, the niyama-based spiritual well-being scale depicted appreciable psychometric properties.

Verification of the Validity of a Measurement Scale for Menstrual Abnormalities in Young Women and Consideration of Related Factors

Verification of the Validity of a Measurement Scale for Menstrual Abnormalities in Young Women and Consideration of Related Factors

Comparing the properties of traditional and novel approaches to the modified Rankin scale: Systematic review and meta-analysis.

The Modified Rankin Scale (mRS) is the most commonly used functional measure in stroke research but is limited by inter-rater reliability (IRR). Various interventions to improve mRS application have been described. We aimed to compare properties of differing approaches to mRS assessment. Multidisciplinary databases (MEDLINE, EMBASE, Health and Psychosocial Instruments [OVID], CINAHL, PsycINFO [EBSCO]) were searched for adult human stroke studies describing psychometric properties of mRS. Two researchers independently screened 20% titles and abstracts, reviewed all full studies, extracted data, and conducted risk of bias (ROB) analysis. Primary outcomes for random-effects meta-analysis were IRR measured by kappa (K) and weighted kappa (KW). Validity and inter-modality reliability measures (Spearman's rho, KW) were also summarised. From 897 titles, 46 studies were eligible, including twelve differing approaches to mRS, 8608 participants. There was high ROB in 14 (30.4%) studies. Overall, reliability was substantial (n = 29 studies, K = 0.65, 95% CI: 0.58-0.71) but IRR was higher for novel approaches to mRS, for example, the Rankin Focussed Assessment (n = 2 studies, K = 0.94, 95% CI: 0.90-0.98) than standard mRS (n = 13 studies, K = 0.55, 95%CI:0.46-0.64). Reliability improved following the introduction of mRS training (K = 0.56, 95% CI: 0.44-0.67; vs K = 0.69, 95% CI: 0.62-0.77). Validity ranged from poor to excellent, with an excellent overall concurrent validity of novel scales (n = 6 studies, KW = 0.86, 95% CI: 0.75-0.97). The agreement between face-to-face and telephone administration was substantial (n = 5 studies, KW = 0.80, 95% CI: 0.74-0.87). The mRS is a valid measure of function but IRR remains an issue. The present findings are limited by a high ROB and possible publication bias. Interventions to improve mRS reliability (training, structured interview, adjudication) seem to be beneficial, but single interventions do not completely remove reliability concerns.

Inter-rater and Intra-rater Reliability of Het’s MMT in Pelvic Floor Assessment

Abstract Objective: Pelvic floor dysfunctions (pfds) such as urinary incontinence, pelvic organ prolapse, and vaginismus are very common and are affecting the quality of life of the female suffering through it. The pelvic floor muscles can be in spasm, thus resulting in the inability to relax or the pelvic floor muscles can be extremely weak or loose, resulting in the inability to contract strongly and completely. The spasmodic pelvic floor can result in vaginismus, dyspareunia, chronic pelvic pain, constipation, etc., Moreover, a weak pelvic floor can lead to issues such as urinary incontinence, pelvic organ prolapse, and sexual dysfunction. There is a scarcity of a valid and reliable scale that assesses both the components of pfd. Subjects and Methods: The present study was conducted on 1349 participants which were divided into three groups on the basis of their symptoms. Group A – No symptoms (n = 439), Group B – Hypotonus pfd (n = 658), and Group C – Hypertonus pfd (n = 252). Examination: Vaginal examination to assess the pelvic floor muscles relaxation and contraction was done by Het’s Manual Muscle Testing (MMT). Inter rater reliability was assessed by comparing the data of two independent examiners on the same day. The intra rater reliability was assessed by comparing the data of test and retest at an interval of 1 week. Results: The intra rater reliability at 95% confidence interval (CI) was 0.92 – Normal pelvic floor function, 0.96 – Hypotonus pfd, and 0.97 – Hypertonus pfd. Moreover, inter rater reliability at 95% CI was 0.93 – normal pelvic floor function, 0.95 for hypotonus pfd, and 0.98 – hypertonus pfd. Conclusions: This study concludes Het’s MMT is a highly reliable manual muscle testing tool to assess the pelvic floor muscles.

Translation, cross-cultural adaptation and scale validation to assess professionalism among medical students

Introduction: the professionalism of the physician should be present not only in the technical attributes, such as decision making and clinical reasoning, but also personal and interpersonal attributes, such as empathy, ethics, commitment, sense of social responsibility, altruism, teamwork and confidentiality. However, these attributes should be worked already during the medical course and includes the need to be assessed. Objective: To translate, cross-culturally adapt and validate a scale to assess professionalism in medical students. Method: We conducted a methodological validation study of the Professionalism Assessment Scale for Medical Students developed in Slovenia and authorized by the main author. The study was developed in four phases: translation and retranslation phase; cross-cultural adaptation phase; test and retest phase; and final application phase of the scale. The study population in the final phase consisted of a medical student and the sample was of convenience. The questionnaire was developed through the open LimeSurvey software and available via link in social networks. Data analysis was performed in Epi Info 7.2.4.0 and study approved by the institution’s Research Ethics Committee. Results: 82 students participated, with a mean age of 21 years (SD = 1.8) and predominance of males. Before answering the Professional Assessment Scale (PAS), 73.2% said they knew how to define what professionalism was and 47.3% said they had a medical relative. Participants achieved very high PAS scores, with only 4 participants (4.88%) scoring less than 100. The mean score was 107 on a scale of no more than 110 points. The PAS presented a Cronbach alpha coefficient of 0.7. Conclusion: The study revealed that the students of the educational institution have a high degree of professionalism and the validation of the scale in its final stage reached an acceptable level of reliability and can be used in other studies.