Validity Index Research Articles

A survey of genetic algorithms for clustering: Taxonomy and empirical analysis

Clustering, an unsupervised learning technique, aims to group patterns into clusters where similar patterns are grouped together, while dissimilar ones are placed in different clusters. This task can present itself as a complex optimization problem due to the extensive search space generated by all potential data partitions. Genetic Algorithms (GAs) have emerged as efficient tools for addressing this task. Consequently, significant advancements and numerous proposals have been developed in this field.This work offers a comprehensive and critical review of state-of-the-art mono-objective Genetic Algorithms (GAs) for partitional clustering. From a more theoretical standpoint, it examines 22 well-known proposals in detail, covering their encoding strategies, objective functions, genetic operators, local search methods, and parent selection strategies. Based on this information, a specific taxonomy is proposed. In addition, from a more practical standpoint, a detailed experimental study is conducted to discern the advantages and disadvantages of approaches. Specifically, 22 different cluster validation indices are considered to compare the performance of clustering techniques. This evaluation is performed across 94 datasets encompassing diverse configurations, including the number of classes, separation between classes, and pattern dimensionality. Results reveal interesting findings, such as the key role of local search in optimizing results and reducing search space. Additionally, representations based on centroids and labels demonstrate greater efficiency and crossover and mutation operators do not prove to be as relevant. Ultimately, while the results are satisfactory, real-world clustering problems introduce additional complexity, especially for algorithms aiming to determine the number of clusters, resulting in diminished performance and the need for new approaches to be explored. Code, datasets and instructions to run algorithms in the LEAL library are available in an associated repository, in order to facilitate future experiments in this environment.

Psychometric Properties of Turkish Post-Apocalyptic and Doomsday Prepping Beliefs Scale in Turkey.

This is a methodological study of the Turkish version of the PAPBS, aiming to test its reliability and validity. The research was conducted in 2023 via social media across Türkiye, using the snowball sampling method. The item-level content validity index of the scale ranged between 0.82 and 1.00. The Cronbach's alpha value of the scale was determined to be 0.78. According to the findings, there was a high, positive, and significant relationship between the two halves of the scale (r: 0.71; p < 0.001). The findings and goodness of fit values indicate that the scale can be used validly and reliably in Turkish culture.

A Comparative Study of Multivariate Clustering Algorithms for Climate Variables and Chickpea Production in Dharwad District of Karnataka, India

India's agriculture sector holds immense significance in its economy, and this study delves into how different clustering techniques can enhance our comprehension of the interplay between weather patterns and chickpea production in Dharwad district, specifically Density-Based Spatial Clustering of Applications with Noise (DBSCAN), K-Means, and Hierarchical clustering methods to discern underlying patterns within climate variables and chickpea yield data. Leveraging historical weather data spanning an extensive 42-year period and crop yield records were employed to train and validated. The findings illuminate that K-Means clustering consistently outperforms DBSCAN and Hierarchical clustering when evaluated through a variety of validity indices, including the Silhouette Coefficient, Calinski-Harabasz Index, Davies-Bouldin Index, and the determination of the optimal number of clusters. In essence, India's pivotal agricultural sector dynamics and the intricate relationship between climatic factors and chickpea production in Dharwad district are elucidated effectively by the superiority of K-Means clustering in this study.

Validity and Reliability of the Turkish Version of the Self-Efficacy Regarding Vaginal Birth Scale: A Methodological Study

Aim: The aim of the study was to test validity and reliability of the Self-efficacy Regarding Vaginal Birth Scale in Turkish. Material and Methods: The methodological study was conducted in a university hospital with 165 pregnant women. The data were collected using "Personal Information Form", "Self-Efficacy Regarding Vaginal Birth Scale and "Childbirth Self-Efficacy Inventory - Short Form". Language validity, content validity, confirmatory factor analyse and criterion-dependence validity and were performed to test the validity of the scale. The scale’s reliability was assessed using the item-total correlation, Cronbach’s alpha, split-half test method and test-retest analysis. Results: The scale content validity index was found above 0.80. In the confirmatory factor analysis, all the goodness of fit indexes had acceptable values. Item-total correlations ranged between 0.167 and 0.809 for each item and were positively correlated with the scale total. In line with the recommendations of experts, no items were removed from the scale. It was determined that the scale was collected under one factor as 9 items. The correlation between the two halves of the scale is 0.76, the Spearman-Brown coefficient is 0.86, and the Gutmann Split-Half coefficient is 0.85. The Cronbach’s alpha coefficient calculated for the overall scale was 0.87. The total correlation of the items and the test-retest correlation showed high reliability with 0.924 (p

Cultural tailoring advance care planning for an American Indian community: make your wishes about you

ABSTRACT Background Advance care planning empowers people by allowing them some control over certain healthcare decisions in the event they are unable. Yet, advance care planning rates in the American Indian and Alaska Native populations are low. Thus, we culturally tailored the Make Your Wishes About You (MY WAY), an intervention to improve advance care planning access and completion for American Indian peoples. Methods In partnership with an American Indian Tribe, the project took a community-based participatory orientation and relied on a Community Advisory Board and a Professional Advisory Board. The culturally tailoring was a 15-step process. These steps allowed us to ensure that the tailoring reflects community-specific norms and preferences, greater reliance on visual images and local idioms of expression, more appropriate attention to family roles, and inclusion of spiritual elements. Results A four-phase cultural tailoring framework emerged with each phase centering around listening, learning, and analyzing with tailoring occurring between each phase. A culturally tailored MY WAY was created, which was delivered in a manner that reflected Tribal citizenss' preferences. Materials included Tribal language, local idioms of expression, attention to family roles, and appropriate inclusion of spiritual elements. The materials were rated high on a content validity index by the advisory board members. Conclusion There is a growing interest in tailoring existing evidence-based programs with relatively little in the literature offering guidance. By sharing our efforts and experiences in culturally tailoring an advance care planning program for an American Indian Tribe, we hope that it will serve useful for future efforts in ensuring that evidence-based programming reaches those in greatest need. While this project was rooted in the core Indigenous values of community, ceremony or spirituality, language, and place it also lends itself to broader translation across different populations.

Validation of a novel system to quantify authorship diversity in orthopaedic surgery literature.

The diversity of authors in orthopaedic literature is fundamental to the distribution of unique discoveries, innovations, and advancements. The purpose of the current study was to create and validate a comprehensive Author Diversity Scoring System (ADSS) to quantify authorship diversity in orthopaedic manuscripts. Six items were included in the initial ADSS. The ADSS and associated survey were sent to 120 experts to evaluate the clarity, simplicity, and relevancy its components. Responses were used to validate the ADSS using Content Validity Ratio (CVR) and Content Validity Index (CVI). The initial ADSS contained author gender, ethnicity, academic rank/title, country of origin of the article, affiliated institution, and the publication history of the senior/corresponding author as representative items. Subsequently, 21 experts completed the survey (response rate 17.5%). Following validation, the final ADSS included author gender, ethnicity, and region of article origin, scored cumulatively on a 0-30 point scale with increasing scores indicating greater author diversity. The validated ADSS scoring system quantitatively assesses manuscript author diversity.

The development and validation of a knowledge, attitude, and practice questionnaire of methamphetamine use

Methamphetamine is a synthetic psychostimulant that is showing a rising trend of usage among adolescents and youths. Its harmful side effects and high risk of developing addiction is a public health problem. Recognizing the knowledge, attitudes, and practices (KAP) on methamphetamine is critical in the planning of an intervention strategy. Currently there is a lack of KAP questionnaires on methamphetamine. The study aims to develop and validate a KAP questionnaire on methamphetamine-use for use among Malaysian adolescents. Following an extensive literature review, face and content validity were carried out among healthcare workers, the public, students, and local subject matter experts. A pilot study was conducted amongst 50 students to assess the test-retest reliability. The questionnaire was then distributed to two groups of 269 and 331 individuals for the Exploratory (EFA) and Confirmatory Factor Analysis (CFA), respectively. The internal reliability was also assessed among these groups. The content validation consisting of Item Content Validity Index (I-CVI, ranging from 0.875 to 1.00), and Scale Content Validity Index (S-CVI/Ave = 0.941) both showed good validation scores. Test-retest reliability showcased an Intraclass Correlation Coefficient (ICC) of > 0.7, indicating its reliability. The model was constructed via the EFA resulting in four constructs, and the model’s goodness of fit was confirmed with CFA. An internal reliability was calculated with Cronbach’s Alpha and showed acceptable reliability (α-values > 0.6) for all constructs. The KAP questionnaire of methamphetamine use is a valid and reliable tool that can be used among Malaysian adolescents. The model arising from this study, can also be used as a guide for future intervention models for adolescent methamphetamine-use disorder.

Psychometric validation of the Chinese version of the dry eye-related quality-of-life score questionnaire.

To psychometrically validate the Chinese version of the dry eye-related quality-of-life score questionnaire (DEQS-CHN) among Chinese patients with dry eye. This study involved 231 participants, including 191 with dry eye disease (DED) comprising the dry eye disease group, and 40 healthy participants forming the control group. Participants were required to complete the DEQS-CHN, and Chinese dry eye questionnaire and undergo clinical tests including the fluorescein breakup time (FBUT), corneal fluorescein staining (CFS), and Schirmer I test. To assess the internal consistency and retest reliability, Cronbach's α and the intraclass correlation coefficient (ICC) were employed. Content validity was assessed by item-level content validity index (ICV) and an average scale-level content validity index (S-CVI/Ave). Construct validity was assessed by confirmatory factor analysis. The concurrent validity was assessed by calculating correlations between DEQS-CHN and Chinese dry eye questionnaire. Discriminative validity was evaluated through non-parametric tests, with receiver operating characteristic (ROC) curve serving as conclusive indicators of the questionnaire's distinguishing capability. The Cronbach's α coefficients for frequency and degree of ocular symptoms, impact on daily life, and summary score were 0.736, 0.704, 0.811, 0.818, 0.861, and 0.860, respectively, and the ICC were 0.611, 0.677, 0.715, 0.769, 0.711, and 0.779, respectively. All I-CVI scores ranged from 0.833 to 1.000, with an S-CVI/Ave of 0.956. Confirmatory factor analysis results exhibited a well-fitting model consistent with the original questionnaire [χ 2/df=2.653, incremental fit index (IFI)=0.924, comparative fit index (CFI)=0.924, Tucker-Lewis index (TLI)=0.909, and root mean square error of approximation (RMSEA)=0.065]. There was a moderate positive correlation between the DEQS-CHN and the Chinese dry eye questionnaire (r 2=0.588). The dry eye group demonstrated significantly higher scores compared to the control group, and the area under the curve (AUC) value was 0.8092. The DEQS-CHN has been demonstrated as a valid and reliable instrument for assessing the impact of dry eye disease on the quality of life among Chinese individuals with DED.

Content validation of the nursing diagnosis "Insufficient breast milk production (00216)".

To review and validate the elements of the nursing diagnosis (ND) "Insufficient breast milk production" (00216) based on the literature and expert consensus, and to construct operational definitions (ODs) for its defining characteristics (DCs). It is a methodological study carried out in two phases. In the first phase, a scoping review was conducted, and in the second, a committee of experts reviewed the elements' content. Items with a Content Validity Index ≥0.8 were validated for relevance, clarity, and precision. Discussions were conducted until a consensus was reached on all items and criteria evaluated. The Ethics Committee approved the study. The final scoping review sample consisted of 61 articles, and 19 experts evaluated the content of the ND. All DCs were revised. Three at-risk populations, three associated conditions, and one related factor were added. Three elements had their category changed, and an element was deleted. Experts also validated ODs developed for all DCs. "Insufficient breast milk production (00216)" was validated by experts. This study improved the ND through literature and expert consensus. New elements were added, and existing ones were revised. This study improves this ND based on scientific evidence and clinical expertise and potentially improves nurses' diagnostic accuracy through ODs.

Development and Validation of an Evaluation Questionnaire for the Healthy Early Life Moments in Singapore (HELMS) Program.

Global fertility rates are declining due to metabolic and mental health challenges in women trying to conceive. The Healthy Early Life Moments in Singapore (HELMS) program aims to address these challenges through mobile health (mHealth)-enabled lifestyle interventions. However, the lack of validated evaluation tools for such programs makes it difficult to assess their feasibility and acceptability. To tackle this, a comprehensive evaluation questionnaire was developed and validated to determine if the HELMS preconception program's implementation outcomes were achieved. The questionnaire development process included a literature review and a two-step validation process: content validation by five content experts and face validation by 20 HELMS participants. Content validation was assessed using the scale content validity index (S-CVI) based on relevance, clarity, simplicity, and ambiguity. Face validation with participants evaluated these criteria and the ease of completing the questionnaire. Internal consistency was assessed using Cronbach's alpha among 49 participants. The questionnaire achieved good S-CVI values for relevance (0.93), clarity (0.91), simplicity (0.94), and ambiguity (0.71). After expert feedback, the revised version scored highly among HELMS participants for relevance (100%), clarity (95%), simplicity (95%), and non-ambiguity (90%). A Cronbach's alpha of 0.93 indicated good internal consistency. The HELMS evaluation questionnaire shows promise for evaluating similar mHealth-based lifestyle intervention programs globally.

German mHealth App Usability Questionnaire (G-MAUQ) and short version (G-MAUQ-S): Translation and validation study

BackgroundThe use of mobile health applications is increasingly common among the general public and in healthcare systems. With such apps percolating into the classic healthcare sector, the necessity of sound and standardized evaluation grows. The mHealth App Usability Questionnaire (MAUQ) provides a novel and custom-tailored psychometrically validated instrument to capture users’ perception of the usefulness and usability of an mHealth application. So far, this questionnaire is only available in English, Malay and Chinese. The aim of this study was to translate and validate a German version of the MAUQ (G-MAUQ). Further, we developed a short scale with 6 items (G-MAUQ-S) in German. MethodsWe used the Translation, Review, Adjudication, Pretest and Documentation (TRAPD) method to translate the MAUQ. Subsequently, we assessed content validity with 15 expert ratings and face validity with 15 German speaking mHealth users. To further validate the questionnaire, we used data from 148 participants of an RCT examining symptom checkers in the Emergency Department to assess convergent validity by correlating the G-MAUQ with the German version of the System Usability Scale and discriminant validity by correlating the G-MAUQ with other unrelated questionnaires. Lastly, we developed a short version by assessing item discrimination, factor loadings, correlation with the full scale and construct validity. ResultsAll but one item showed sufficient content validity with item-level content validity index values between CVI-I = 0.8 and 1.0. Face validity was excellent with item-level face validity index values ranging from FVI-I = 0.87 to 1. Convergent validity was sufficient with r = 0.769, and discriminant validity was sufficient with values between r = −0.014 and r = 0.220. An internal consistency of Cronbach's α = 0.93 demonstrated high reliability. The short scale showed sufficient convergent validity (r = 0.762) and discriminant validity (r between −0.012 and 0.201). ConclusionsA validated and reliable G-MAUQ can be used by researchers and practitioners to assess the usability of mHealth interventions. We also provide the German mHealth App Usability Questionnaire – Short Version (G-MAUQ-S) with six questions to quickly assess the usability of an intervention.

Validation and usability of SeDAR e-health video for enhancing cervical cancer screening.

The cervical cancer (CC) incidence rate is increasing among young women aged <50 years despite early screening is proven effective. Electronic health (e-health) has great potential for disseminating health education. This study validated a newly developed e-health tool "SeDAR®" and assessed its usability via evaluations by health experts (HE), media experts (ME), and women. The SeDAR® content was developed based on protection motivation theory (PMT) using the nominal group technique and in-depth interviews that involved HE and women, respectively. Content validation was performed among the HE (n = 12) and ME (n = 5) using the content validation index (CVI) to identify their agreement. Subsequently, the Video Engagement Scale (VES®) was used to validate SeDAR® among women of different ethnicities (n = 11) to achieve ecological validity. The experts and women also commented on the presentation of the video. The validation yielded a good CVI among the HE (scale-level CVI-average [SCVI/Ave] = 0.986; scale-level CVI-universal agreement [SCVI/UA] = 0.900) and ME (SCVI/Ave = 0.979, SCVI/UA = 0.897). The highest VES® score [mean (±SD) = 92.90(±3.46)] proved the ecological validity of SeDAR®. The experts' feedback established that SeDAR® conveyed a clear message about awareness of performing CC screening and was suitable for public viewing. The women considered SeDAR® easy to understand, and it advised early exposure for early CC screening. SeDAR® was valid and could constitute an important e-health tool to improve motivation and uptake of CC screening.

Psychometric properties of the social determinants of health questionnaire (SDH-Q): development and validation

BackgroundThe influence of social determinants of health (SDH) on sustainable development goals (SDG) has gained attention in recent years. However, there is a scarcity in the availability of valid and reliable instruments to assess the multiple aspects of SDH. Hence, this study was conducted to develop a brief self-reported measure for assessing SDH.MethodA cross-sectional survey was conducted among university undergraduate students in Nigeria. The study consisted of 300 participants in the EFA (males 55.7%, females 44.3%) and 430 participants in the CFA (males 54.0%, females 46.0%). Participants were selected using a convenience sampling approach to assess their perceptions regarding SDH. Content Validity Index (CVI), Face Validity Index (FVI), Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Composite Reliability (CR), Average Variance Extracted (AVE), Cronbach’s alpha, and Intraclass Correlation Coefficient (ICC) were computed to determine the psychometric properties of the newly developed SDH scale.ResultsIn the EFA, two factors were extracted (structural determinants of SDH and intermediary determinants of SDH), with all 20 items retained. The total variance explained by the EFA model was 61.8%, and the factor correlation was 0.178. The Cronbach’s alpha values of the two factors were 0.917 and 0.939. In the CFA, the initial model did not fit the data well based on fit indices. After several re-specification of the model, the final re-specified measurement model demonstrated adequate fit factor structure of the SDH scale with two factors and 20 items (CFI = 0.943, TLI = 0.930, SRMR = 0.056, RMSEA = 0.053, RMSEA p-value = 0.220). The CR was 0.797 for structural determinants of SDH and 0.794 for intermediary determinants of SDH. The ICC was 0.938 for structural determinants of SDH and 0.941 for intermediary determinants of SDH.ConclusionThe findings indicate that the SDH scale has adequate psychometric properties and can be used to assess the perceived level of SDH. We recommended that this tool be tested in other populations with diverse age groups and other demographic characteristics.

Transcultural adaptation and validation of Persian Version of Patient Assessment of Chronic Illness Care (PACIC-5As) Questionnaire in Iranian older patients with type 2 diabetes

BackgroundThe Patient Assessment of Chronic Illness Care (PACIC-5As) questionnaire has been designed to evaluate the healthcare experiences of individuals with chronic diseases such as diabetes. Older adults are at higher risk for diabetes and its associated complications. The aim of this study was transcultural adaptation and evaluation of the validity and reliability of the PACIC-5As questionnaire in older patients with diabetes residing in Qazvin City, Iran.MethodIn this validation study, we recruited 306 older patients with diabetes from Comprehensive Health Centers in Qazvin, Iran. The multi-stage cluster sampling technique was used to choose a representative sample. The PACIC-5As questionnaire was translated into Persian using the World Health Organization (WHO) standardized method. The validity (face, content, and construct) and reliability (Cronbach’s alpha) of the PACIC-5As were assessed. Data analysis was conducted using R software and the Lavaan package.ResultsThe mean age of the older patients was 69.99 ± 6.94 years old. Most older participants were female (n = 180, 58.82%) and married (n = 216, 70.59%). Regarding face validity, all items of PACIC-5As had impact scores greater than 1.5. In terms of content validity, all items had a content validity ratio > 0.49 and a content validity index > 0.79. The results of confirmatory factor analysis demonstrated that the model exhibited satisfactory fit across the expected five factors, including assess, advise, agree, assist, and arrange, for the 25 items of the PACIC-5As questionnaire. The Cronbach’s alpha coefficient for the PACIC-5As questionnaire was 0.805.ConclusionThis study indicates that the Persian version of the PACIC-5As questionnaire is valid and reliable for assessing healthcare experiences in older patients with diabetes. This means that the questionnaire can be effectively used in this population.

Effectiveness of Interventions on Habits among University Staff in Southeastern Iran

Background: Health-promoting environments are a key focus of the Ottawa Strategic Charter, which aims to enhance health in the workplace and reduce unhealthy behaviors among employees. Objectives: This study aimed to evaluate the effectiveness of health-promoting interventions on the habits of university staff in Southeastern Iran. Methods: This semi-experimental study was conducted from 2020 to 2021 in Zahedan, Southeastern Iran. A total of 254 administrative staff from the University of Medical Sciences and Sistan &amp; Balochistan University were selected using available randomized methods and divided into control and intervention groups. The study instrument was a researcher-designed questionnaire, which demonstrated a content validity ratio (CVR) of 0.8, a Content Validity Index (CVI) ranging from 0.83 to 0.97, and an internal consistency with a Cronbach's alpha of 0.85. The questionnaire was distributed online via the Porsline platform. For the intervention, training sessions were conducted online, and the session files and training booklet were made available to intervention group staff through the university's education system. A post-test was administered one month after the pretest. Data were analyzed using SPSS 21 software, with pretest results adjusted using chi-square and ANCOVA statistical tests. Results: The study found that the mean age of participants was 40.5 ± 7.4 years. Scores for employee knowledge, attitude, and behavior were 80.0 ± 16.4, 86.6 ± 22.8, and 80.8 ± 17.6, respectively. The most significant factors influencing attitudes were education (P &lt; 0.001) and health status (P = 0.001). Type of employment (P = 0.025), work experience (P = 0.017), and health status (P = 0.037) were also significantly associated with behavior. After adjusting for pretest results, there were significant differences between the intervention and control groups in terms of scores for knowledge, attitude, and behavior (P &lt; 0.001). Conclusions: The study concluded that employees with correct attitudes and healthy behaviors reported better health outcomes. Additionally, educational interventions effectively improved staff knowledge, attitudes, and behavior. To enhance health status, reduce employee disability, decrease absenteeism, and increase organizational productivity, it is recommended to plan and implement workplace health promotion programs focused on employees.

Validation of the personal suicide stigma questionnaire among adolescents with suicide attempts in mainland China.

The study aimed to translate and culturally adapt the personal suicide stigma questionnaire (PSSQ) into simplified Chinese and evaluate its psychometric properties among adolescents who have attempted suicide in mainland China. Following Brislin's translation model and using purposive sampling, we surveyed 440 adolescents who had attempted suicide at Hangzhou Seventh People's Hospital in Zhejiang Province, China. Content validity was determined by a panel of experts, and the construct validity of the scale was assessed using exploratory factor analysis (EFA), confirmatory factor analysis (CFA), convergent validity, and discriminant validity. Reliability analysis was evaluated using Cronbach's α coefficient, test-retest reliability, and half-split reliability. The Chinese version of the PSSQ consists of three dimensions and 14 items. After two rounds of expert consultation, the item-content validity index for all items exceeded 0.70, and the scale-content validity index exceeded 0.90. EFA extracted three factors and retained all 14 items. The CFA indicators demonstrated a good fit. The Cronbach's α coefficient of the scale was 0.880, the half-split reliability was 0.681, and the test-retest reliability was 0.862. It is evident that the PSSQ and its subscales demonstrate stable structural validity and good internal consistency in measuring self-stigma among individuals with suicidal tendencies, indicating that the PSSQ is a reliable tool for assessing the degree of personal stigma in Chinese adolescents who have attempted suicide. This study ensured the linguistic and cultural appropriateness of the Chinese version of the PSSQ through cross-cultural adaptation and validation of its reliability and validity, thereby enhancing the accuracy and reliability of assessing personal stigma among Chinese adolescents who have attempted suicide. The validation of the Chinese version of the scale not only enriches the research tools available for studying personal stigma related to suicide in mainland China, but also provides a reliable quantitative tool for future research on the psychological states of individuals who have attempted suicide, the impact of stigma, and the effectiveness of interventions.

Development and validation of Social Support Needs Questionnaire (SSNQ) for the left-behind older adults in rural China.

Objectives: This study compiled a Social Support Needs Questionnaire (SSNQ) for the left-behind older adults in rural China and assessed its psychometric properties. Methods: The formation of the SSNQ included three stages. First, item pool was established based on literature analysis. Second, through expert consultation, the 1-version questionnaire items were determined. Third, pre-survey with 901 cases of rural left-behind older adults was used to develop and test final-version of the Social Support Needs Questionnaire (SSNQ). Results: The Cronbach's α of the SSNQ was 0.914, ranging from 0.815 to 0.886 for each factor. The item-content validity index ranged from 0.875 to 1.00, and the scale-content validity index was 0.969. Conclusions: The SSNQ prepared by this study can be used as an evaluation tool for the social support needs of left-behind older adults in rural China, providing a basis for further establishment of the social support system.

B - 132 Validation of the PCL-5 Symptom Severity Scale Embedded Symptom Validity Index in a Cross-Cultural Forensic Sample

Abstract Objective Three embedded symptom validity indices were recently created for the PTSD Checklist for DSM-5 (PCL-5). The first, the PCL-5 Symptom Severity Scale (PSS), is derived from the PCL-5 total score, and preliminary findings have indicated its effectiveness in research and clinical samples. Our aim was to cross-validate this validity index in a cross-cultural forensic sample. Method Examinees were Macedonian and Kosovar contractors (N = 79) previously employed at military bases in Afghanistan and Iraq. Examinees underwent defense psychological examinations between 2018 and 2023 related to pursuit of federal workers compensation claims for PTSD. Testing was performed with translated instruments and administered with assistance from certified interpreters. Two sets of analyses were conducted in this study. In the first, examinees were categorized as valid or invalid responders based on their Trauma Symptom Inventory-II Atypical Response Scale (ATR) scores. In the second, validity status was categorized based on a more conservative criterion of failing 2+ validity tests. Results Receiver operating characteristic analyses were used to determine optimal cutoff scores and classification accuracy statistics for the PSS. The area under the curve was acceptable (0.77) in both analyses. When categorizing invalidity with the ATR, a PSS cutoff of 64 resulted in 95% specificity and 33% sensitivity. When categorizing invalidity by failure of 2+ validity tests, the PSS cutoff could be adjusted to 62 resulting in 90% specificity and 46% sensitivity. Conclusion Results of the current study are in line with those from previous research. These findings extend the utility of the PSS to a cross-cultural forensic sample.

Validation of the HIV/AIDS-Targeted Quality of Life (HAT-QOL) for Evaluation of Health-related Quality of Life in People Living with HIV/AIDS in Brazil.

HIV/AIDS-Targeted Quality of Life (HAT-QOL) is an instrument for evaluating health-related quality of life (HRQOL) in people living with HIV (PLWHIV). This has been adapted into Brazilian Portuguese, but its dimensional structure has not been analyzed. This study evaluated the psychometric properties of the Brazilian Portuguese version of the HAT-QOL, using a sample of 319 PLWHIV in Salvador, Brazil. The study performed Exploratory Factor Analysis (EFA) to assess the HAT-QOL dimensional structure. The analysis used a polychoric correlation matrix, Robust Diagonally Weighted Least Squares (RDWLS) as an extraction method, Parallel Analysis for factor retention, robust promin as oblique rotation, and Generalized H-index (G-H) for construct replicability of each factor. Model adequacy was assessed using the Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI), and Tucker-Lewis Index (TLI). Concurrent validity was evaluated with the 36-item Short Form Health Survey, version 2 (SF-36v2). EFA identified a HAT-QOL six-factor solution: Financial Worries, Sexual Function, Medication Concerns, Life Satisfaction, Health Worries, and Overall Function. This solution showed high G-H indexes, concurrent validity, and satisfactory adequacy indexes (X2 = 231.345, df = 291, p < 0,001; RMSEA = 0.001, CFI = 0.999, TLI = 1.028). HIV Mastery, Disclosure Worries, and Provider Trust domains were not retained in EFA and did not have evidence of concurrent validity. This study proposed a HAT-QOL six-factor model for measuring HRQOL in the Brazilian PLWHIV. Future research could help identify another latent construct from not-included domains.

Preliminary Validation of a Clinical Reasoning Theory-Based Assessment Rubric: An e-Delphi Study.

Questions persist regarding the evaluation of cognitive processes related to clinical reasoning when resolving situations in a learning by concordance tool. This Delphi technique study aimed to validate a clinical reasoning assessment rubric based on script theory. Seventeen experts participated in the study. Two rounds of consultation were conducted to obtain a consensus on the accuracy and clarity of the rubric descriptors (clarity index and content validity index ≥ 0.9). The results inform future research procedures and the intended use of the rubric to facilitate evaluator inferences, provide student feedback, and support the development of learners' clinical reasoning.