Item Response Theory Assumptions Research Articles

Item Response Theory: A Modern Measurement Approach to Reliability and Precision for Counseling Researchers

The purpose of this article is to discuss reliability and precision through the lens of a modern measurement approach, item response theory (IRT). Reliability evidence in the field of counseling is primarily generated using Classical Test Theory (CTT) approaches, although recent studies in the field of counseling have shown the benefits of using IRT approaches to explore measurement precision. We discuss the theoretical foundations and assumptions of CTT and IRT, and examine how modern measurement theory (i.e. IRT) poses advantages for capturing measurement precision. We use an example analysis to demonstrate the indices of measurement precision in IRT approaches (e.g. standard errors, person-fit, item-fit, targeting, residual-based fit statistics). Finally, we discuss practical and clinical implications for counseling researchers for using IRT approaches to measure precision, including insights into precision for persons, items, and measurement invariance as well as the utility of brief and adaptive scales.

Multidimensionality of the PROMIS sleep disturbance 8b short form in working adult populations

ObjectivesThe Patient-Reported Outcomes Measurement Information System sleep disturbance measures were developed using item response theory assumptions of unidimensionality and local independence. Given that sleep health is multidimensional, we evaluate the factor structure of the Patient-Reported Outcomes Measurement Information System sleep disturbance 8b short form to examine whether it reflects a unidimensional or multidimensional construct. MethodsSix full-time working adult samples were collected from civilian and military populations. Exploratory and confirmatory factor analyses were conducted. Single-factor and two-factor models were performed to evaluate the dimensionality of sleep disturbance using the 8b short form. Sleep duration and subjective health were examined as correlates of the sleep disturbance dimensions. ResultsAcross six working adult samples, single-factor models consistently demonstrated poor fit, whereas the two-factor models, with insomnia symptoms (ie, trouble sleeping) and dissatisfaction with sleep (ie, subjective quality of sleep) dimensions demonstrated sufficient fit that was significantly better than the single-factor models. Across each sample, dissatisfaction with sleep was more strongly correlated with sleep duration and subjective health than insomnia symptoms, providing additional evidence for distinguishability between the two sleep disturbance factors. ConclusionsIn working adult populations, the Patient-Reported Outcomes Measurement Information System sleep disturbance 8b short form is best modeled as two distinguishable factors capturing insomnia symptoms and dissatisfaction with sleep, rather than as a unidimensional sleep disturbance construct.

An Investigation of Item Response Theory Parameter Estimations and Reliability in Multiple Groups

This study aimed to investigate the parameters estimation of item response theory (IRT) and their reliability in the context of binary data across multiple groups derived from the same population. Within the scope of the research, 2017 (April) mathematics subtest of the Transition from Primary to Secondary Education exam (TPSEE) was used. The dataset encompassed 7500 students as a single-sample subgroup and 3750 students distributed across two subgroups. In the research, IRT assumptions were examined first. After meeting the assumptions, item and ability estimations were performed with 1PLM, 2PLM, 3PLM, and 4PLM for dichotomous data. When the model data fits were examined, it was found that the best fit was obtained with 3PLM in all conditions. It was observed that the item parameters did not differ significantly as the sample changed. The a and b parameters differ according to the different IRT models. While there is a partial difference between the ability parameters as the samples change, there are also differences as the models change. Minor differences have been observed among the ability parameters obtained through ability estimation methods (Expected A Posteriori (EAP) and Maximum A Posteriori (MAP)). The marginal reliability coefficients were similar in all conditions. It is recommended that researchers perform parameter estimation with which have the best model data fit out of 3PLM or 4PLM to provide more information while performing analysis in IRT.

Psychometric properties and general population reference values for PROMIS Global Health in Hungary.

Patient-Reported Outcomes Measurement Information System-Global Health (PROMIS-GH) is a widely used generic measure of health status. This study aimed to (1) assess the psychometric properties of the Hungarian PROMIS-GH and to (2) develop general population reference values in Hungary. An online cross-sectional survey was conducted among the Hungarian adult general population (n = 1700). Respondents completed the PROMIS-GH v1.2. Unidimensionality (confirmatory factor analysis and bifactor model), local independence, monotonicity (Mokken scaling), graded response model fit, item characteristic curves and measurement invariance were examined. Spearman's correlations were used to analyse convergent validity of PROMIS-GH subscales with SF-36v1 composites and subscales. Age- and gender-weighted T-scores were computed for the Global Physical Health (GPH) and Global Mental Health (GMH) subscales using the US item calibrations. The item response theory assumptions of unidimensionality, local independence and monotonicity were met for both subscales. The graded response model showed acceptable fit indices for both subscales. No differential item functioning was detected for any sociodemographic characteristics. GMH T-scores showed a strong correlation with SF-36 mental health composite score (rs = 0.71) and GPH T-scores with SF-36 physical health composite score (rs = 0.83). Mean GPH and GMH T-scores of females were lower (47.8 and 46.4) compared to males (50.5 and 49.3) (p < 0.001), and both mean GPH and GMH T-scores decreased with age, suggesting worse health status (p < 0.05). This study established the validity and developed general population reference values for the PROMIS-GH in Hungary. Population reference values facilitate the interpretation of patients' scores and allow inter-country comparisons.

Validation of the simplified Chinese version of PROMIS Parent Proxy-25 Profile in parents of children with cancer

PurposeTo determine the psychometric properties of the Patient-reported Outcomes Measurement Information System Parent Proxy-25 Profile (PROMIS-25) in a sample of Chinese parents of children with cancer. Design and methodsA cross-sectional sample (N = 148) of parents with children aged 5–17 years living with cancer was recruited. Each participant completed sociodemographic and clinical questionnaires and PROMIS-25. The flooring and ceiling effects were calculated. Reliability was determined by the Cronbach's alpha and split-half coefficient. Factor structure was examined by factor analysis. Model fit and graphical plots were assessed to test the assumptions of Rasch model-based item response theory (IRT). Differential item functioning (DIF) was assessed in terms of gender, age, and treatment stage. ResultsPROMIS-25 demonstrated some flooring and ceiling effect, excellent reliability (Cronbach's α > 0.7 for all six domains), and the six-domain factor structure was supported. The IRT assumptions were met in terms of unidimensionality, local independence, monotonicity, and measurement equivalence with acceptable DIF in terms of gender, age, diagnosis, and treatment stage. ConclusionPROMIS-25 is a highly reliable and valid instrument for evaluating children with cancer that assesses important health-related quality of life domains of child cancer. Practice implicationChinese parents of children with cancer and healthcare providers could use PROMIS-25 to assess the symptoms of children.

Physical performance tasks were linked to the PROMIS physical function metric in patients undergoing hemodialysis

ObjectivesTo investigate whether a multi-item performance outcome measure, the physical performance test (PPT), can be calibrated to a common scale with patient-reported outcome measures, using the Patient-Reported Outcomes Measurement Information System (PROMIS) physical function (PF) metric. Study Design and SettingWe analyzed baseline data (N = 1,113) from the CONVINCE study, an international trial in end-stage kidney disease patients comparing high-dose hemodiafiltration with high-flux hemodialysis. Assumptions of item response theory (IRT) modelling were investigated for the combined set of the nine-item PPT and a four-item PROMIS PF short form (PROMIS-PF4a). We applied unidimensional IRT linking for calibrating the PPT to the PROMIS PF metric. ResultsAlthough some evidence for multidimensionality was found, classical test statistics (Cronbach's Alpha = 0.93), Mokken (Loevinger's H = 0.50), and bifactor analysis (explained common variance = 0.65) indicated that PPT and PROMIS-PF4a items can be used to assess a common PF construct. On the group level, the agreement between PROMIS-PF4a and linked PPT scores was stable across several subsamples. On the individual level, scores differed considerably. ConclusionWe found preliminary evidence that the PPT can be linked to the PROMIS PF metric in hemodialysis patients, enabling group comparisons across patient-reported outcome and performance outcome measures. Alternative linking methods should be applied in future studies using a more comprehensive PROMIS PF item set.

Item response theory assumptions were adequately met by the Oxford hip and knee scores

ObjectivesTo develop item response theory (IRT) models for the Oxford hip and knee scores which convert patient responses into continuous scores with quantifiable precision and provide these as web applications for efficient score conversion. Study Design and SettingData from the National Health Service patient-reported outcome measures program were used to test the assumptions of IRT (unidimensionality, monotonicity, local independence, and measurement invariance) before fitting models to preoperative response patterns obtained from patients undergoing primary elective hip or knee arthroplasty. The hip and knee datasets contained 321,147 and 355,249 patients, respectively. ResultsScree plots, Kaiser criterion analyses, and confirmatory factor analyses confirmed unidimensionality and Mokken analysis confirmed monotonicity of both scales. In each scale, all item pairs shared a residual correlation of ≤ 0.20. At the test level, both scales showed measurement invariance by age and gender. Both scales provide precise measurement in preoperative settings but demonstrate poorer precision and ceiling effects in postoperative settings. ConclusionWe provide IRT parameters and web applications that can convert Oxford Hip Score or Oxford Knee Score response sets into continuous measurements and quantify individual measurement error. These can be used in sensitivity analyses or to administer truncated and individualized computerized adaptive tests.

Suitability of the animated activity questionnaire for use as computer adaptive test: establishing the AAQ-CAT

PurposeThe animated activity questionnaire (AAQ) is a computer-based measure of activity limitations. To answer a question, patients choose the animation of a person performing an activity that matches their own level of limitation. The AAQ has not yet been tested for suitability to be applied as computer-adaptive test (CAT). Thus, the objective of this study was to develop and evaluate an AAQ-based CAT to facilitate the application of the AAQ in daily clinical care.MethodsPatients (n = 1408) with hip/knee osteoarthritis from Brazil, Denmark, France, The Netherlands, Norway, Spain, and the UK responded to all 17 AAQ items. Assumptions of item-response theory (IRT) modelling were investigated. To establish item parameters for the CAT, a graded response model was estimated. To evaluate the performance of post-hoc simulated AAQ-based CATs, precision, test length, and construct validity (correlations with well-established measures of activity limitations) were evaluated.ResultsUnidimensionality (CFI = 0.95), measurement invariance (R2-change < 2%), and IRT item fit (S-X2p > .003) of the AAQ were supported. Performing simulated CATs, the mean test length was more than halved (≤ 8 items), while the range of precise measurement (standard error ≤ 0.3) was comparable to the full AAQ. The correlations between original AAQ scores and three AAQ-CAT versions were ≥ 0.95. Correlations of AAQ-CAT scores with patient-reported and performance measures of activity limitations were ≥ 0.60.ConclusionThe almost non-verbal AAQ-CAT is an innovative and efficient tool in patients with hip/knee osteoarthritis from various countries, measuring activity limitations with lower respondent burden, but similar precision and construct validity compared to the full AAQ.

Scale Development Based on Item Response Theory: A Systematic Review

Classical test theory (CTT) and item response theory (IRT) are two fundamental approaches used in scale development research. Although CTT is the preferred methodology in scale development research in the Republic of Turkey, the IRT methodology has started to gain traction in recent years. In this study, we used the systematic review methodology to review scale development research in Turkey that used the IRT procedures. Results revealed that most of the studies were conducted in 2017. Most of the studies have a sufficient sample size. Exploratory factor analysis was used more than confirmatory factor analysis. Some studies failed to choose the proper IRT model, report and interpret item parameters, check IRT assumptions, and report and interpret information functions. We recommend some practical considerations to researchers in terms of IRT assumptions.

Validation of the Vocabulary Size Test

The Vocabulary Size Test (VST) is one of the most commonly used assessment tools for measuring English vocabulary size in the field of language testing. Despite its common usage, only a limited number of validity and reliability studies have been carried out with regard to the VST. Besides, they were mostly predicated on the Rasch model. This validation study has attempted to reveal evidence for construct validity for the VST, and to this end, item response theory (IRT) analyses were performed based on the three-parameter logistic model (3PLM). The assumptions of IRT were investigated via factor analysis (unidimensionality) and Yen’s Q3 statistic (local independence). Detailed differential item functioning (DIF) analyses were conducted with Mantel-Haenszel, Lord's chi-square test, and Logistic regression methods to add evidence based on internal structure and to check fairness as a lack of measurement bias. The validation results with IRT showed that the 3PLM fitted the data better than the one- and the two-parameter logistic models. DIF results indicated that 10 items exhibited large DIF (seven favoring males and three favoring females). The results further showed that the guessing effect was not negligible for the VST.

A Comperative Adaptation of the Crick Learning for Resilient Agency (CLARA) with Classical Test Theory and Item Response Theory

The aim of this study is to adapt the Crick Learning for Resilient Agency (CLARA) to Turkish culture, and to examine the psychometric features of the Inventory according to both Classical Test Theory (CTT) and Item Response Theory (IRT). In this respect, it is a descriptive level survey design research. Two different study groups were formed in accordance with the purpose of the study. Lingual equivalence applications were performed on two separate groups, one of which consisted of English Language and Literature Department students and the other consisted of English Language instructors. 1054 students participated in the validity and reliability studies from 101 different undergraduate programs at Ankara University. Before testing the research questions, it was examined whether the assumptions of CTT and IRT were met. With the application data; the predicted item discrimination indices, ability levels, students’ scores forming their learning power profiles, and reliability coefficient values were found to be similar in both theories. It can be said that with CLARA-Tr, obtained by adapting CLARA, a valid and reliable tool has been provided to the Turkish literature to be used in future studies.

Psychometric Evaluation of the Korean Version of PROMIS Self-Efficacy for Managing Symptoms Item Bank: Item Response Theory

To evaluate the psychometric properties of the Patient-Reported Outcomes Measurement Information System (PROMIS) self-efficacy for managing symptoms of the version 1.0 item bank in Korean. This study consisted of two phases: first, developing the Korean version of the item bank following the translation guidelines; and second, performing a cross-sectional study to evaluate its psychometric properties using the item response theory. This study enrolled 323 patients with type 2 diabetes mellitus between July and August 2020. Cronbach's α was used to assess the reliability of this item bank. Confirmatory factor analysis, using diagonally weighted least squares, was used to identify the assumptions of item response theory. Item parameter estimates including discrimination and thresholds were derived using the graded response model of the item response theory to reflect patient-reported outcomes as individualized responses. The Korean version of the item bank demonstrated good reliability (Cronbach's α =.98) and its discrimination ranged from 1.82 to 4.93. The thresholds resulted in the establishment of a category response curve for each item. However, no overlap was observed among the category curves. Moreover, the differential item functioning was not significant for age, gender, and income variables. The graded response model and differential item functioning provided qualitative evidence that demonstrated acceptable psychometric properties of symptom management self-efficacy among patients. This item bank is expected to provide adequate assessments of self-efficacy of symptom management for patients with a chronic disease, which can contribute to nursing research and intervention.

Development and Diagnostic Accuracy of a Shortened Dutch Naming Test for People with Aphasia Using Item Response Theory.

The first objective was to assess the psychometric properties of the 92-item Dutch Naming Test (DNT-92), developed to assess word finding difficulties in people with aphasia, using Item Response Theory (IRT). The second objective was to select suitable items for a short version with a discriminative purpose. This study has a retrospective, psychometric research design, in which 510 DNT-92-forms of people with aphasia and 192 DNT-forms of healthy participants were used for analyses. An IRT analysis was performed and information on the item- and person parameters was obtained. Item selection for the short version was based on a combination of the discriminative ability of the items and their estimated theta or difficulty. Items with the highest information load, and a difficulty parameter in the range of overlap between the sample of people with aphasia and healthy participants were selected. A 2-PL IRT analysis showed best fit to the data. Assumptions of unidimensionality, local independence, and monotonicity were met. Items were removed incrementally, whilst checking sensitivity and specificity of the remaining short form. A selection of six items proved optimal in terms of sensitivity and specificity, with an area under the curve value of 0.85. Differences were found between participants younger than 70 and older. The IRT assumptions for the DNT-92 were met, indicating that the test has good psychometric properties. A reduction of items to just six items proved possible, leading to a reliable six item short form with a discriminatory purpose.

Development of computer adaptive testing for measuring depression in patients with cancer

The usefulness of depression scales for patients with cancer based on item response theory (IRT) and computer adaptive testing (CAT) has not yet been fully explored. This study thus aimed to develop an IRT-based tool for measuring depression in patients with cancer. We analyzed data from 393 patients with cancer from four tertiary centers in Japan who had not received psychiatric treatment. They answered 62 questions across five categories regarding their psychiatric status over the previous week. We selected 28 items that satisfied the assumptions of IRT, fitted a graded response model to these items, and performed CAT simulations. The CAT simulation used an average of 6.96 items and showed a Pearson’s correlation coefficient of 0.916 (95% confidence interval, 0.899–0.931) between the degree of depression estimated by simulation and that estimated using all 28 items. The measurement precision of CAT with only four items was superior to that of the estimation using the calibrated Patient Health Questionnaire-9. These results imply that this scale is useful and accurate for measuring depression in patients with cancer.

Psychometric properties of Snijders- Omen test to measure non- verbal intelligence according to item response theory- on a sample of secondary school students in the city of Makkah: الخصائص السيكومترية لاختبار سنجدرس أومن Snijders- Oomen لقياس الذكاء غير اللفظي في ضوء نظرية الاستجابة للمفردة الاختبارية على عينة من طلاب الثانوية في مدينة مكة المكرمة

The current study aimed at creating Psychometric characteristics to test Sinjders- Oomen to measure non- verbal intelligence, and find criteria for explanation of ability to individuals, and the classified approach was used in Sinjders- Oomen. A secondary school in Makkah city, the results showed that the most appropriate data model is Two- Parameter Model, after ensuring the assumptions of Item Response Theory for the examination of the study data, and are Unidimensional using the Nonparametric factor analysis method T= 2.13 "For a stout method at the level of significance (P = 0.016), a statistically function, It explains that only one latent variable is sufficient to explain the variance of individuals' performance on the test. The paragraph analysis method was used using noharm3 software and the value of the square root index for the average boxes (RMSR = 0.007) was very close to scratch. The value of the Tanaka Index for Good Match (0.977) is very close one in the correct one, and the values ​​point to Goodness of fit to the Unidimensional model. The method of detection of local independence was used for paragraphs Yen Q3, and the appropriateness of individuals and paragraphs for the Two- parameter Logistic. The results confirmed that the test paragraphs included a wide range of difficulty and tend to graduate at the difficult level and that the average normative mistakes of the difficulty of the difficulty of the difficulty (0.151) is a standard deviation (1.949), small values ​​indicated that values ​​were highly appreciated, as well as a function Test information in the light of the item response theory for the separation of the organs, the capacity of individuals (θ) has also been found for the corresponding to each degree of crude college on the test, and the standards explained in the performance of the performance on the test. Based on the results presented several recommendations and proposals: 1- Provide the opportunity for graduate students in measurement and evaluation for the exact details of item response theory. 2- Pay attention to the training of graduate students during systematic study on the use of existing response theoretical applications and applying what has been studied at the theoretical side. 3- Use the models of response to the disruption of the tests and psychological standards. 4- Restructuring psychological tests in the light of the models of response for the disruption. The researcher also recommends the use of Sinjders- Oomen test or sealing the students with higher mental abilities in the Ministry of Education to detect talented intelligence in talented care centers. As well as in care centers for intelligence of deaf and mute and mutual disabilities and autism.

How to screen for social withdrawal in primary care: An evaluation of the alarm distress baby scale using item response theory.

Early identification of infants at-risk is imperative for proper referral to intervention programs. The Alarm Distress Baby Scale (ADBB) is an eight-item observer-rated screening tool detecting social withdrawal in infants. Previously, a shortened five-item version of the scale (m-ADBB) has been proposed. To date, few studies have examined the validity of the two scales, and no studies have examined the validity of the ADBB after implementation as a universal screening tool in primary care. The aim of this study is to use Item Response Theory (IRT) to examine the construct validity of the ADBB when used by public health visitors in primary care. Participants were 24,752 infants (aged: 2-12.9 months) screened by public health visitors using the ADBB. Screenings were categorized into three waves according to the infant's age at the screening time (2-3.9 months, 4-7.9 months, and 8-12.9 months). Analyses were conducted separately on each wave. We checked IRT assumptions: (a) Unidimensionality, (b) Monotonicity, (c) Local independence, and (d) No DIF in relation to infant sex and gestational age. The 2PLM was used to assess model fit and estimate model parameters. Items fulfilled assumptions regarding unidimensionality, monotonicity, and no clinical and significant DIF. Local independence was not present for all items (i.e. 2, 7, and 8). The items showed moderate to good discriminatory abilities (alpha values ≥ 1.11) and discriminated best above average levels of social withdrawal (theta values ≥ 1.33). Items 7 and 8 showed nearly identical ICC suggesting that the two items discriminate equally well at the same level of social withdrawal. In addition, items 4 and 6 discriminated best at very high levels of social withdrawal, which might be of limited interest for screening purposes. Finally, the items showed similar patterns in terms of discrimination and location parameters across the three waves. The ADBB shows several psychometric strengths when used by public health visitors in primary care, and the items show good discriminatory abilities at the levels of social withdrawal of interest for screening purposes. Yet, the results also suggest that for first-line screening, the validity of the scale might be improved with the removal of items 4, 6, and 8 as suggested in the m-ADBB. However, before recommending implementation of the m-ADBB, studies comparing the criterion-related validity of the two scales are needed.

Psychometric properties of the PROMIS-57 questionnaire, Norwegian version

PurposeThe aims of this cross-sectional study were to explore reliability and validity of the Norwegian version of the Patient-Reported Outcome Measurement System®—Profile 57 (PROMIS-57) questionnaire in a general population sample, n = 408, and to examine Item Response properties and factor structure.MethodsReliability measures were obtained from factor analysis and item response theory (IRT) methods. Correlations between PROMIS-57 and RAND-36-item health survey (RAND36) were examined for concurrent and discriminant validity. Factor structure and IRT assumptions were examined with factor analysis methods. IRT Item and model fit and graphic plots were inspected, and differential item functioning (DIF) for language, age, gender, and education level were examined.ResultsPROMIS-57 demonstrated excellent reliability and satisfactory concurrent and discriminant validity. Factor structure of seven domains was supported. IRT assumptions were met for unidimensionality, local independence, monotonicity, and invariance with no DIF of consequence for language or age groups. Estimated common variance (ECV) per domain and confirmatory factor analysis (CFA) model fit supported unidimensionality for all seven domains. The GRM IRT Model demonstrates acceptable model fit.ConclusionsThe psychometric properties and factor structure of Norwegian PROMIS-57 were satisfactory. Hence, the 57-item questionnaire along with PROMIS-29, and the corresponding 8 and 4 item short forms for physical function, anxiety, depression, fatigue, sleep disturbance, social participation ability and pain interference, are considered suitable for use in research and clinical care in Norwegian populations. Further studies on longitudinal reliability and sensitivity in patient populations and for Norwegian item calibration and/or reference scores are needed.

Calibration for Instrument Argumentation Skills on the Subject of Fluid Statics Using Item Response Theory

This study aims to calibrate the instrument of argumentation skills on the subject of Fluid Statics using item response theory (IRT). The blueprint instrument developed based on the aspects and sub-aspects of argumentation skills, totaling 20 items. The scoring uses the Partial Credit Model (PCM) principle in 4 categories. Subjects involved in the study were 206 undergraduate students at two different universities. The validation of the instrument using expert judgment techniques, which consisted of linguists, physicists, and educational measurement experts. Instrument calibration for argumentation skills is carried out by (1) analysis of item fit with PCM by testing goodness of fit items, (2) testing prerequisite analysis, (3) reliability, (4) difficulty level, and (5) Standard Error of Measurement (SEM). The test developed is valid with Aiken V index values in the range 0.93 to 1. The analysis of IRT assumptions uses two parameters, the adequacy test of the sample and the factor analysis. The Chi-Square value in the Bartlett test is 2202.67 with df 190, and a p-value value (Sig.) <0.05 indicates that the sample size used has met the unidimensional requirements. The instrument developed has met the criteria for scoring the Polytomus items, based on a) the MNSQ INFIT value is in the range of 0.70 to 1.30, and b) the difficulty index test is in the range -2.00 <b <2.00. The results of the reliability estimate on the test equipment obtained a reliability value of 0.86, which means that the reliability of the test is in the high category. The graph of the information function and SEM converge on the ability scales of -2.8 and +1.5, meaning that the skills test kit argues it is suitable for testees in the low to moderate ability range.

Design and Psychometric Properties of the BAtSS: A New Tool to Assess Attitudes towards Bats.

Simple SummaryDespite the benefits that bats offer the ecosystem, these animals are feared due to mythological beliefs and their association with dirt and disease. The COVID-19 pandemic has aggravated this situation, exacerbating the already habitual attacks on bats. Today there is an urgent need to address the human–bat conflict to develop conservation policies. Understanding peoples’ attitudes towards bats is a crucial part of this process. This study aimed to design the Bats Attitudes Standard Scale (BAtSS) and to analyze its properties. We developed a scale and analyzed its properties in a sample of 1639 Chileans. The final BAtSS consists of 34 questions on a five-point response scale. It has four factors (scientistic, positivistic, negativistic, and myths) and three subfactors (emotional negativistic, behavioral negativistic, and cognitive negativistic). The results showed that the scale was reliable and valid for measuring participants’ attitudes. Women and participants with a lower level of education were more negativistic and less positivistic. People with a higher level of education had a less mythological view of bats. We also analyzed the attitudes which would be more/less difficult to change. The BAtSS is an adequate tool and could help to understand and solve human–wildlife conflicts.Despite the benefits that bats offer the ecosystem, these animals are feared and attacked. The COVID-19 pandemic has aggravated this situation. Today there is an urgent need to address the human-bat conflict to develop conservation policies. Understanding peoples’ attitudes towards bats are critical for this process. This study aimed to design the Bats Attitudes Standard Scale (BAtSS) and to analyze its psychometric properties. We developed an initial version of the scale in which we established the content validity; we analyzed the items and structure in a pilot sample. In the next phase, we examined psychometric properties in a sample of 1639 Chileans. The final BAtSS consists of 34 Likert-type items configured in an oblique-hierarchical structure of four factors (scientistic, positivistic, negativistic, and myths) and three facets (emotional negativistic, behavioral negativistic, and cognitive negativistic). It presents adequate internal consistency, and the analysis of concurrent validity confirms the scale’s capacity to discriminate between groups. Women and participants with a lower level of education are more negativistic and less positivistic. People with a higher level of education have a less mythological view of bats. We also analyzed the items under the assumptions of item response theory (IRT).

The WHO-5 well-being index – validation based on item response theory and the analysis of measurement invariance across 35 countries

The five-item World Health Organization Well-Being Index (WHO-5) is a frequently used brief standard measure in large-scale cross-cultural clinical studies. Despite its frequent use, some psychometric questions remain that concern the choice of an adequate item response theory (IRT) model, the evaluation of reliability at important cutoff points, and most importantly the assessment of measurement invariance across countries. Data from the 6th European Working Condition survey (2015) were used that collected nationally representative samples of employed and self-employed individuals (N = 43,469) via computer-aided personal interviews across 35 European countries. An in-depth IRT analysis was conducted for each country, testing different IRT assumptions (e.g., unidimensionality), comparing different IRT-models, and calculating reliabilities. Furthermore, measurement invariance analysis was conducted with the recently proposed alignment procedure. The graded response model fitted the data best for all countries. Furthermore, IRT assumptions were mostly fulfilled. The WHO-5 showed overall and at critical points high reliability. Measurement invariance analysis revealed metric invariance but discarded scalar invariance across countries. Analysis of the test characteristic curves of the aligned graded response model indicated low levels of differential test functioning at medium levels of the WHO-5, but differential test functioning increased at more extreme levels. The current study has no external criterion (e.g., structured clinical interviews) to assess sensitivity and specificity of the WHO-5 as a depression screening-tool. The WHO-5 is a psychometrically sound measure. However, large-scale cross-cultural studies should employ a latent variable modeling approach that accounts for non-invariant parameters across countries (e.g., alignment).