Outfit Mean Square Research Articles

Factor structure and psychometric properties of a Persian translation of the Epworth Sleepiness Scale for Children and Adolescents.

Background: Given the high prevalence of excessive daytime disorder (EDS) among children and adolescents, daytime sleepiness should be effectively measured for them to design appropriate intervention program. However, the commonly used instrument Epworth Sleepiness Scale for Children and Adolescents (ESS-CHAD) has little information in its psychometric properties. This study aimed to apply 2 different test theories to examine the psychometric properties of the Persian ESS-CHAD among a large sample of Iranian adolescents and children.Methods: In this methodological study, participants from 8 high schools (n=1371; 700 males), in Qazvin, Iran, completed the ESS-CHAD, a background information sheet, and Insomnia Severity Index (ISI). The ESS-CHAD was translated by using a forward-backward translation method.Two weeks later, the participants completed the ESS-CHAD again. Internal consistency using Cronbach’s alpha, test-retest reliability using intraclass correlation coefficient (ICC), regression analysis testing the correlation between ESS-CHAD and ISI, Confirmatory factor analysis (CFA)with measurement invariance, Rasch analysis with differential item functioning (DIF), and latent class analysis (LCA) were used to examine the psychometric properties of the ESS-CHAD. Results: The internal consistency (α=0.79), test-retest reliability (ICC=0.84), regression findings(β=0.39, P<0.001), CFA (comparative fit index [CFI])=0.974, root-mean square error of approximation [RMSEA]=0.040), supported measurement invariance (∆CFI=-0.009 to 0.007,∆RMSEA=-0.009 to 0.001), Rasch analysis (infit mean square=0.88 to 1.31, outfit mean square=0.68 to 1.19), and no substantial DIF (DIF contrast=-0.43 to 0.38) all indicated that ESSCHAD is a reliable and valid instrument. The LCA further classified the sample into 2 distinctclasses. Conclusion: Persian ESS-CHAD could be used to assess daytime sleepiness for adolescents who are speaking Persian.

Validity and Reliability of Students’ Science and Technology Culture Instrument (BST-M) using Rasch Measurement Model

Students’ Science and Technology Culture Instrument (Budaya Sains dan Teknologi Murid, BSTM) was developed to measure the level of Science and Technology Culture among the students. A total of 800 Form Two students from several schools in Seremban, Negeri Sembilan have been selected as a sample study. This study was conducted to determine the reliability and construct validity of the instrument using Rasch Model via Winstep 3.73 software. The constructs consist of Value and Perception on Science and Technology (B); Perception on Science and Technology (C); Scientific Attitude and Common Practice (D); Scientific Mind Habits and Environmental Concerns (E); and Personality Traits (F). From the analysis, it is found that PTMEA Corr has a positive value, in which items are able to differentiate the capabilities of the respondents. Besides, the results of infit and outfit mean square are ranged between 0.60 and 1.4. The quality of items is high because the reliability value is also high. In addition, the separation of item and person is at the acceptable range. However, statistical data shows that 8 out of 110 items need to be modified.

Reliability and Validity of Scores from the Foot and Ankle Ability Measure

Category: Ankle Introduction/Purpose: A commonly used measure of ankle function is the Foot and Ankle Ability Measure (FAAM). To support interpretation of the FAAM, evidence of reliability and validity must be established. Some studies have assessed FAAM scores; however, these studies had small sample sizes, sample characteristics that may limit generalizability, and did not report reliability estimates. These studies were also unable to account for person ability and item difficulty, a unique feature Rasch modeling offers, which is key when attempting to generalize to other populations. The purpose of this study was to determine whether there is evidence of reliability and validity for the FAAM ADL and Sport scales, utilizing the Rasch model, in patients who have undergone surgical intervention for the treatment of an ankle injury. Methods: Evidence of reliability and validity were determined utilizing the Rasch measurement model, a special case of item response theory, which has been used to develop new patient reported outcome measures and improve existing measures. This is a widely used technique that may be used as an alternative to classical test theory due to advantages including generalizability across samples, accounting for response options not equally spaced in terms of ability, and identifying poorly functioning items. The scale of interest is measured in terms of item difficulty and generates estimates of locations of individual items (item difficulty) and ability level along a common interval-level scale (log-odds). To identify misfit items, outfit mean-square (MNSQ) and infit MNSQ statistics were assessed. Infit and outfit MNSQ range from 0 to positive infinity (ideal value of 1.0 means observed variance = expected variance; acceptable value range 0.5 -1.7). Person reliability was also reported (analogous to Cronbach’s a). Results: There were 456 patients included in the study(192 females, 264 males)(average age=47.6 years(18-79). Rasch analysis showed good evidence of reliability for FAAM ADL and FAAM Sport scores (Figure 1). Person reliability was 0.87 for FAAM ADL and 0.89 for FAAM Sport. Outfit MNSQ values for FAAM ADL items 11 (Coming Up On Toes) and 10 (Squatting) were high (2.17, 1.96). Item 19 “Light/Moderate Work” was low(0.48), indicating item redundancy. For FAAM Sport, all outfit values (range 0.67 -1.64) were within the acceptable range. For internal scale validity, infit MNSQ values for FAAM ADL items 11 and 10 were high(2.30, 2.05). All other infit values (range 0.61 -1.48) were within the acceptable range. For FAAM Sport, all infit values (range 0.74 -1.65) were within the acceptable range. Conclusion: This study provides good evidence of reliability for FAAM ADL and Sport scores in a wide range of patients who underwent ankle surgery, which may demonstrate wide clinical applicability. Both scales demonstrated good internal scale validity; however, 3 FAAM ADL items may indicate the need for further scale development for use in a diverse ankle population.

Validating the Persian Adolescent Sleep Hygiene Scale-Revised (ASHSr) using comprehensive psychometric testing methods

BackgroundThis study translated the Adolescent Sleep Hygiene Scale-revised (ASHSr) into Persian and aimed to validate its psychometric properties using classical test theory and Rasch analyses. MethodsAdolescents aged 14–18 (n = 389; 199 males) and their parents in Iran participated in the study. Each adolescent wore a wrist actigraphy device during sleep time and completed the ASHSr, the Depression Anxiety Stress Scale (DASS), the General Health Questionnaire (GHQ), the Pediatric Daytime Sleepiness Scale (PDSS), and the Pittsburgh Sleep Quality Index (PSQI). A parent of each adolescent completed the Sleep Disturbance Scale for Children (SDSC). ResultsThe construct validity of the ASHSr was supported by both classical test theory (factor loadings from confirmatory factor analysis [CFA] = 0.64 to 0.88; corrected item-total correlations = 0.70 to 0.92; test-retest reliability = 0.72 to 0.90) and Rasch analyses (infit mean square = 0.73 to 1.30; outfit mean square = 0.74 to 1.32). ASHSr had significantly negative associations with DASS subscales (β = −0.15 to −0.42, ps < 0.001) and GHQ (β = −0.663, p < 0.001). Known-group validity was demonstrated by the significant differences between poor and good sleep hygiene based on ASHSr in the actigraphy measure and scores of PDSS, PSQI, and SDSC. The multigroup CFA and differential item functioning in Rasch analyses suggested that all the participants interpreted the ASHSr similarly, regardless of their gender or living in a private room. ConclusionsThe Persian ASHSr demonstrated good reliability and validity in assessing sleep hygiene among Iranian adolescents. Healthcare providers may use it to assess the effectiveness of sleep hygiene programs.

2044 Investigation of patient-reported outcomes following ACL reconstruction using Rasch analysis

OBJECTIVES/SPECIFIC AIMS: The knee injury osteoarthritis and outcomes survey (KOOS) is a commonly used instrument to measure patient-reported quality of life (QOL) post-ACLR. The purpose is to evaluate the psychometric properties of the QOL subscale of the KOOS. METHODS/STUDY POPULATION: Rasch analysis of KOOS QOL subscale from 39 individuals 1–2 years post ACLR was conducted. Measurement properties and model fit of the rating scale, items, and persons were evaluated. Relationship of item difficulties and person measures was evaluated using probability curves and item maps. Reliability indicators were also examined. RESULTS/ANTICIPATED RESULTS: All items demonstrated infit and outfit mean squares and standard z-scores. The majority of persons (n=38, 97.4%) demonstrated fit to the Rasch model. However, ceiling effects were noted (n=4, 10.26%), indicating some participants report higher QOL than is measurable. The mean person measure was 1.73 logits higher than the mean item measure: this sample is skewed toward higher QOL. Person reliability was adequate (0.67) and person separation was 1.42. Calculation of person strata revealed that the KOOS QOL separated participants into 2 strata. DISCUSSION/SIGNIFICANCE OF IMPACT: Although all items of the KOOS QOL fit the model, not all categories of the rating scale were used. Overall, this sample reported high QOL, which is to be expected given the time since ACLR. If participants with a broader range of time since ACLR were included, that the KOOS QOL could identify additional person strata.

PHP198 - A Rasch Analysis of Student Pharmacists’ Attitudes Towards Herbal Medications

To describe student pharmacists’ attitudes towards herbal medicines and to assess questionnaire psychometrics. All students (n=429) at a public college of pharmacy were invited to participate. Seven items assessed students’ attitudes towards herbal medication use on a six-point scale with options ranging from do not agree to strongly agree. Ten items collected demographic data. Students were categorized as those who had not yet learned about herbal medicines and those who had. Median attitudinal scores were compared using Mann-Whitney U tests and descriptive statistics were calculated as appropriate. The polytomous Rasch model was used to ascertain item validity. Item polarity, model fit, and reliability were assessed. An alpha of 0.05 was selected a-priori. The Human Subjects Protection Program approved this study. A total of 324 students completed the survey (76% response rate). Respondents had a mean age of 25.5 (SD=4.5), most were female (59%) and did not report use of herbal medicines by themselves or family members (57%). Most participants worked in a community pharmacy (45%) and had access to herbal medication information (53%). Students who had learned about herbal medicines agreed less strongly that herbal medications are efficacious (p<0.01). Students were not confident in their ability to recommend or educate patients on herbal medicines, and strongly agreed that an elective course on herbal medicines would be useful for improving competency to educate patients. All items had a positive correlation, and item fit statistics were within an acceptable range (outfit mean-square=0.73-1.30, Z-standardized residuals=-1.9-2.0). Item reliability was 0.99. Person reliability was 0.08. There were four significant items gaps (p<0.02) suggesting more items need to be added. Participants reported that they were not confident to recommend or educate patients on the use of herbal medicines. Further work is needed to refine this attitudinal questionnaire and to remove uninformative items.

ReHabgame: A non-immersive virtual reality rehabilitation system with applications in neuroscience

This paper proposes the use of a non-immersive virtual reality rehabilitation system “ReHabgame” developed using Microsoft Kinect™ and the Thalmic™ Labs Myo gesture control armband. The ReHabgame was developed based on two third-person video games that provide a feasible possibility of assessing postural control and functional reach tests. It accurately quantifies specific postural control mechanisms including timed standing balance, functional reach tests using real-time anatomical landmark orientation, joint velocity, and acceleration while end trajectories were calculated using an inverse kinematics algorithm. The game was designed to help patients with neurological impairment to be subjected to physiotherapy activity and practice postures of daily activities. The subjective experience of the ReHabgame was studied through the development of an Engagement Questionnaire (EQ) for qualitative, quantitative and Rasch model.The Monte-Carlo Tree Search (MCTS) and Random object (ROG) generator algorithms were used to adapt the physical and gameplay intensity in the ReHabgame based on the Motor Assessment Scale (MAS) and Hierarchical Scoring System (HSS). Rasch analysis was conducted to assess the psychometric characteristics of the ReHabgame and to identify if these are any misfitting items in the game.Rasch rating scale model (RSM) was used to assess the engagement of players in the ReHabgame and evaluate the effectiveness and attractiveness of the game. The results showed that the scales assessing the rehabilitation process met Rasch expectations of reliability, and unidimensionality. Infit and outfit mean squares values are in the range of (0.68–1.52) for all considered 16 items. The Root Mean Square Residual (RMSR) and the person separation reliability were acceptable. The item/person map showed that the persons and items were clustered symmetrically.

Indonesian teacher engagement index: a rasch model analysis

The research aimed to calibrate Indonesian Teacher Engagement Index (ITEI) using instrument with RASCH MODEL. The respondents were 672 teachers of elementary, junior high, high school and vocational school. The number of items planned was 165 items with the initial reliability of 0.98. The ITEI scale uses Likert Scale (1 to 4) which was converted from ordinal scale to Equal Interval Scale. RASCH MODEL analysis was done by selecting based on Outfit Mean Square (MNSQ) between 0.5-1.5 as a good item, and measuring Point Measure Correlation (Pt Mean Corr) with the criterion of 0.4-0.85. Moderate Outfit Z-Standard (ZSTD) was ignored because the sample was >500. Conclusions: ITEI is valid with 30 items and reliability of 0.97, and less engage teachers significantly at α <0.05.

Development of a Social Functioning Assessment Using Computerized Adaptive Testing for Patients With Stroke

ObjectiveTo develop a computerized adaptive test of social functioning (Social-CAT) for patients with stroke. DesignThis study contained 2 phases. First, a unidimensional item bank was formed using social-related items with sufficient item fit (ie, infit and outfit mean square [MNSQ]). The social-related items were selected from 3 commonly used patient-reported quality-of-life measures. Items with differential item functioning (DIF) of sex were deleted. Second, we performed simulations to determine the best set of stopping rules with both high reliability and efficiency. The participants' responses to the items were extracted from a previous study. SettingRehabilitation wards and departments of rehabilitation/neurology of 5 general hospitals. ParticipantsPatients (N=263) with stroke (47.1% were inpatients). InterventionsNot applicable. Main Outcome MeasureSocial-CAT. ResultsThe unidimensionality of the 24 selected items was supported (infit and outfit MNSQs =0.8–1.2). One item had DIF of sex and was deleted. The item bank was composed of the remaining 23 items. With the best set of stopping rules (person reliability ≥.90 or limited reliability increased ≤.001), the Social-CAT used on average 10 items to achieve sufficient reliability (average person reliability =.88; 81.0% of the patients with reliability ≥.90). ConclusionsThe Social-CAT appears to be a unidimensional measure with acceptable reliability and efficiency, and it could be useful for both clinicians and patients in time-pressed clinical settings.

Improving the utility of the fine motor skills subscale of the comprehensive developmental inventory for infants and toddlers: a computerized adaptive test

Aim: This study aimed at improving the utility of the fine motor subscale of the comprehensive developmental inventory for infants and toddlers (CDIIT) by developing a computerized adaptive test of fine motor skills.Methods: We built an item bank for the computerized adaptive test of fine motor skills using the fine motor subscale of the CDIIT items fitting the Rasch model. We also examined the psychometric properties and efficiency of the computerized adaptive test of fine motor skills with simulated computerized adaptive tests.Results and conclusions: Data from 1742 children with suspected developmental delays were retrieved. The mean scores of the fine motor subscale of the CDIIT increased along with age groups (mean scores = 1.36–36.97). The computerized adaptive test of fine motor skills contains 31 items meeting the Rasch model’s assumptions (infit mean square = 0.57–1.21, outfit mean square = 0.11–1.17). For children of 6–71 months, the computerized adaptive test of fine motor skills had high Rasch person reliability (average reliability >0.90), high concurrent validity (rs = 0.67–0.99), adequate to excellent diagnostic accuracy (area under receiver operating characteristic = 0.71–1.00), and large responsiveness (effect size = 1.05–3.93). The computerized adaptive test of fine motor skills used 48–84% fewer items than the fine motor subscale of the CDIIT. The computerized adaptive test of fine motor skills used fewer items for assessment but was as reliable and valid as the fine motor subscale of the CDIIT.Implications for RehabilitationWe developed a computerized adaptive test based on the comprehensive developmental inventory for infants and toddlers (CDIIT) for assessing fine motor skills.The computerized adaptive test has been shown to be efficient because it uses fewer items than the original measure and automatically presents the results right after the test is completed.The computerized adaptive test is as reliable and valid as the CDIIT.

Common European Framework of Reference Rating Scale: Scaling Its Functionality Through ESL Learners’ Self- and Peer Assessments

The Common European Framework of Reference (CEFR) was empirically derived from experienced teachers’ intuitive judgements and although it may seem adequate, assessment theorists argue on the absence of performance data-driven approach in structuring its rating scale. Therefore, the objective of this study was to gauge rating scale functioning of five CEFR oral assessment criteria (overall impression, range, accuracy, fluency and coherence), based on ratings awarded by intermediate ESL learners during self- and peer assessments of their speaking skills. Before learners embarked on awarding ratings to their own performance as well as their peers,’ they were trained to understand and apply the criteria and the corresponding ratings based on the benchmarked videos provided on the CEFR official website. Findings on rater measurement report suggest that learners were within productive measurement range based on their infit and outfit mean-squares and the reliability of their ratings was reported at 0.91. However, only four out of six rating categories were utilized in all five CEFR oral assessment criteria and this was illustrated through category probability curve for each criterion. The implications of the findings are discussed in view of learner performance and classroom instruction.

Instructional Rubrics as an Alternative Approach for Improving Practical Teaching Among Teachers Candidate

Practical teaching process is different as compared to the theoretical teaching process. Practical teaching in workshops or laboratories requires teachers who have the knowledge, skills and attitude in order to provide high efficiency in the teaching process. Therefore, an instrument that is legal and can be trusted is needed to measure teacher candidate competency value so that the skills can be ensured and enhanced before the teacher candidate step into a practical job later. Existing assessment instruments in Universiti Tun Hussein Onn Malaysia (UTHM) that evaluate the teacher candidate are in the form of a checklist and are not specific towards every construct. Therefore, this study was conducted to design practical teaching assessment rubric to assess teacher candidate teaching at the university. The construction of this rubric involves four phases: Phase 1, the formation of concepts and items; Phase 2, construction sections; Phase 3, pilot study and the validity of the content and Phase 4, data analysis and discussion. This study used a Multiple Facet Rasch Measurement Model version 3.71.4 which involves three facets, namely, items, the examiner, and video teaching students. Examiners consist of 14 students from semester two of, Master of Technical and Vocational Education in UTHM enrolled in the subject of Microteaching in PTV. Meanwhile, student teaching videos were taken from student of Postgraduate Diploma in Education (DPLI), UTHM. The resulting rubric has been reviewed in terms of reliability, value of infit and outfit mean square so that it meets the requirements of the Rasch Measurement Model. Analysis of data results found out that the produced rubric can assess teacher candidate practical lesson in UTHM.

Development of a Microsoft Excel tool for one-parameter Rasch model of continuous items: an application to a safety attitude survey

BackgroundMany continuous item responses (CIRs) are encountered in healthcare settings, but no one uses item response theory’s (IRT) probabilistic modeling to present graphical presentations for interpreting CIR results. A computer module that is programmed to deal with CIRs is required.To present a computer module, validate it, and verify its usefulness in dealing with CIR data, and then to apply the model to real healthcare data in order to show how the CIR that can be applied to healthcare settings with an example regarding a safety attitude survey.MethodsUsing Microsoft Excel VBA (Visual Basic for Applications), we designed a computer module that minimizes the residuals and calculates model’s expected scores according to person responses across items. Rasch models based on a Wright map and on KIDMAP were demonstrated to interpret results of the safety attitude survey.ResultsThe author-made CIR module yielded OUTFIT mean square (MNSQ) and person measures equivalent to those yielded by professional Rasch Winsteps software. The probabilistic modeling of the CIR module provides messages that are much more valuable to users and show the CIR advantage over classic test theory.ConclusionsBecause of advances in computer technology, healthcare users who are familiar to MS Excel can easily apply the study CIR module to deal with continuous variables to benefit comparisons of data with a logistic distribution and model fit statistics.

Parents' Assessments of Disability in Their Children Using World Health Organization International Classification of Functioning, Disability and Health, Child and Youth Version Joined Body Functions and Activity Codes Related to Everyday Life.

AIMTo help parents assess disability in their own children using World Health Organization (WHO) International Classification of Functioning, Disability and Health, Child and Youth Version (ICF-CY) code qualifier scoring and to assess the validity and reliability of the data sets obtained.METHODParents of 162 children with spina bifida, spinal muscular atrophy, muscular disorders, cerebral palsy, visual impairment, hearing impairment, mental disability, or disability following brain tumours performed scoring for 26 body functions qualifiers (b codes) and activities and participation qualifiers (d codes). Scoring was repeated after 6 months. Psychometric and Rasch data analysis was undertaken.RESULTSThe initial and repeated data had Cronbach α of 0.96 and 0.97, respectively. Inter-code correlation was 0.54 (range: 0.23-0.91) and 0.76 (range: 0.20-0.92). The corrected code-total correlations were 0.72 (range: 0.49-0.83) and 0.75 (range: 0.50-0.87). When repeated, the ICF-CY code qualifier scoring showed a correlation R of 0.90. Rasch analysis of the selected ICF-CY code data demonstrated a mean measure of 0.00 and 0.00, respectively. Code qualifier infit mean square (MNSQ) had a mean of 1.01 and 1.00. The mean corresponding outfit MNSQ was 1.05 and 1.01. The ICF-CY code τ thresholds and category measures were continuous when assessed and reassessed by parents. Participating children had a mean of 56 codes scores (range: 26-130) before and a mean of 55.9 scores (range: 25-125) after repeat. Corresponding measures were −1.10 (range: −5.31 to 5.25) and −1.11 (range: −5.42 to 5.36), respectively. Based on measures obtained at the 2 occasions, the correlation coefficient R was 0.84. The child code map showed coherence of ICF-CY codes at each level. There was continuity in covering the range across disabilities. And, first and foremost, the distribution of codes reflexed a true continuity in disability with codes for motor functions activated first, then codes for cognitive functions, and, finally, codes for more complex functions.CONCLUSIONSParents can assess their own children in a valid and reliable way, and if the WHO ICF-CY second-level code data set is functioning in a clinically sound way, it can be employed as a tool for identifying the severity of disabilities and for monitoring changes in those disabilities over time. The ICF-CY codes selected in this study might be one cornerstone in forming a national or even international generic set of ICF-CY codes for the benefit of children with disabilities, their parents, and caregivers and for the whole community supporting with children with disabilities on a daily and perpetual basis.

Psychometric Properties and Validation of the Arabic Academic Performance Rating Scale

Aim. To validate the Arabic version of Academic Performance Rating Scale. Method. Translation and test‐retest reliability were computed. Exploratory factor analysis and Rasch analysis were conducted to report on the validity. EFA factor structures were evaluated using a Scree plot and the standard multiple criteria included eigenvalue greater than 1. Average measures and step measures were ordered and the mean‐square outfit statistic for each category was also evaluated. Results. Cronbach’s Alpha value of 0.90 was obtained. No differences across category of educational levels were seen (P &gt; 0.05). Pattern matrix analysis revealed items to be significantly correlated with each other with a chi square goodness of fit value 0.02. Results supported the interpretation of adequate fit of items, since the infit ZSTD (1.55–0.46), outfit ZSTD (1.59–0.99), infit MNSQ (0.74–1.47), and outfit MNSQ (0.50–1.37) for the items were within acceptable ranges. Conclusion. Valid and reliable A‐APRS‐15 can be used in future studies to see its relation with other variables such as general health and oral health.

Rasch analysis of the Western Ontario Osteoarthritis of the Shoulder index - the Danish version.

PurposeThe Western Ontario Osteoarthritis of the Shoulder (WOOS) index is a disease-specific, patient-reported, 19-question survey that measures the quality of life among patients with osteoarthritis (OA). The purpose of this study was to validate the Danish version of WOOS for OA and fractures (FRs) using modern test theory.Patients and methodsThe study included 1,987 arthroplasties in 1,943 patients that were reported to the Danish Shoulder Arthroplasty Register between 2006 and 2011. These included 847 OA and 1,140 FR cases.ResultsPrincipal component analysis indicated the unidimensionality of WOOS. The person reliabilities showed a floor-ceiling effect, indicating that a dichotomy was the best fit for the WOOS scale. For OA, WOOS showed good reliability (item and person reliability of 0.98 and 0.76) and good targeting, with a person mean of −0.56 logits. FR also showed good targeting (person mean of −0.08) and good reliability (item and person reliabilities of 1.00 and 0.86, respectively). All WOOS items fit well with the OA sample except items 5 and 6 (pertaining to grinding and the influence of weather). In addition, item 6 showed signs of degrading the scale with an outfit mean square of 2.46. Only item 6 showed a misfit for FR with no sign of scale degradation. The residual principal component analysis confirmed the unidimensionality of FR but not OA. Six items displayed clinically significant differential item functioning between OA and FR.ConclusionRasch analysis showed that WOOS had a good fit with the Rasch model when used as a dichotomous scale for OA and FR. However, the results were valid only when WOOS was divided into two categories with a threshold of 950 (50% of the maximum score). For the use of WOOS in future clinical research, we recommend that a dichotomous score be reported as a measure of clinical failure in OA and FR.

Oswestry Disability Index: a psychometric analysis with 1,610 patients

BackgroundOne-fourth of the adult US population has or will experience back pain and has undergone one of a myriad of treatments. Understanding the outcomes of these many treatments from pharmacologic to surgical, from manipulation to modality, allows for a better understanding and value-driven decision making. Patient-reported outcome measures are the current standard and include general and disease-specific measures. The Oswestry Disability Index (ODI) is the most commonly used disease-specific patient-reported outcome tool to measure functional disability related to back pain. Few studies have evaluated its psychometric properties in a large patient sample using a modern tool such as the Rasch analysis model. This study aims to identify the benefits and deficiencies of the ODI as an outcome tool for assessing patients with back pain. PurposeThis study aimed to investigate the psychometric properties, performance, and applicability of the ODI in patients with back pain who visited a university-based outpatient clinic. Study DesignThis study used a secondary analysis—assessment of diagnostic tool on consecutive patients. Patient SampleThe sample comprised 1,610 patients visiting an academic spine center. Outcome MeasuresThe ODI was the outcome measure. MethodsDetailed Rasch analysis of the ODI was performed. Standard descriptive statistics were also assessed. ResultsThe ODI performed well overall. It demonstrated suboptimal unidimensionality (ie, unexplained variance after accounting for the first dimension) of 8.3%. Person reliability was good, at 0.85, and item reliability was excellent, at 1.00. The overall item fit for the ODI was good with an outfit mean square of 1.02. The ODI had a floor effect of 29.9% and ceiling effect of 3.9%. The raw score to measure correlation of the ODI was excellent, at 0.944. ConclusionsThe ODI performed relatively well overall, with some problematic findings. It had good person and item reliability, although it did not demonstrate strong evidence of unidimensionality. The ODI has moderately poor coverage, with a very large floor effect and small ceiling effect, which could present a challenge in interpreting results of scores at the end of the spectrum.

Rasch analysis of the Persian version of PedsQL(TM) Oral Health Scale: further psychometric evaluation on item validity including differential item functioning.

Background: The study aimed to further evaluate the psychometric properties of one recently developed oral health related quality of life (OHRQoL) instrument (PedsQL Oral Health Scale), including student self-report and parent-proxy report. Specifically, we tested the item validity,threshold order, local dependency, and differential item functioning (DIF) across gender and rater. Methods: This is a cross-sectional study, and study population was recruited in Qazvin, Iran using one-stage sampling with the unit of school. Students and their parents (1529 dyads) separately completed the Persian version of PedsQL Oral Health Scale. The psychometric properties were analyzed using Rasch rating scale model, including item validity, threshold order for response categories, and DIF across gender (boys vs. girls in student self-report) and rater (student self report vs. parent-proxy report). Results: All items had satisfactory in fit and outfit mean square error. One disordering category (the response of often) was found in parent-proxy report, while all categories were ordered in student self-report. All items were DIF-trivial across gender and rater. Conclusion: PedsQL Oral Health Scale is a valid instrument to measure OHRQoL. However, our results indicated that the parent-proxy report was inferior to the student self-report, and healthcare providers should primarily use the student self-report.

Rasch Analysis of the Premature Ejaculation Diagnostic Tool (PEDT) and the International Index of Erectile Function (IIEF) in an Iranian Sample of Prostate Cancer Patients.

BackgroundMale sexual dysfunction is an increasing problem across a variety of general and clinical populations, such as cancer populations; especially among prostate cancer patients who tend to receive treatments that often result in erectile dysfunction (ED) and/or premature ejaculation (PE). Therefore, in order to diagnose ED and PE in these populations, adequate and efficient instruments such as the International Index of Erectile Function 5-item version (IIEF-5) and the Premature Ejaculation Diagnostic Tool (PEDT) are needed. However, since this is an important topic additional evidence of psychometric properties of the IIEF-5 and the PEDT in such samples are required. Thus the aim of the present study was to use Rasch models to investigate the construct validity, local dependency, score order, and differential item functioning (DIF) of both questionnaires in a sample of prostate cancer patients.MethodsProstate cancer patients (n = 1058, mean±SD age = 64.07±6.84 years) who visited urology clinics were invited to fill out the IIEF-5 and the PEDT. Construct validity was examined using infit and outfit mean square (MnSq) and local dependency using correlations between each two residual Rasch scores. Score order was investigated using step and average measures of difficulty and DIF using DIF contrast.ResultsAll IIEF-5 and PEDT items had acceptable infit and outfit MnSq. Step measures revealed that all but two items had disordered categories in terms of scores 1 to 3. Only one local dependency was found, and no items displayed DIF across age, educational level, and help seeking.ConclusionsThe results showed that both the IIEF-5 and the PEDT had sound psychometric properties in the Rasch analyses, although some score disordering could be detected in both instruments. The results of no DIF items in both instruments suggest using them to compare ED and PE across age and educational level is adequate.

Analysis of the suitability of the Korean Federation of Science and Technology Societies journal evaluation tool

The Korean Federation of Science and Technology Societies has provided funds to support scientific journals published in Korea. In 2012, it adopted an evaluation tool to assist journals in improving their style and format to meet international standards. This study analysed reliability and fitness of this tool. The 34 evaluation items were tested for goodness of fit, and item analysis was performed for 540 journals based on classical test theory, the Rasch model, and a two‐parameter logistic model. The tool was found to be reliable, with a Cronbach's alpha value of 0.94. Based on the goodness of fit test, the outfit mean square was over 2.0 (i.e. outlier) for the following four items: participation in editor training courses, turnover in editors in the most recent 10 years, publishing at least 40 articles annually, and online accessibility. Three items were found to be the most difficult to be fulfilled: participation in editor training courses, description of the length of time the journal has been publishing, and full‐text XML. Above results indicated that this tool was acceptable for measuring the parameters assessed by the items. We concluded that this accreditation system was valid for evaluating a journal's adherence to international publishing standards.