Winsteps Program Research Articles

Assessment Battery for Children with Developmental Coordination Disorder (ABCD): Preliminary report of tool development and clinical application.

Development of an easy to use tool for the assessment of Developmental Coordination Disorder that is applicable to Indian children. The steps for instrument development were followed stringently. In order to ensure the robustness of the tool, psychometric properties were determined with 127 children attending various schools. The Winsteps program was used to analyze data for a Rasch model analysis. The Kaiser-Meyer-Olkin Measure of Sampling Adequacy (KMO) analysis showed an acceptable limit. The real item separation reliability of 4.84 demonstrates that the items of this tool create a well-defined variable. This study met the objectives that it attempted to. The final tool consists of two versions- the Assessment Battery for Children with coordination Disorder-Short Version (ABCD-SV) consisting of 12 items, and the ABCD-FV consisting of 20 items. ABCD fulfills criterion A and B of the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) criteria for Developmental Coordination Disorder (DCD).

Calidad de vida relacionada con la salud en estudiantes universitarios de primer año

Objetivo: Calidad de Vida Relacionada con la Salud (CVRS) en estudiantes universitarios de primer año. Material y Método: Estudio observacional, transversal y analítico en estudiantes de 17 a 18 años de primer año de 14 Facultades, 2 Institutos y 1 Programa de Bachillerato. Se aplicó el test Kidscreen-52, enviado por correo electrónico a 3.738 estudiantes. Contestaron 1.277 (34,16%). Análisis con programa WINSTEPS y expresión con puntajes Rasch. Resultados: Las dimensiones Bienestar Físico, Estado de Ánimo y Emociones y Autonomía con menos de 42 puntos Rasch, y otras dos, Bienestar Psicológico, Amigos y Apoyo Social tuvieron puntajes significativamente menores a lo encontrado en adolescentes chilenos de edad comparable, en mujeres, escolares de establecimientos municipales de bajo nivel socioeconómico, con Índice de Vulnerabilidad Escolar (IVE) o con discapacidad o problema de salud o enfermedad crónica. Las diferencias son mayores en Facultades con más demanda académica. Este primer estudio revela información no conocida, trascendente para estudiantes, académicos y sus autoridades. Se sospecha que posiblemente ocurre en otras universidades. Conclusiones: Los estudios de Calidad de Vida estudiantil son factibles de aplicar en instituciones de educación superior en beneficio de educandos y educadores. Este estudio es un insumo para diagnóstico y evaluación de las políticas salud y apoyo estudiantil y aporta a la orientación de la docencia. En el futuro podrían aplicarse instrumentos de medición de la Calidad de Vida en estudiantes de otras edades y en otros estamentos universitarios con test validados en Chile, combinado con estudios de Factores de Riesgo.

Application of Rasch Analysis to the Korean Version of the Fullerton Advanced Balance Scale

Background: Rasch analysis estimates the probability that a respondent will endorse an item and select a particular rating for that item. It has the advantage of placing both the items and the person along a single ration scale and calibrates person ability and item difficulty onto an interval scale by logits. In addition, Rasch analysis is a useful tool for exploring the validity of questionnaires that have been developed using traditional methods. Therefore, it has been recommended as a method for developing and evaluating functional outcome measures. Objects: The purpose of this study was to investigate the item fit, item difficulty, and rating scale of the Korean version of the Fullerton Advanced Balance Scale (KFAB) using Rasch analysis. Methods: Total 97 subjects (39 males and 58 females) with dwelling elderly adults were participated, but 3 people were excluded for misfit persons. Rasch analysis was then done by means of the Winsteps program to determine the item fit, item difficulty, rating scale, and reliability of the KFAB. Results: In this study, the 'standing with feet together and eyes closed', 'two-footed jump', 'walk with head turns', and 'stand on foam, eyes closed' items shown misfit statistics. The most difficult item was 'stand on one leg', whereas the easiest item was 'turn in full circle'. The rating scale was acceptable with all criteria. Both item and person separation indices and reliability showed acceptable values. This would indicated that each domain covers a useful range of item difficulty that is appropriate for measuring a person with a wide range of functional ability. Conclusion: The KFAB has been proven reliable, valid and an appropriate tool with which to evaluate the balance of the elderly people.

VALIDITAS DAN RELIABILITAS INSTRUMEN PENGETAHUAN PEMBELAJARAN AKTIF, KREATIF DAN MENYENANGKAN (PAKEM) MENGGUNAKAN MODEL RASCH

Instruments of Active, Creative, Effective and Fun learning (PAKEM) were created to measure teachers' knowledge about the PAKEM’s concept as a form of learning strategies implemented in teaching in schools and madrasahs. This study was conducted to produce empirical evidence on the validity and reliability of the PAKEM instrument using the RaschMeasurement Model analysis. A Survey study has been conducted on 30 teachers fromMadrasah Ibtidaiyah School (MI) in the Aceh Districts. The validity and reliability of the PAKEM instrumentswere tested with the Rasch.Measurement Model analysis usingthe Winsteps program. The unidimensionality test conducted showed standarlized residual variance of 37.9 % which is almost to the point of at least 40.0 % points desired by Rasch models . The Rasch Model analysis showed person reliability index of 0.77 and the item reliability index of 0.88 . In terms of polarity items showed that all the items have value Point Correlation Measure ( PMC ) positive means there is no conflict between the items and the constructs being measured . Value Mean Square also showed that all the items have a mean square less than 1.5 , which means the value of the measurement of productive unless the item Peng10 (2.21) and item Peng1 (3.88). For both of these items need to be re- examined because it has a problem in measuring validity. The results of this study have proved that PAKEM instrument has a standard value of validity and reliability to be usedin measuring knowledge PAKEM strategis for teachers.

Investigation of psychometric properties of the Falls Efficacy Scale using Rasch analysis in patients with hemiplegic stroke.

[Purpose] The purpose of this study was to investigate the psychometric properties of the Falls Efficacy Scale using Rasch analysis in patients with hemiplegic stroke. [Subjects] Fifty-five community-dwelling hemiplegic stroke patients were selected as participants. [Methods] Data were analyzed using the Winsteps program (version 3.62) with the Rasch model to confirm the unidimensionality through item fit, reliability, and appropriateness of the rating scale. [Results] There were no misfit persons or items. Furthermore, infit and outfit statistics appeared adjacent. The person separation value was 3.07, and the reliability coefficient was 0.90. The reliability of all items was at an acceptable level for patients with hemiplegic stroke. [Conclusion] This was the first study to investigate the psychometric properties of the Falls Efficacy Scale using Rasch analysis. The results of this study suggest that the 6-point Falls Efficacy Scale is an appropriate tool for measuring the self-perceived fear of falling in patients with hemiplegic stroke.

Developing Information Skills Test for Malaysian Youth Students Using Rasch Analysis

This study explored the psychometric properties of a locally developed information skills test for youth students in Malaysia using Rasch analysis. The test was a combination of 24 structured and multiple choice items with a 4-point grading scale. The test was administered to 72 technical college students and 139 secondary school students. The data from the test were fitted to the Rasch partial credit model using the Winsteps program in which the unidimensionality, reliability and person-item distribution map of the test were examined. The analysis showed all 24 items meet the Rasch model expectation and thus have a potential in assessing information skills of youth students in Malaysia. The findings showed that Rasch analysis could help researchers to refine the developed test in a systematic and informed manner.

Neuro-linguistic Programming (NLP) for Language Teachers: Revalidation of an NLP Scale

Enjoying much potential for learning and teaching, Neuro-linguistic programming (NLP) is regarded as a supplementary tool in L2 teaching and an approach to support learners to achieve excellence in their performance. Relying on its saliency, Pishghadam, Shayesteh, and Shapoori (2011) constructed and validated an NLP scale to examine the extent to which English language teachers employ NLP techniques in their practices. In accordance, this study attempted to revalidate the NLP scale through Rasch-rating scale model (RSM) and to underscore its importance in the field of language education. The WINSTEPS program was used to perform the Rasch measurement. Based on the analysis, items 5 and 9 were removed from the scale to maintain uni-dimensionality. To boot, given that the 5-category rating scale did not function satisfactorily, it was shifted to 3-category rating scale. At last, empirical findings were discussed, and implications were yielded in the context of English language teaching. Index Terms—Neuro-linguistic programming (NLP), Rasch-rating scale model (RSM), revalidation, language education, NLP scale

엘리트 선수의 도핑 사고성향 분석을 위한 한국형 PEAS의 타당도 검증: Rasch 모형 적용

이 연구는 Rasch 모형을 적용하여 우리나라 엘리트 선수의 도핑 사고성향 분석을 위한 PEAS의 타당도를 검증하는데 목적이 있다. PEAS (performance enhancement attitude scale)는 Petroczi (2006)이 제시한 선수들의 도핑 (doping)에 대한 사고방식과 성향을 측정하는 척도로 17문항 6점 척도로 구성되어 있다. 국가대표 엘리트 선수 438명을 대상으로 측정하였고, Rasch 모형을 적용하여 타당도를 분석하였다. 우선 Rasch 모형의 기본가정인 일차원성을 검증하기 위해 SPSS 프로그램을 적용하여 주성분분석을 실시하였다. 문항의 적합도 검증과 측정척도 범주의 타당도, 그리고 성별에 따른 차별기능문항을 추출하기 위해 Winsteps 프로그램을 이용하였다. 분석에 모든 유의수준은 .05로 설정하였다. 자료분석 결과는 다음과 같다. 첫째, 총 17문항으로 구성된 PEAS는 일차원성을 만족하는 것으로 나타났다. 둘째, 응답범주 수의 타당도는 6점척도보다 5점척도가 더 적합한 것으로 나타났다. 셋째, 문항의 적합도는 17문항 중 7문항 (문항1, 문항9, 문항10, 문항12, 문항13, 문항14, 문항17)이 통계적으로 적합하지 못한 것으로 나타났다. 넷째, 성별에 따른 차별기능문항 분석 결과 3문항 (문항3, 문항12, 문항13)이 추출되었다. 따라서 이 연구에서 우리나라 엘리트 선수의 도핑 사고성향분석을 위한 PEAS는 9문항 5점척도가 타당한 것으로 구명되었다. PEAS (performance enhancement attitude scale) has been used to measure attitude and disposition toward doping in elite athlete. It is constructed of 17-item, 6-point scale. The purpose of this study was to verify validity of the PEAS for Korean elite player through Rasch model. The scale was administered to 438 Korean elite players. Principal component analysis was used to verify unidimensionality using SPSS program. Rasch measurement computer program, WISTEPS, was used to estimate goodness-of-fit of items and category structure. Differenctial item functioning by gender was also estimated by the WINSTEPS program. All alpha level was set at 0.05. First, principal component analysis showed that unidimensionality is satisfied as over 20.0% of variance of eigenvalue. Second, category probabilities curve showed 5-point scale was better than 6-point scaled statistically. Third, seven items (1, 9, 10, 12, 13, 14, 17) in the 17-item were not good model fit and three items (3, 12, 13) were estimated as the differential item functioning. This study showed that 9-item, 5-point scale is better PEAS to Korean elite player.

아마추어 골프 선수를 위한 코치-선수 관계 척도의 타당화: Rasch 평정척도 모형 적용

이 연구는 Rasch 모형을 적용하여 아마추어 골프 선수들에게 적합한 코치-선수와의 관계 척도를 개발하고 타당화시키는데 목적이 있다. 코치-선수 관계 척도는 Kim과 Park (2008)이 개발한 한국판 척도를 검사내용에 기초한 증거를 토대로 수정 (11문항, 7척도)하여 아마추어 골프 선수 217명 (중학교, 고등학교, 대학교)에게 조사하였다. 그리고 WINSTEPS 프로그램을 이용하여 Rasch 모형의 기본가정인 일차원성을 검증 (주성분 분석)하였으며, 응답범주에 적절성은 단계조정값 (step calibration)을 통해 규명하였다. 이때 적합도 지수 (infit, outfit)를 통해 문항별 적합도를 검증하였으며, 골프경력 (10년미만, 10년이상)에 따라 차별기능문항을 추정하였다. 문항별로 추정되는 적합지수가 1.30 이상을 부적합하게 판단하였고, 분석에 모든 유의수준을.05로 설정하였다. 분석결과, Rasch 측정모형에 의해 설명되는 관찰분산이 20% 이상 (33.7%)으로 나타나 11문항의 일차원성 가정은 만족하였다. 그리고 응답범주 (7척도)를 단계조정값으로 분석한 결과에서 부적합하게 나타나 5점 척도로 재점수화하여 재분석한 결과에서 적합하게 나타났다. 특히 체계화된 응답범주 (5척도)를 이용하여 문항의 적합도를 추정한 결과, 상보성 요인에서 문항 10 (나는 최선을 다할 준비가 되어 있다)과 문항 11 (나는 호의적인 자세를 취한다)이 부적합 문항으로 나타났고 골프경력에 따라 차별기능문항 추정결과에서는 상보성 요인인 문항 11이 경력에 따라 비균일적으로 차별화되는 것으로 나타났다. 따라서 부적합하고 차별되는 두 문항을 제거하여 아마추어 골프 선수에게 적합한 코치-선수 관계 척도는 9문항에 5점 척도가 타당한 것으로 규명되었다. The purpose of this research was to develop and validate the coach-athlete relationship scale suitable to amateur golf players by applying the Rasch rating scale model. As the coach-athlete relationship scale, the Korean form of scale developed by Kim and Park (2008), which was revised based on the evidence on the basis of inspection contents, was used to conduct a survey on 217 amateur golf athletes. And the unidimensionality, which is the basic assumption of the Rasch model, was verified using the WINSTEPS program, and the appropriateness of the item category was established through the step calibration. The goodness of fit of each question was tested through the goodness-of-fit index and the differential item functioning (DIF) was estimated according to the golf career. When the goodness-of-fit index estimated for each question was 1.30 or more it was judged unfit and the significance level in the analysis was all set as.05. The results of the analysis showed that the measures variance explained by the Rasch measurement model was more (33.7%) than 20%, so the unidimensionality assumptions of the 11 questions (..hospitable posture when my coach is teaching) were satisfied. The result of analyzing the item category (7 scale) with step calibration was found to be unfit, but in the result of reanalyzing by rescoring into a 5-point scale, it was found to be fit. Particularly, in the result of estimating the goodness-of-fit using the systematized item category (5 scale), Question 10 (...my best when my coach is teaching) and Question 11 were found to be unfit, and as a result of estimating the differential functioning item according to golf career, Question 11 was found to be unevenly differentiated according to golf career. So the 5-point scale of Question 9 after eliminating the two questions which were unfit and differentiated was validated to be the coach-athlete relationship scale suitable to amateur golf athletes.

Cross‐cultural validity of the Individualised Care Scale – a Rasch model analysis

The aim of this study was to investigate, using Rasch model analysis, the measurement invariance of the item ratings of the Individualised Care Scale. Evidence of reliability is needed in cross-cultural comparative studies. To be used in different cultures and languages, the items must function the same way. A methodological and comparative design. Secondary analysis of data, gathered in 2005-2006 from a cross-cultural survey using the Individualised Care Scale from Finnish, Greek, Swedish and English predischarge hospitalised orthopaedic and trauma patients (n = 1093), was used. The Rasch model, which produces calibrations (item locations and rank) and item fit statistics, was computed using the Winstep program. The rank of average Individualised Care Scale item calibrations (-2·26-1·52) followed a generally similar trend (Infit ≤ 1·3), but slight differences in the item rank by country were found and some item misfit was identified within the same items. There was some variation in the order and location of some Individualised Care Scale items for individual countries, but the overall pattern of item calibration was generally corresponding. The Rasch model provided information about the appropriateness, sensitivity and item function in different cultures providing more in-depth information about the psychometric properties of the Individualised Care Scale instrument. Comparison of the four versions of the Individualised Care Scale - patient revealed general correspondence in the item calibration patterns although slight differences in the rank order of the items were found. Some items showed also a slight misfit. Based on these results, the phrasing and targeting of some items should be considered. The Individualised Care Scale - Patient version can be used in cross-cultural studies for the measurement of patients' perceptions of individualised care. Information obtained with the use of the Individualised Care Scale in clinical nursing practice is important, and valid measures are needed in evaluating patients' assessment of individualised care, one indicator of care quality.

Development and Validation of a Tool for Evaluating Core Competencies in Nursing Cancer Patients on Chemotherapy

This study was done to develop tool to evaluate the core competencies regarding nursing cancer patients on chemotherapy, and to verify the reliability and efficacy of the developed tool. A tool to evaluate the core competencies was developed from a preliminary tool consisting of 112 items verified by expert groups. The adequacy of the preliminary tool was analyzed and refined to the final evaluation tool containing 76 items in 8 core competencies and 18 specific competencies. The evaluation tool is in the form of a self-report, and each item is evaluated according to a 3-point scale. From September 22 to October 14, 2011, 349 survey responses were analyzed using SPSS 20.0 and the WINSTEPS program that employs the Rasch model. Results indicated that there were no inappropriate items and the items had low levels of difficulty in comparison with the knowledge levels of the study participants. The results of factor analysis yielded 18 factors, and the reliability of the tools was very high with Cronbach's α=.97. The results of this study can be used for training and evaluation of core competencies for nursing cancer patients, and for standardizing nursing practices associated with chemotherapy.

Rasch analysis of the Oxford Knee Score

Use Rasch analysis to examine the psychometric properties of the Oxford Knee Score (OKS), particularly in respect to unidimensionality, and consistency of item functioning before and after total knee replacement and across age and gender groups. The 12-item OKS was administered to 1,712 patients before the surgery, and 1,322 and 855 patients were administered the instrument repeatedly at the 6-month and 2-year postoperative assessments, respectively. Data were fitted to the Rasch partial credit model with the Winsteps program. Differential item functioning (DIF) analysis was performed, and fit statistics in combination with principal components analysis of the residuals were used to test the unidimensionality assumption. The fit criteria were set at 1.5 and 2.0 for infit mean-square (MNSQ) and outfit MNSQ, respectively. At baseline, item difficulty ranged from -1.86 to 1.78 logits, and person measures had a mean+/-SD of -0.01+/-0.89. Misfit items were "limping" and "night pain" in preoperative data and "limping" and "kneeling" in postoperative data. After removing items limping and kneeling and recoding item night pain, none of the items misfit at each of the time points and there was stability of item difficulty ordering across time. In the modified OKS set, five items displayed DIF by age and three by gender. The original OKS had adequate targeting and good coverage of knee severity levels in preoperative patients. The modified 10-item OKS data fit the Rasch model and had stable item difficulty ordering over time.

Developing a Scale to Measure Self-Efficacy on Asthma Teaching for Health Care Providers

Background. A number of educational programs have focused on promoting the knowledge of asthma to health care professionals, but not teaching competency. Increasing the cognition of self-efficacy on patient teaching could enhance the competency in teaching for patients with asthma. However, at present we do not have an appropriate tool to measure self-efficacy on asthma teaching for health care providers. Objectives. The aim of this study was to evaluate construct validity by Factor analysis and investigating dimensionality by Rasch analysis of a self-efficacy on asthma teaching scale (SEATs) among nurses in Taiwan. Participants. A total of 281 nurses from 3 medical centers volunteered to participate and complete the SEATs. Methods. A 20-item SEATs was developed including self-efficacy of general teaching and self-efficacy of specific asthma-related teaching. Instrument reliability and validity are examined by classical testing theory (item analysis, internal consistency, content validity, and construct validity). To examine whether each item in the SEATs fits the unidimensionality in the Rasch model, the Winsteps program was used to assess item difficulty, scale unidimensionality, item separation, and linearity. Results. SEATs has good content validity, internal consistency, and construct validity. Rasch analysis revealed that three items were problematic and need to be re-examined in further study. Conclusion. The first version of SEATs has an acceptable psychometric property to evaluate the asthma teaching efficacy of nurses, although three items were INFIT according to Rasch analysis. A different population of nurses should be recruited to further refine this tool. SEATs could be used as an outcome measure for further program evaluation.

Use of Item Response Analysis to Investigate Measurement Properties and Clinical Validity of Data for the Dynamic Gait Index

The Dynamic Gait Index (DGI) is a standardized clinical assessment that aids in evaluating a subject's ability to modify gait in response to changing demands. The purpose of this study was to use Rasch measurement theory to examine whether the DGI rating scale meets suggested psychometric guidelines, whether the hierarchical order of DGI tasks is consistent with a clinically logical testing procedure, and whether the DGI represents a unidimensional construct. Subjects were 84 community-dwelling male veterans (age range=64-88 years; mean+/-SD=75+/-6.47 years). Data were retrieved retrospectively from the participants' clinical records. The Rasch measurement model with the WINSTEPS program was used in this study because it offers distinct advantages over traditional psychometric approaches. Overall, the DGI showed sound item psychometric properties. Each of the original 4 rating scale categories appeared to distinctly identify subjects at different ability levels. The analysis revealed a clear item difficulty hierarchical order that is generally consistent with clinical expectations. In addition, fit statistics and principal components analysis indicated that the 8 items of the DGI appear to represent a single construct. The results suggest that the rating scale of the DGI is used appropriately for community-dwelling older subjects with balance problems. The findings support the continued use of this well-constructed scale for clinical and research assessment in a community-dwelling population of older subjects.

Item Parameter Recovery, Standard Error Estimates, and Fit Statistics of the Winsteps Program for the Family of Rasch Models

This study investigates item parameter recovery, standard error estimates, and fit statistics yielded by the WINSTEPS program under the Rasch model and the rating scale model through Monte Carlo simulations. The independent variables were item response model, test length, and sample size. WINSTEPS yielded practically unbiased estimates for the difficulty parameters under the Rasch model and the overall difficulty parameters under the rating scale model. However, the estimates for the intersection parameters under the rating scale model were substantially biased, especially for short tests. The standard errors of the overall difficulties and intersection parameters were slightly underestimated. The cube root-transformed weighted and unweighted item fit statistics did not follow the standard normal distribution in that their empirical sampling variances were much smaller than the expected value of unity. Correction procedures were proposed to make them follow approximately the standard normal distribution so that the usual critical ranges at the α nominal level could be used to screen the misfitting items.

Rasch analysis of the Roland disability questionnaire.

A cross-sectional survey using patient questionnaires was conducted. OBJECTIVE To assess whether the Roland Disability Questionnaire satisfies the Rasch model including unidimensionality and item separation. The Roland Disability Questionnaire, the most widely used patient-assessed measure of health outcome for back pain, has undergone several evaluations for its measurement properties including reliability, validity, and responsiveness. However, there is no published work relating to the underlying dimensionality of the instrument and the extent to which individual items contribute to the construct of physical disability resulting from low back pain. Patients entering a randomized controlled trial of exercise, manipulation, and usual management for back pain completed a questionnaire that included the Roland Disability Questionnaire. The Winsteps program was used to assess whether the Roland Disability Questionnaire fits the Rasch model. Item fit was assessed using the Infit and Outfit statistics. The Roland Disability Questionnaire was completed by 1008 (90%) of the patients taking part in the trial. Most of the items in the Roland Disability Questionnaire contribute to a single underlying construct. However, four items had poor Outfit statistics, suggesting that they do not contribute sufficiently to the scale hierarchy. Several items positioned around the middle of the hierarchy are not sufficiently distinct in terms of difficulty. There were very few items positioned at the extremes of the hierarchy. The Roland Disability Questionnaire largely satisfies the Rasch model for unidimensionality. However, the instrument could be improved through the removal of poorly fitting items and the addition of items at the upper and lower points of the scale hierarchy. The distribution of Roland Disability Questionnaire scores should be carefully considered before statistical testing is undertaken. Rasch transformed scores can be used to deal with deficiencies in the scale hierarchy.