Test-retest Reliability Analysis Research Articles

Psychometric properties of the Hoarding Rating Scale-Interview

The present study tested the psychometric properties of an expanded version of the Hoarding Rating Scale (HRS-I), a semistructured interview for hoarding disorder (HD). Eighty-seven adults with HD and 44 healthy control (HC) participants were assessed using the HRS-I and completed a battery of self-report measures of HD severity, negative affect, and functional impairment. All interviews were audio recorded. From the HD participants, 21 were randomly selected for inter-rater reliability (IRR) analysis and 11 for test-retest reliability (TRR) analysis. The HRS-I showed excellent internal consistency (α = 0.87). IRR and TRR in the HD sample were good (intra-class coefficients = 0.81 and 0.85, respectively). HRS-I scores correlated strongly with scores on the self-report Saving Inventory-Revised (SI-R); partial correlations indicated that the HRS-I clutter, difficulty discarding, and acquiring items correlated significantly and at least moderately with corresponding SI-R subscales, when controlling for the other SI-R subscales. The HD group scored significantly higher on all items than did the HC group, with large effect sizes (d = 1.28–6.58). ROC analysis showed excellent sensitivity (1.00) and specificity (1.00) for distinguishing the HD and HC groups with a cutoff score of 11. Results and limitations are discussed in light of prior research.

The Contributions of Arterial Cross-Sectional Area and Time-Averaged Flow Velocity to Arterial Blood Flow.

Background:Ultrasound has been used for noninvasive assessments of endothelial function in both clinical and athletic settings and to identify changes in muscle blood flow in response to exercise, nutritional supplementation, and occlusion. The purposes of the present study were to examine the reliability and relative contributions of arterial cross-sectional area and time-averaged flow velocity to predict muscle blood flow as a result of fatiguing exercise in men and women.Methods:Eighteen healthy men and 18 healthy women performed 50 consecutive eccentric repetitions of the elbow flexors at 60% of their pretest eccentric peak torque at a velocity of 180° s−1. Test-retest reliability and stepwise linear regression analyses were performed to determine the ability of arterial cross-sectional area and time-averaged flow velocity to predict brachial artery muscle blood flow for the men, women, and combined sample.Results:There was no systematic test versus retest mean differences (P > 0.05) for any of the ultrasound determined variables. The two-variable regression models significantly improved the ability to predict muscle blood flow and were associated with smaller standard error of the estimates (3.7%–10.1% vs. 16.8%–37.0% of the mean baseline muscle blood flow values) compared to the one-variable models.Conclusions:The findings of the present study supported the use of ultrasound for reliable assessments of arterial diameter, arterial cross-sectional area, time-averaged flow velocity, and muscle blood flow from the brachial artery in men and women. Furthermore, time-averaged flow velocity was a more powerful predictor of muscle blood flow than arterial cross-sectional area.

Validation of the MISSCARE-BRASIL survey - A tool to assess missed nursing care.

ABSTRACTObjective:to analyze the metric validity and reliability properties of the MISSCARE-BRASIL survey. Method:methodological research conducted by assessing construct validity and reliability via confirmatory factor analysis, known-groups validation, convergent construct validation, analysis of internal consistency and test-retest reliability. The sample consisted of 330 nursing professionals, of whom 86 participated in the retest phase. Results:of the 330 participants, 39.7% were aides, 33% technicians, 20.9% nurses, and 6.4% nurses with administrative roles. Confirmatory factorial analysis demonstrated that the Brazilian Portuguese version of the instrument is adequately adjusted to the dimensional structure the scale authors originally proposed. The correlation between “satisfaction with position/role” and “satisfaction with teamwork” and the survey’s missed care variables was moderate (Spearman’s coefficient =0.35; p<0.001). The results of the Student’s t-test indicated known-group validity. Professionals from closed units reported lower levels of missed care in comparison with the other units. The reliability showed a strong correlation, with the exception of “institutional management/leadership style” (intraclass correlation coefficient (ICC)=0.15; p=0.04). The internal consistency was adequate (Cronbach’s alpha was greater than 0.70). Conclusion:the MISSCARE-BRASIL was valid and reliable in the group studied. The application of the MISSCARE-BRASIL can contribute to identifying solutions for missed nursing care.

Early prelingual auditory development in Italian infants and toddlers analysed through the Italian version of the Infant-Toddler Meaningful Auditory Integration Scale (IT-MAIS).

To evaluate the reliability and validity of the Italian version of the Infant-Toddler Meaningful Auditory Integration Scale (I-IT-MAIS), and to assess the normal trajectory of early prelingual auditory (EPLAD) development from birth to 24months in a group of normal-hearing Italian children using the I-IT-MAIS. The study consisted of four phases: item generation, reliability analysis, assessment of the normal trajectory for EPLAD, and validity analysis. A group of 120 normal-hearing children and a group of 31 deaf children wearing hearing aids and on a waiting list for cochlear implantation were enrolled. All the parents completed the I-IT-MAIS. Sixty of them completed the I-IT-MAIS twice, 2weeks apart, for test-retest reliability analysis. The I-IT-MAIS scores were used to assess the normal trajectory of EPLAD development from birth to 24months in normal-hearing children. For criterion validity analysis, the I-IT-MAIS scores were correlated with production of infant scale evaluation (PRISE) scores in 60 normal-hearing children. For discriminant validity analysis, the I-IT-MAIS scores obtained in normal and deaf children were compared. Internal consistency of I-IT-MAIS was satisfactory as well as individual item reliability, test-retest reliability, and discriminant validity. EPLAD development in normal-hearing Italian-speaking children was evaluated. As far as the criterion validity of the I-IT-MAIS is concerned, a strong correlation between I-IT-MAIS and PRISE scores was found. I-IT-MAIS is reliable and valid. Its application is recommended for clinical practice and outcome research.

The design and psychometric assessment of a child-friendly TPB-based questionnaire.

Despite the popularity of the theory of planned behaviour (TPB), a lack of research assessing the efficacy of the model in understanding the health behaviour of children exists. The aim of this study was to develop and test a TPB-based measure suitable for use with schoolchildren aged 9-10 years. A mixed-method sequential design was employed. In Phase 1, semi-structured focus group discussions were conducted to elicit the underlying beliefs specific to tooth brushing. Using content thematic analysis, the beliefs were identified and a TPB measure was developed. A repeated measures design was employed in Phase 2 using test-retest reliability analysis in order to assess its psychometric properties. In all, 184 children completed the questionnaire. The questionnaire proved to be reliable for assessing the tooth brushing beliefs of children. Pearson's product moment correlations were calculated for all of the TPB constructs, achieving substantial to almost perfect agreement levels, providing strong predictive power of the TPB. The design and development of the measure are described, which could serve as a guide to fellow researchers and health professionals interested in using theoretical models to investigate the health and well-being of children.

Czech Version of the Patient Dignity Inventory: Translation and Validation in Incurable Patients

ContextThe Patient Dignity Inventory (PDI) is a valid, reliable screening tool to assess a range of issues that have been reported to affect the sense of dignity in patients with life-limiting conditions. ObjectivesWe investigated the item characteristics, factor structure, and reliability of the Czech version of the PDI (PDI-CZ) among cancer and noncancer patients. MethodsThe PDI was translated into the Czech language following state-of-the-art criteria (a five-stage proceeding method for the translation). Two hundred thirty-nine participants completed the study (136 cancer and 103 noncancer patients). Internal consistency, test-retest reliability, and factor analysis were used for validation of the PDI-CZ. ResultsA Czech version of the PDI was obtained. The Cronbach's α for PDI-CZ was 0.92. Item 22 (not feeling supported by my health care providers) did not correlate with any other items, and it was skipped for factor analysis processing for this reason. Factor analysis resulted in a four-factor solution, accounting for 56.34% of the overall variance (factor loadings range, 0.37–0.92). The factor labels were as follows: loss of purpose of life; loss of autonomy; loss of confidence; and loss of social support (internal consistencies range, Cronbach's α 0.58–0.90). Test-retest reliability was assessed with 25 patients after two weeks. The resulting range of the Gwet's coefficient, AC1, was between 0.58 and 1.00. ConclusionThe results from the study support the reliability of the PDI-CZ and its future use in patients with incurable cancer and noncancer patients.

Pathological Movements of the Pelvis and Trunk During Gait in Children With Cerebral Palsy: A Cross-Sectional Study With 3-Dimensional Kinematics and Lower Lumbar Spinal Loading

Increased loading at the lumbar spine, particularly in the coronal plane, has been reported in children with cerebral palsy (CP). As pelvic and trunk movements associated with Trendelenburg and Duchenne type gait are most significant in the coronal plane, the potential exists for lower lumbar spinal loading to be negatively affected in children with CP and these types of movement patterns. The objective of this study was to assess trunk and pelvic kinematics and lower lumbar spinal loading patterns in children with CP and Trendelenburg and Duchenne type gait. This was a cross-sectional study. Three-dimensional kinematic (lower limb and thorax) and L5-S1 kinetic data were recorded. Children were divided according to clinical presentation of Trendelenburg or Duchenne type gait. Several discrete kinematic and kinetic parameters were assessed between groups. Three distinct pelvic and trunk movement patterns were identified for children with CP: Trendelenburg, Duchenne, and complex Trendelenburg-Duchenne. Peak L5-S1 lateral bending moments were increased by 62% in children with CP and Duchenne type gait. Children with CP and complex Trendelenburg-Duchenne gait demonstrated the largest deviations from normal, with increased peak ipsilateral and contralateral directed moments of 69% and 54%, respectively, compared with children with typical development. A test-retest reliability analysis or measure of minimal detectable change was not conducted as part of this study. Results suggest that measures of minimal detectable change may be high for some of the reported variables. In addition, the inverse dynamic approach determines only the net intersegmental reactive forces that reflect the effect of external loads. Previous studies have shown that spinal loads may be larger than the net intersegmental force. Trendelenburg and Duchenne type movements were not always distinct, and a third type of movement, a combination of the two, was the most common in this study. Clinicians should be aware that children with CP and the Duchenne type or the complex Trendelenburg-Duchenne type of gait pattern experience abnormal loading that may have significant implications for the lower spine in the long term.

The Revised Body Awareness Rating Questionnaire: Development Into a Unidimensional Scale Using Rasch Analysis.

The Body Awareness Rating Questionnaire (BARQ) is a self-report questionnaire aimed at capturing how people with long-lasting musculoskeletal pain reflect on their own body awareness. Methods based on classical test theory were applied to the development of the instrument and resulted in 4 subscales. However, the scales were not correlated, and construct validity might be questioned. The primary purpose of this study was to explore the possibility of developing a unidimensional scale from items initially collected for the BARQ using Rasch analysis. A secondary purpose was to investigate the test-retest reliability of a revised version of the BARQ. This was a methodological study. Rasch and reliability analyses were performed for 3 samples of participants with long-lasting musculoskeletal pain. The first Rasch analysis was carried out on 66 items generated for the original BARQ and scored by 300 participants. The items supported by the first analysis were scored by a new group of 127 participants and analyzed in a second Rasch analysis. For the test-retest reliability analysis, 48 participants scored the revised BARQ items twice within 1 week. The 2-step Rasch analysis resulted in a unidimensional 12-item revised version of the BARQ with a 4-point response scale (scores from 0 to 36). It showed a good fit to the Rasch model, with acceptable internal consistency, satisfactory fit residuals, and no disordered thresholds. Test-retest reliability was high, with an intraclass correlation coefficient of .83 (95% CI = .71-.89) and a smallest detectable change of 6.3 points. The small sample size in the second Rasch analysis was a study limitation. The revised BARQ is a unidimensional and feasible measurement of body awareness, recommended for use in the context of body-mind physical therapy approaches for musculoskeletal conditions.

Tapering Practices of Strongman Athletes: Test-Retest Reliability Study.

BackgroundLittle is currently known about the tapering practices of strongman athletes. We have developed an Internet-based comprehensive self-report questionnaire examining the training and tapering practices of strongman athletes.ObjectiveThe objective of this study was to document the test-retest reliability of questions associated with the Internet-based comprehensive self-report questionnaire on the tapering practices of strongman athletes. The information will provide insight on the reliability and usefulness of the online questionnaire for use with strongman athletes.MethodsInvitations to complete an Internet questionnaire were sent via Facebook Messenger to identified strongman athletes. The survey consisted of four main areas of inquiry, including demographics and background information, training practices, tapering, and tapering practices. Of the 454 athletes that completed the survey over the 8-week period, 130 athletes responded on Facebook Messenger indicating that they intended to complete, or had completed, the survey. These participants were asked if they could complete the online questionnaire a second time for a test-retest reliability analysis. Sixty-four athletes (mean age 33.3 years, standard deviation [SD] 7.7; mean height 178.2 cm, SD 11.0; mean body mass 103.7 kg, SD 24.8) accepted this invitation and completed the survey for the second time after a minimum 7-day period from the date of their first completion. Agreement between athlete responses was measured using intraclass correlation coefficients (ICCs) and kappa statistics. Confidence intervals (at 95%) were reported for all measures and significance was set at P<.05.ResultsTest-retest reliability for demographic and training practices items were significant (P<.001) and showed excellent (ICC range=.84 to .98) and fair to almost perfect agreement (κ range=.37-.85). Moderate to excellent agreements (ICC range=.56-.84; P<.01) were observed for all tapering practice measures except for the number of days athletes started their usual taper before a strongman competition (ICC=.30). When the number of days were categorized with additional analyses, moderate reliability was observed (κ=.43; P<.001). Fair to substantial agreement was observed for the majority of tapering practices measures (κrange=.38-.73; P<.001) except for how training frequency (κ=.26) and the percentage and type of resistance training performed, which changed in the taper (κ=.20). Good to excellent agreement (ICC=.62-.93; P<.05) was observed for items relating to strongman events and traditional exercises performed during the taper. Only the time at which the Farmer’s Walk was last performed before competition showed poor reliability (ICC=.27).ConclusionsWe have developed a low cost, self-reported, online retrospective questionnaire, which provided stable and reliable answers for most of the demographic, training, and tapering practice questions. The results of this study support the inferences drawn from the Tapering Practices of Strongman Athletes Study.

Cross-cultural Adaptation and Validation of the Italian Version of the Vocal Tract Discomfort Scale (I-VTD)

To evaluate the reliability and validity of the Italian version of the VTD scale (I-VTD scale). Cross-sectional, nonrandomized, prospective study with controls. For the item generation, a cross-cultural adaptation and translation process was performed following the back translation process (phase 1). For reproducibility analysis (phase 2), 102 patients with dysphonia were recruited (internal consistency analysis); 57 of them completed the I-VTD scale twice (test-retest reliability analysis). Seventy-three vocally healthy participants completed the I-VTD scale for normative data generation (phase 3). For validity analysis (phase 4), the scores obtained by patients with dysphonia and by vocally healthy participants were compared (construct validity analysis); in addition, 45 patients with dysphonia completed both the I-VTD scale and the Italian version of the Voice Handicap Index for criterion validity analysis. Finally, for responsiveness analysis (phase 5), a cohort of 30 patients with muscle tension dysphonia was recruited, and scores of the I-VTD scale before and after voice therapy were compared. Both the internal consistency and the test-retest reliability of the I-VTD scale were satisfactory. The scores obtained by patients with dysphonia and vocally healthy participants were significantly different. Moderate correlations between the Italian version of the Voice Handicap Index and the I-VTD scores were found. Finally, the scores of the I-VTD scale obtained in pretreatment conditions appeared to be significantly higher than those obtained after successful voice therapy. The I-VTD scale appears a reliable and valid instrument for the assessment of vocal tract discomfort in Italian-speaking patients.

Assessing Test-Retest Reliability of Psychological Measures

Abstract. Psychological research and clinical practice rely heavily on psychometric testing for measuring psychological constructs that represent symptoms of psychopathology, individual difference characteristics, or cognitive profiles. Test-retest reliability assessment is crucial in the development of psychometric tools, helping to ensure that measurement variation is due to replicable differences between people regardless of time, target behavior, or user profile. While psychological studies testing the reliability of measurement tools are pervasive in the literature, many still discuss and assess this form of reliability inappropriately with regard to the specified aims of the study or the intended use of the tool. The current paper outlines important factors to consider in test-retest reliability analyses, common errors, and some initial methods for conducting and reporting reliability analyses to avoid such errors. The paper aims to highlight a persistently problematic area in psychological assessment, to illustrate the real-world impact that these problems can have on measurement validity, and to offer relatively simple methods for improving the validity and practical use of reliability statistics.

Biomarkers for diagnosis of Pediatric Acute Neuropsychiatric Syndrome (PANS) – Sensitivity and specificity of the Cunningham Panel

ObjectivePediatric Acute Neuropsychiatric Syndrome (PANS) and pediatric autoimmune neuropsychiatric disorders associated with streptococcal infections (PANDAS) are conditions marked by sudden onset of obsessive-compulsive disorder (OCD), tics, or avoidant/restrictive food intake in combination with multiple psychiatric symptoms. A diagnosis of PANS or PANDAS may be supported by the Cunningham Panel, a commercially available set of immunologic assays currently in clinical use. However, the relationship between Cunningham Panel results and patient symptoms remains unclear. This study was done to assess the diagnostic accuracy of the Cunningham Panel in patients with suspected PANS or PANDAS. MethodAll Swedish patients who had taken the Cunningham Panel prior to June 2014 (n=154) were invited and 53 patients participated in the study. Based on comprehensive psychiatric assessment (the reference standard of diagnosis), subjects were classified as PANS, PANDAS, or neither. Prior Cunningham Panel test results were collected from patient records, and new blood samples were similarly analyzed within the scope of this study. In addition, results were compared to healthy controls (n=21) and a test-retest reliability analysis was performed. ResultsSensitivities of individual biomarkers in the Cunningham Panel ranged from 15 to 60%, and specificities from 28 to 92%. Positive predictive values ranged from 17 to 40%, and negative predictive values from 44 to 74%. A majority of the healthy controls had pathological Cunningham Panel results and test-retest reliability proved insufficient. ConclusionClinical use of the Cunningham Panel in diagnosing PANS or PANDAS is not supported by this study.

Wilderness Survival Self-Efficacy Scale (WSSES)

This article presents a new diagnostic tool: the Wilderness Survival Self-Efficacy Scale (WSSES). The WSSES was developed to allow researchers and instructors to assess individuals’ perceived abilities to build their survival skills and apply them in their daily life. An exploratory factor analysis was conducted with 348 participants and resulted in one factor. A confirmatory factor analysis was performed using another sample of 199 participants, and the results verified the one-factor structure. The results suggest that the WSSES demonstrates a strong internal consistency (α = .88). A test-retest reliability analysis on a sample of 102 respondents indicated that WSSES scores were stable over a 4-week period. WSSES scores were highly related to general self-efficacy, moderately related to problematic coping and wilderness seeking, and unrelated to personality traits (openness to experience and agreeableness). The implications for outdoor education and mental health practices as well as research applications of this new measure are discussed. Key Words: Self-efficacy—Survival—Outdoor skills—Wilderness.

Comparing two schizophrenia-specific quality of life instruments in institutionalized people with schizophrenia

Clinical health professionals may have difficulties to select appropriate schizophrenia-specific Quality of life (QoL) instruments because of the limited information regarding their psychometric properties. Two widely used schizophrenia-specific QoL instruments (Schizophrenia Quality of Life Scale Revision 4 [SQLS-R4] and Lancashire Quality of Life Profile [LQOLP]) were compared in institutionalized people with schizophrenia, and useful recommendations for clinical health professionals were provided. Participants (n = 100) filled out the two instruments twice. Test-retest reliability, internal consistency, and confirmatory factor analyses (CFAs) were conducted. Both SQLS-R4 domains (r = 0.573–0.731) and LQOLP domains (r = 0.303–0.778) had good test-retest reliability. However, the objective QoL domains in the LQOLP showed lower internal consistency (α = 0.219–0.617) than its subjective QoL domains (α = 0.532–0.947) and the SQLS-R4 domains (α = 0.768–0.939). The CFAs with two correlated underlying instruments constructs and two correlated underlying QoL traits (viz., Physical and Psychosocial QoL) performed the best data-model fit (CFI = 0.990, RMSEA = 0.039, SRMR = 0.039), which supported the validity of both instruments. Although both SQLS-R4 and LQOLP were valid and reliable, using SQLS-R4 on institutionalized people seemed to be more psychometrically solid than using the LQOLP.

Psychometric Properties of the Fatigue Questionnaire EORTC QLQ-FA12 in a Sample of Female Cancer Patients

ContextCancer patients frequently suffer from fatigue. Recently, the European Organization for Research and Treatment of Cancer (EORTC) Quality of Life group developed a new 12-item fatigue assessment instrument. ObjectivesThe aim of this study was to psychometrically test this questionnaire in comparison with the three-item fatigue scale of the EORTC QLQ-C30. MethodsA sample of 354 patients who were being treated for breast cancer or gynecologic cancer were examined using the new fatigue questionnaire EORTC QLQ-FA12 and the EORTC QLQ-C30 during their hospital stay (t1) and three months after hospital discharge (t2). Confirmatory factorial analyses, item analyses, test-retest reliability analyses, and correlation analyses were performed. ResultsThe analyses roughly supported the three-factorial structure of the FA12, which comprised the subscales physical, emotional, and cognitive fatigue. The fit indices of the confirmatory factorial analysis were worse than those of the original article but nevertheless acceptable. Cronbach alpha of the total scale was 0.92; the coefficients of the subscales were between 0.79 and 0.93. The correlation between the EORTC QLQ-FA12 total scale and the fatigue scale of the EORTC QLQ-C30 was 0.69 and the correlation between the t1 and t2 scores was 0.45 for the EORTC QLQ-FA12 total scale and between 0.37 and 0.47 for the subscales. ConclusionThe psychometric coefficients justify the calculation of a sum score, which can be used by clinicians to assess the general degree of fatigue. Although the three-item fatigue scale of the EORTC QLQ-C30 stresses the physical aspect of fatigue, the new EORTC QLQ-FA12 covers its emotional and cognitive aspects as well.

Reliability, validity and sensitivity to change of neurogenic bowel dysfunction score in patients with spinal cord injury.

Psychometrics study. The aim of this study is to investigate the validity, reliability and sensitivity to change of neurogenic bowel dysfunction (NBD) score. Dokuz Eylül University Faculty of Medicine, Turkey. The study included 42 patients with spinal cord injury (SCI). The reliability of NBD score was assessed by test-retest reliability and internal consistency. Cronbach's alpha coefficient was calculated to determine internal consistency. The construct validity was evaluated by exploring correlations between the NBD score and SF-36 scales, patient assessment of impact of NBD on quality of life (QoL) and the physician global assessment (PGA). The Global Rating of Change (GRC) scale was used to assess the change of NBD to investigate the sensitivity of the score to change. Cronbach's alpha coefficient was 0.547. In test-retest reliability analysis, high correlations between total test-retest NBD score and answers of each question were found (r=1.000, P<0.001). NBD score had a strong and significant correlation with PGA (r=0.98, P<0.000) and the impact on QoL (r=0.92, P<0.001). There was a significant negative correlation between NBD score and subscales of SF-36 (P<0.05) except physical functioning, physical role functioning and physical component summary score. There was a significant improvement in NBD scores after treatment (P=0.011). A significant positive correlation was found between GRC scale and change in total NBD score (r=0.821, P=0.007). The Turkish version of the NBD score is a valid and reliable instrument and also sensitive to change in patients with SCI.

Reliability and Validity of the Greek Migraine Disability Assessment (MIDAS) Questionnaire.

BackgroundThe Migraine Disability Assessment (MIDAS) Questionnaire is a reliable and valid instrument for migraine-related disability. Such a tool is needed to quantify migraine-related disability in the Greek population.ObjectiveThis validation study aims to assess the test–retest reliability, internal consistency, item discriminant and convergent validity of the Greek translation of the MIDAS.MethodsAdults diagnosed with migraine completed the MIDAS Questionnaire on two occasions 3 weeks apart to assess reliability, and completed the RAND-36 to assess validity.ResultsParticipants (n = 152) had a median MIDAS score of 24 and mostly severe disability (58% were grade IV). The test–retest reliability analysis (N = 59) revealed excellent reliability for the total score. Internal consistency was α = 0.71 for initial and α = 0.82 for retest completion. For item discriminant validity, the correlations between each question and the total score were significant, with high correlations for questions 2–5 (range 0.67 ≤ r ≤ 0.79; p < 0.01). For convergent validity, there was significant negative correlation between the total score and all RAND-36 subscales except for ‘emotional wellbeing’. The negative correlation indicates that patients with a lower degree of disability according to their MIDAS score tended to have better wellbeing. Psychometric properties are comparable with those of other published validation studies of the MIDAS and the original. Findings on question 1 show that missing work/school days may be closely related with increased affect issues.ConclusionThe Greek version of the MIDAS Questionnaire has good reliability and validity. This study allowed for cross-cultural comparability of research findings.

Development of an assessment scale for treatment compliance in type 2 Diabetes Mellitus in Turkish population: Psychometric evaluation

ObjectivesCompliance to treatment is important for the management of type 2 diabetes mellitus (DM) and the prevention of complications. The purpose of the study was to develop a scale and test its psychometric properties for the treatment compliance of the diabetic Turkish population. MethodsThis multicenter study was conducted in four training and research hospitals. The convenience sample consisted of 350 patients with type 2 DM. The items of the scale were determined after a literature review and qualitative interviews with the patients. Items were psychometrically analyzed. Content validity of the scale was evaluated using opinions from experts and a pilot study. Principal component analysis and the varimax rotation technique were used to evaluate construct validity in exploratory factor analysis. Criterion validity was evaluated with the Attitudes Towards Diabetes Scale, a subgroup of the Diabetes Care Profile scale. Reliability was evaluated with Cronbach’s α coefficient and test-retest analysis of internal consistency. ResultsThe scale consisted of 7 factors that explained 47.36% of the total variance. The KMO test was conducted to determine whether the sample size was sufficient before the factor analysis. The KMO test result of the data was 0.75. The Cronbach’s α value of the sample was 0.77. The test-retest reliability analysis result was r = 0.991. We found a positive correlation between total scores of the developed scale and the Attitudes Towards Diabetes Scale (r = 0.31). ConclusionThe results of the study demonstrated that the scale with 30 items is a valid and reliable scale for the evaluation of patient compliance with type 2 DM treatment. Thus, by using this scale, nurses and healthcare providers can evaluate the treatment compliance of patients with type 2 DM.

A Developmental Study on Evaluating the Performance of Preschool Education Institution Teachers with 360 Degree Feedback

In accordance with the subject of this research, three different scales to measure preschool teachers’ performances with respect to school principals’, parents’ and children’s point of view were developed for the research. 51 principals, 893 parents and 256 children participated in the research.“Teacher Performance Evaluation Scale – Administrators’ Form” (TPESAF), “Teacher Performance Evaluation Scale – Parents’ Form” (TPESPF) and “Teacher Performance Evaluation Scale – Children’s Form” (TPESCF) are the scales that were prepared and used by the researcher. The data obtained were analysed by “SPSS 13 for Windows”. The main results of the research are as follows: Research, an exploratory factor analysis was carried out for each of the scales developed. In order to show the validity of the scales, the overall and sub-test content validity analysis and differentiation power of the (TPESAF), (TPESPF) and (TPESCF) were calculated. Following the factor analysis which gave the scales their final shape, statistical reliability analysis was carried out. In this study, Cronbach Alpha coefficients of the (TPESAF), (TPESPF) and (TPESCF) and their sub-tests’ means and standard deviations were calculated. Furthermore the test re-test reliability analysis was carried out. The scales were found to be reliable according to the reliability analysis (Cronbach Alpha Coefficients of Principal’s Form: 0,94, Parents’ Scale: 0,93, Children’s Scale: 0,84).

Multidimensional daily diary of fatigue-fibromyalgia-17 items (MDF-fibro-17): part 2 psychometric evaluation in fibromyalgia patients

BackgroundThe Multidimensional Daily Diary of Fatigue-Fibromyalgia-17 instrument (MDF-Fibro-17) has been developed for use in fibromyalgia (FM) clinical studies and includes 5 domains: Global Fatigue Experience, Cognitive Fatigue, Physical Fatigue, Motivation, and Impact on Function. Psychometric properties of the MDF-Fibro-17 needed to demonstrate the appropriateness of using this instrument in clinical studies are presented.MethodsPsychometric analyses were conducted to evaluate the factor structure, reliability, validity, and responsiveness of the MDF-Fibro-17 using data from a Phase 2 clinical study of FM patients (N = 381). Confirmatory factor analyses (CFA) were performed to ensure understanding of the multidimensional domain structure, and a secondary factor analysis of the domains examined the appropriateness of calculating a total score in addition to domain scores. Longitudinal psychometric analyses (test-retest reliability and responder analysis) were also conducted on the data from Baseline to Week 6.ResultsThe CFA supported the 17-item, 5 domain structure of this instrument as the best fit of the data: comparative fit index (CFI) and non-normed fit index (NNFI) were 0.997 and 0.992 respectively, standardized root mean square residual (SRMR) was 0.010 and the root mean square error of approximation (RMSEA) was 0.06. In addition, total score (CFI and NNFI both 0.95) met required standards. For the total and 5 domain scores, reliability and validity data were acceptable: test-retest and internal consistency were above 0.9; correlations were as expected with the Global Fatigue Index (GFI) (0.62-0.75), Fibromyalgia Impact Questionnaire (FIQ) Total (0.59–0.71), and 36-Item Short Form Health Survey (SF-36) vitality (VT) (0.43–0.53); and discrimination was shown using quintile scores for the GFI, FIQ Total, and Pain Numeric Rating Scale (NRS) quartiles. In addition, sensitivity to change was demonstrated with an overall mean responder score of -2.59 using anchor-based methods.ConclusionThe MDF-Fibro-17 reliably measures 5 domains of FM-related fatigue and psychometric evaluation confirms that this measure meets or exceeds each of the predefined acceptable thresholds for evidence of reliability, validity, and responsiveness to changes in clinical status. This suggests that the MDF-Fibro-17 is an appropriate and responsive measure of FM-related fatigue in clinical studies.