Reliability Of Individual Items Research Articles

Reliability of the Mini-BESTest and Brief-BESTest for assessing patients with incomplete spinal cord injury.

Single institution observational study. To investigate the ceiling and floor effects of the Berg Balance Scale (BBS), Mini-Balance Evaluation Systems Test (BESTest), and Brief-BESTest, as well as to determine the intra- and inter-rater reliabilities and minimal detectable change (MDC) of the Mini-BESTest and Brief-BESTest in patients with acute and subacute incomplete cervical spinal cord injury (SCI) classified as AIS D. Advanced critical care center of our university hospital. Twenty patients with incomplete cervical SCI who could stand without assistance were recruited. The floor and ceiling effects were evaluated by plotting histograms from the distribution of scores on the BBS, Mini-BESTest and Brief-BESTest, and calculating skewness. The Mini-BESTest and Brief-BESTest were evaluated and videotaped simultaneously, and intra- and inter-rater reliabilities were assessed. The MDC was also calculated. The skewness of the BBS was -1.57, and the full score was 35%, indicating a ceiling effect. However, no ceiling or floor effect was observed for the Mini-BESTest and the Brief-BESTest. Intraclass correlation coefficients for intra-rater and inter-rater reliabilities were 0.98 and 0.97 for the Mini-BESTest and Brief-BESTest, respectively. Individual item reliability was moderate or better for the Mini-BESTest and excellent or better for the Brief-BESTest. The MDC of total scores ranged 3.14-3.84 and 2.92-3.60 for the Mini-BESTest and Brief-BESTest, respectively. The Mini-BESTest and Brief-BESTest are reliable assessment tools for patients with acute and subacute incomplete SCI classified as AIS D. Clarified error ranges aid in estimating the treatment effect on balance abilities.

Adaptation and development of the instruction manual for a videoconference-based Motor Assessment Scale: validity, reliability and measurement error of Tele-MAS

Purpose To develop an instruction manual to administer the Motor Assessment Scale (MAS) via videoconferencing (Tele-MAS), investigate its validity, reliability and measurement error. Materials and methods In-person assessment, conducted at the participant’s home, was compared to remote assessment conducted by rater A. Then, within two days, the rater B, repeat the remote assessment (n = 41). Part of the sample (n = 10) was assessed again within seven days by rater A to determine test-retest reliability. Concurrent validity, agreement of alternate forms (in-person x remote) for total score and reliability of individual items were analyzed using respectively the Pearson correlation coefficient, Bland-Altman plots and weighted Kappa (Kw). Interrater and test-retest reliability were analyzed by Intraclass Correlation Coefficient (ICC). Standard Error of Measurement (SEM) and Minimal detectable changes (MDC) were computed. Results The Tele-MAS instruction manual was developed. In-person MAS and Tele-MAS present a high positive correlation (r = 0.97). Bland-Altman plots showed adequate agreement (MD=-0.0 point). Most Individual items showed excellent reliability (Kw > 0.70). Tele-MAS showed excellent interrater (ICC(2,1)=0.92) and test-retest (ICC(3,1)=0.98) reliability. Tele-MAS presents a SEM = 3% and MDC = 8%. Conclusion The Tele-MAS is a valid and reliable global motor assessment scale to be applied in individuals after stroke.

Evaluation of the psychometric properties of the homophobia scale in religious-based university students in Indonesia

This study aims to evaluate the psychometric properties of the homophobia scale in students attending religion-based universities in Indonesia. This research is important as homosexuality is a controversial issue in the country and is still a topic of debate. The Homophobia Scale is a tool that assesses attitudes towards homosexuality through 17 items measuring positive affirmation, negative cognition, and the perceived threat of homosexual behavior. The scale was adapted for the Indonesian context, which is predominantly religious, based on The Heterosexual Attitudes Towards Homosexuality (HATH) Scale and Items, originally translated by bilingual experts. The translated scale was then reviewed for content by psychologists and communication experts, and field-tested for reliability and validity. Data from 327 students aged 18–35 from both state and private religion-based universities were analyzed using Rasch model analyses, including principal component analysis (PCA), reliability analysis, and differential item functioning (DIF) assessment. The study found that the homophobia scale accounted for 42.4 % of the raw variance, indicating its unidimensionality. The scale demonstrated an acceptable level of personal reliability and excellent reliability for individual items. Results revealed significant demographic effects, with age and study program showing more differential item functioning (DIF). Male students were more tolerant towards homosexuals than females. Additionally, students at state universities tended to be more tolerant but held negative views of homosexuality when associated with AIDS. In conclusion, the homophobia scale assessed in this study exhibits promising construct validity and sufficient psychometric properties. The findings indicate that negative stigma towards homosexuals and homophobia still persist among students at religion-based universities in Indonesia, despite limited interaction with homosexuals.

Reliability and concurrent validity of the Active Movement Scale (AMS) in adults with musculoskeletal disorders.

The Active Movement Scale (AMS) is a brief screen for identifying movement impairments affecting functional task performance. To assess inter-rater reliability, test-retest reliability, floor and ceiling effects, and concurrent validity of the AMS in adults with musculoskeletal disorders. Fifty-five subjects (mean age: 61.3±15.3 years) transitioning from physical therapy attended two sessions. The 14-item AMS was assessed by two therapists, resulting in a total score (AMST) and two sub-scores: upper body (AMSU) and lower body (AMSL). Moreover, subjects completed PROMIS Physical Function-10a (PPF), Lifestyle Physical Function (LPF), Cardio Activity Level (CAL) surveys, Two Square Agility Test (TSAT), WorkAbility Rate of Manipulation Turning (WRMT) and Placing (WRMP), Grip Strength (GS), 10-Meter Walk Usual (GSU) and Fast (GSF) pace, and Grooved Pegboard Placing (GPP) and Remove (GPR) tests. Inter-rater reliability coefficients for AMST, AMSU, and AMSL were 0.96, 0.92, and 0.96, respectively, with individual item reliability ranging from 0.58 to 1.0. Test-retest reliability for these assessments yielded coefficients of 0.93, 0.84, and 0.94, with individual item reliability ranging from 0.47 to 0.88. No floor effects were observed, but mild ceiling effects were noted. AMST showed a high correlation with LPF (r = 0.72) and moderate correlation with PPF (r = 0.64) surveys. AMSU had moderate correlations with GPP (r = 0.61) and WRMP (r = 0.57) tests, while AMSL correlated moderately with GSF (r = 0.55) and TSAT (r = 0.50) tests. This study provides evidence of the reliability and validity of AMS in adults with musculoskeletal disorders to support transitions between rehabilitation and fitness programs.

Development of self-administered questionnaire on barriers, prescription practices, and guideline adherence of osteoporosis management among tertiary care clinicians: content validity and reliability analysis.

This study outlined the development of the barriers, prescribing practices, and guideline adherence for osteoporosis management according to the Clinicians' Osteoporosis Questionnaire (COQ) followed by an assessment of the content validity index and reliability test. The development of the COQ was performed in two stages. Stage I involved the development of the COQ, and stage II involved judgmental evidence and quantification of the questionnaire. Five panel experts related to the study area and five clinicians participated in the validity of the COQ assessment. Fifty clinicians took part in the reliability test evaluation by filling out the questionnaire twice at 2-week intervals. The content validity index (CVI) and content validity ratio (CVR) were analyzed using Microsoft Excel, while Cohen's kappa statistic was used to determine the test-retest reliability using SPSS version 29. Forty items and three domains, namely, barriers, prescribing practices, and guideline adherence for osteoporosis management, were identified in the COQ (version 4.0). The scale-level CVI (S-CVI/Ave) for every domain was above 0.9, which is considered acceptable. The CVRs for all the items were above 0.7, except for two items in the barrier domain and two items in the guideline adherence domain. Two items were revised to improve the clarity of the item, and other items were retained based on consensus among the expert panel. Between the test and retest, the reliability of individual items ranged from moderate to almost perfect for the barrier domain (k = 0.42-0.86), prescribing practice domain (k = 0.79-0.87), and guideline adherence domain (k = 0.46-1). None of the items had "fair" or "poor" agreement. Thus, the 40-item COQ (version 4.0) was finalized following the content and face validity analysis. Through an iterative process, the development and assessment of the COQ showed a high degree of content validity and reliability in measuring the barriers, prescribing practices, and guideline adherence among clinicians managing osteoporosis. Future studies should aim to further validate this instrument across different populations and settings, as well as explore methods to enhance its reliability and validity.

Factorial Validity and Reliability of a Food Behavior Checklist for Japanese Pregnant and Postpartum Women

Background: Dietary education programs for pregnant and postpartum Japanese women are conducted during health check-ups and in childbirth education classes, but there is no tool to evaluate their food behavior. Therefore, this study examined the factorial validity, test–retest reliability, and internal consistency of the food behavior checklist (FBC) for pregnant and postpartum Japanese women. Subjects and Method: This was a longitudinal study. We screened 4,000 women aged 18–45 years who were either pregnant or nursing an infant aged <1 years and enrolled in Freeasy, a platform with 4.5 million panels. Data were collected from 97 pregnant women and 203 postpartum women through an online survey. They completed the 21-item FBC on a web survey twice at an interval of 3 weeks. After performing principal component analyses, internal consistency was calculated using Cronbach’s α. The intraclass correlation coefficient (ICC) and kappa (κ) coefficient were calculated to assess the test–retest reliability. Results: There were 21 items loaded on six factors (fruit and vegetable quantity, vegetable variety, balanced fish and meat intake, sweetened beverages, eating habits, and food consciousness). Cronbach’s α for the total scale was 0.77. ICC for the test–retest reliability of individual items ranged from 0.35 to 0.62, and ICC for the total scale was 0.62. The κ coefficient values ranged from 0.26 to 0.52, indicating fair-to-moderate strength of agreement between the test and retest. Conclusion: The FBC demonstrated factorial validity, test–retest reliability, and internal consistency, indicating its potential application in evaluating the effects of the dietary education programs on pregnant and postpartum women, which include taking a staple meal, folic acid, and avoiding raw food consumption. This compact tool can be conveniently used by midwives and provide practical guidance during maternal health check-ups. Keywords: pregnant, postpartum, dietary, checklist, reproducibility. Correspondence: Megumi Fujita. Yamagata University, 2-2-2 Iida Nishi Yamagata, 990-9585, Japan. Email: f.megumi@med.id.yamagata-u.ac.jp Mobile: + 81 23-628-5443.

Twelve tips to aid interpretation of post-assessment psychometric reports

Post-assessments psychometric reports are a vital component of the assessment cycle to ensure that assessments are reliable, valid and fair to make appropriate pass-fail decisions. Students’ scores can be summarised by examination of frequency distributions, central tendency measures and dispersion measures. Item discrimination indicies to assess the quality of items, and distractors that differentiate between students achieving or not achieving the learning outcomes are key. Estimating individual item reliability and item validity indices can maximise test-score reliability and validity. Test accuracy can be evaluated by assessing test reliability, consistency and validity and standard error of measurement can be used to measure the variation. Standard setting, even by experts, may be unreliable and reality checks such as the Hofstee method, P values and correlation analysis can improve validity. The Rasch model of student ability and item difficulty assists in modifying assessment questions, pinpointing areas for additional instruction. We propose 12 tips to support test developers in interpreting structured psychometric reports, including analysis and refinement of flawed items and ensuring fair assessments with accurate and defensible marks.

Inter-rating reliability of the Swiss easy-read integrated palliative care outcome scale for people with dementia.

The Integrated Palliative Care Outcome Scale for People with Dementia is a promising instrument for nursing home quality improvement and research in dementia care. It enables frontline staff in nursing homes to understand and rate the needs and concerns of people with dementia. We recently adapted the measure to include easy language for users from various educational backgrounds. In this study, we examine the inter-rating reliability of the Integrated Palliative Care Outcome Scale for People with Dementia for frontline staff in nursing homes. In this secondary analysis of an experimental study, 317 frontline staff members in 23 Swiss nursing homes assessed 240 people with dementia from a convenience sample. Reliability for individual items was computed using Fleiss Kappa. Because of the nested nature of the primary data, a generalisability and dependability study was performed for an experimental IPOS-Dem sum score. The individual Integrated Palliative Care Outcome Scale for People with Dementia items showed kappa values between .38 (95% CI .3-.48) and .15 (95% CI .08-.22). For the experimental IPOS-Dem sum score, a dependability index of .57 was found. The different ratings and time between ratings explain less than 2% of the variance in the sum score. The different nursing homes make up 12% and the people with dementia make up 43% of the sum score variance. The dependability study indicates that an experimental IPOS-Dem sum score could be acceptable for research by averaging two ratings. Limited research has been conducted on the measurement error and reliability of patient-centred outcome measures for people with dementia who are living in nursing homes. The Swiss Easy-Read IPOS-Dem is a promising instrument but requires further improvement to be reliable for research or decision making. Future studies may look at its measurement properties for different rater populations or at different stages of dementia. Furthermore, there is a need to establish the construct validity and internal consistency of the easy-read IPOS-Dem.

Instructional leadership scale for high school principals: Development and validation

Principal instructional leadership (PIL) refers to the management of school curriculum, instruction, and assessment by the principal of a school. It is essential to measure the extent of the instructional leadership provided by principals and to propose means of improving instructional leadership. The principal instructional leadership scale (PILS) has been put forward to achieve these goals. In the current study, we validated the PILS on a sample of Taiwanese teachers using a multilevel approach involving expert reviews and three studies. Following two stages in confirmation of content validity by 20 experts, the initial 30-item PILS with five core concepts was subjected to discrimination analysis, exploratory factor analysis, and internal consistency reliability analysis utilizing SPSS 13.0 for Windows and AMOS 22.0 ( n = 339). This resulted in the deletion of nine items. In the second study, the individual item reliability of the remaining 21 items was examined, and the composite reliability, convergent validity, and discriminant validity confirmed the selection of the optimal model ( n = 672). The results of the third study ( n = 1438) supported metric invariance, scalar invariance, and factor variance-covariance invariance and confirmed scalar measurement invariance across genders. Finally, cross-validation analysis verified that the scale was stable and well-constructed.

Intrarater and interrater reliability of the dynamic gait index in post stroke patients with eye movement disorders

BackgroundThe Dynamic Gait Index (DGI) is a useful tool that has been evaluated for its reliability in patients with vestibular disorders, elderly people and, in chronic stroke population. Present study was aimed to evaluate the intrarater and interrater reliability of the DGI to measure dynamic balance and gait performance in stroke patients with eye movement disorders. MethodsA sample of 30 stroke patients suffering from eye movement disorders were recruited. Two Physical therapists assessed the intrarater and interrater reliability of the DGI in two testing sessions three days apart. In the later session, two raters assessed the patients’ performance simultaneously on the DGI. The reliability was calculated using the intra-class correlation coefficient (ICC2, 1). Standard error of measurement (SEM) and minimal detectable change (MDC95) at 95% confidence interval were also calculated. A significance level was set at p-value <0.05. ResultsThe (ICC2, 1) for intrarater and interrater reliability of total DGI scores was 0.86 and 0.91 respectively. While (ICC2, 1) for intrarater and interrater reliability of individual items ranged from 0.73 to 0.91 to 0.73–0.93, respectively. The (SEM) and (MDC95) for intrarater reliability of total DGI scores were 0.76 and 2.10, respectively. Corresponding values for interrater reliability were 0.62 and 1.71, respectively. ConclusionsThe DGI is a reliable tool for evaluating the dynamic balance and gait performance in stroke patients with eye movement disorders. This tool showed good to excellent intrarater and interrater reliability of total DGI scores and moderate to good intrarater and interrater reliability of individual items of the DGI.

Psychometric Properties of LUN-MS: A New Questionnaire to Identify the Unmet Needs of People With Multiple Sclerosis.

We developed a 29-item Questionnaire, Long-term Unmet Needs in MS (LUN-MS) to identify the unmet needs of people with multiple sclerosis (pwMS). To assess acceptability, test-retest reliability, internal consistency, and validity of the LUN-MS. Participants completed the LUN-MS and MSIS-29 twice, four weeks apart. Acceptability was assessed by looking at the response rate in each time point. Reliability was calculated by comparing the response during the two time points using Cohen's weighted kappa. Using principal component analysis, the dimensionality of the questionnaire's items was reduced, to five domains and the internal consistency of each domain was assessed using Cronbach's alpha. Concurrent validity was tested by comparing the total LUN-MS score against MSIS-29 and EQ-5D-3L using Pearson's product-moment correlation coefficient. Among 88 participants, rate of completion at time points-1 and 2 was 96 and 80% respectively. Test-retest reliability for individual items was between fair to near-perfect (weighted Cohen's kappa 0.39-0.81). The unmet needs could be divided into five internally consistent domains (Cronbach's alpha 0.83-0.74): neuropsychological, ambulation, physical, interpersonal relationship and informational. Concurrent validity with MSIS-29 (r = 0.705, P < .001) and EQ-5D-3L (r = 0.617, P < .001) were good. LUN-MS is a reliable, valid, and acceptable tool to identify the unmet needs of pwMS.

Keputusan Investasi Digital dan Transaksi Non Tunai Investor Muslim

Muslim investors invest for financial gain in the future. The current investment decision determines the profit or loss received. The purpose of the study was to determine how much financial literacy and risk tolerance influence in determining digital investment decisions and to find out how much financial literacy and risk tolerance influence in conducting non-cash transactions during the covid-19 pandemic for Muslim investors. The research was conducted on Muslim investors in Sukoharjo Regency. Determination of the sample using purposive sampling with the number of respondents as many as 110. Data collection was done using a questionnaire distributed to Muslim investors who have done investment activities. Testing the model using Path Analysis with SmartPLS Software by performing Individual Item Reliability Test, Internal Consistency Test, and Discriminant Validity Test. The test results show that the financial literacy of Muslim investors has no effect on investment decisions and non-cash transaction decisions. Meanwhile, risk tolerance affects investment decisions and non-cash transaction decisions. The investment decisions of a Muslim are not based on their financial knowledge but on the current economic situation.

Translation, cultural adaptation, and validation of the Integrated Palliative Outcome Scale-renal (IPOS-r) to Czech

BackgroundPatients with advanced kidney disease suffer from burdensome symptoms, which should be assessed by valid and reliable patient-reported outcome measures.This study aimed to provide a translation, cultural adaptation, and validation of the Czech version of the IPOS-r.MethodsThe IPOS-r was translated to Czech and culturally adapted using cognitive interviews. During the validation phase, patients and staff in dialysis centres and outpatient renal clinics completed the IPOS-r. Internal consistency was tested with Cronbach’s alpha, its reliability via intraclass correlation coefficient for total IPOS-r score, and weighted Kappa (for test-retest and interrater reliability of individual items). Convergent validity was tested with Spearman correlation to Kidney Disease Quality of Life Survey-Short Form 1.2 (KDQOL-SF 1.2). We assessed sensitivity to change using a distribution-based approach.ResultsTwo sets of translators independently performed forward and backward translations of the IPOS-r. Ten patients and ten health care professionals participated in cognitive pre-testing. The sample size for validation included 88 patients (mean age 66 ± SD13.8; 58% men) who were treated with haemodialysis (70.5%), home haemodialysis (5.5%), peritoneal dialysis (3%), and conservative management (21%). Cronbach’s alpha was 0.72, and the intraclass correlation was 0.84 for test-retest reliability and 0.73 for interrater reliability. The IPOS-r correlated with KDQOL-SF 1.2 had a rho between 0.4–0.8 for most of the IPOS-r items, showing good convergent validity. The IPOS-r measure is feasible and takes 9 minutes to complete. Patients who reported a change in health status after 1 month demonstrated a total IPOS-r score change of eight points in both positive and negative directions.ConclusionsThe process of translation and cultural adaptation of the IPOS-r was successful, and the Czech IPOS-r measure is a valid and reliable tool. The Czech IPOS-r can be used to assess symptoms in patients with advanced chronic kidney disease.Trial registrationGAUK [82121].

Development and Testing of a Sedation Scale for Use in Rabbits (Oryctolagus cuniculus).

In biomedical research, rabbits are commonly sedated to facilitate a variety of procedures. Developing a sedation assessment scale enables standardization of levels of sedation and comparisons of sedation protocols, and may help in predicting sedation level requirements for different procedures. The goal of this study was to develop a rabbit sedation assessment scale using a psychometric approach. We hypothesized that the sedation scale would have construct validity, good internal consistency, and reliability. In a prospective, randomized, blinded study design, 15 (8 females, 7 males) healthy 1-y-old New Zealand white rabbits received 3 intramuscular treatments: midazolam (0.5 mg/kg; n = 6); midazolam (1.5 mg/kg)-ketamine (5 mg/kg; n = 7); and alfaxalone (4 mg/kg)-dexmedetomidine (0.1 mg/kg)-midazolam (0.2 mg/kg; n = 3). One rabbit received 2 treatments. A sedation scale was developed by using psychometric methods, with assessment performed by 6 independent raters who were blind to treatment. Final sedation scale items included posture, palpebral reflex, orbital tightening, lateral recumbency, loss of righting reflex, supraglottic airway device placement, toe pinch, and general appearance. The scale showed construct validity, good to very good interrater reliability for individual items (6 raters; intraclass correlation coefficient, 0.671 to 0.940), very good intrarater reliability (5 raters; intraclass correlation coefficient, 0.951 to 0.987), and excellent internal consistency (Cronbach α, 0.947). The sedation scale performed well under the conditions tested, suggesting that it can be applied in a wider range of settings (different populations, raters, sedation protocols).

Inter-rater reliability of subthreshold psychotic symptoms in individuals with 22q11.2 deletion syndrome

BackgroundPathways leading to psychosis in 22q11.2 deletion syndrome (22q11.2DS) have been the focus of intensive research during the last two decades. One of the common clinical risk factors for the evolution of psychosis in 22q11.2DS is the presence of positive and negative subthreshold psychotic symptoms. The gold standard for measuring subthreshold symptoms is the Structured Interview for Prodromal Syndromes (SIPS) and its accompanying Scale of Prodromal Symptoms (SOPS) ratings. Although the scale has been used by many centers studying 22q11.2DS, the inter-site reliability of the scale in this population has never been established.MethodsIn the present study, experienced clinical assessors from three large international centers studying 22q11.2DS independently rated video recordings of 18 adolescents and young adults with 22q11.2DS.ResultsThe intraclass correlations coefficients (ICCs) among three raters for the SOPS total scores, as well as for the positive, negative, and disorganization subscale scores, were good-to-excellent (ICCs range 0.73–0.93). The raters were also able to reliably determine the subjects’ subthreshold syndrome status (ICC = 0.71). The reliability of individual items was good-to-excellent for all items, ranging from 0.61 for motor disturbances [G3] to 0.95 for bizarre thinking.ConclusionsOur results show that trained clinicians can reliably screen for subthreshold psychotic symptoms in individuals with 22q11.2DS. To increase assessment reliability, we suggest specific clarifications and simplifications to the standard SIPS interview for future studies.

Perceived variability reflects the reliability of individual items

When confronted with many visual items, people can compute their variability accurately and rapidly, which facilitates efficient information processing and optimal decision making. However, how the visual system computes variability is still unclear. To investigate this, we implemented situations whereby estimates of variability based on several possible variability measures (e.g., range, standard deviation, and weighted standard deviation) could be differentiated, and then examined which best accounted for human variability perception. In three psychophysical experiments, participants watched two arrays of items with various orientations and judged which had more variable orientations. Results showed that perceived variability was most consistent with the weighted standard deviation based on the reliability of individual items. Specifically, participants gave less consideration to deviant orientations that were likely to be outliers, and greater consideration to salient orientations that were likely to be encoded precisely. This reliability-based weighted standard deviation suggests an efficient and flexible way of representing visual variability.

Development and standardisation of study skills assessment scale

Adolescence is characterized by several social and emotional changes that include labile emotions, exploring and asserting of personal identity, independence, self-centred attitudes, testing rules and boundaries. Adolescents are intensively curious and have a wide range of intellectual pursuits but show disinterest in conventional learning styles. The researcher felt that comprehensive study on study skills is required to understand adolescents’ learning behaviour. Study Skills are the abilities applied in learning. Theorizing of study skills are supported by five important theoretical frameworks such as, social learning, cognitive problem solving, Constructivist Psychology, Bronfenbrenner’s Ecological Systems and multiple intelligence theory. The study skills assessment scale is a tool developed by the researchers as a self- administered one to a group or to individuals. The scale includes several items which asses the overall level of the individual’s study skills. Respondents answer in a 5-point Likert scale ranging from 1to5. The study skills include time management, learning motivation, memory, concentration, association, comprehension, taking notes, preparation for examinations, textbook reading, consultation with teachers and home work. The study skills assessment scale was constructed with due diligence and extensive field observations to ensure the internal and external validity. The item analysis of the scale was carried out, determining the high score and low score and the relevance of scale. The validity was established through validation of each item by a team of experts in the field of psychology and education. The suggestions given by the experts were incorporated while finalising the items. Pilot tests were conducted among rural and urban including male and female school going adolescents. The reliability of individual items and total was calculated using split half method, test-retest and Cronbach’s alpha. The reliability score of the scale

Reliability of Self-Administered Questionnaire on Dietary Supplement Consumption in Malaysian Adolescents.

The repeatability of most questionnaires utilized in previous studies related to the consumption of dietary supplements (DS) among youth has not been well documented. Thus, a simple and easy-to-administer questionnaire to capture the habitual use of DS in the past one year known as the dietary supplement questionnaire (DiSQ) was developed and supported with external reliability evaluation. Analyses were done based on a convenience sample of 46 secondary school students. To elicit information regarding the intake of DS, the questionnaire was partitioned into two domains. The first domain was used to identify vitamin/mineral (VM) supplements, while the second domain was utilized to identify non-vitamin/non-mineral (NVNM) supplements. Cohen’s kappa coefficient (k) was used to evaluate the test–retest reliability of the questionnaire. Questionnaire administration to the respondents was done twice whereby a retest was given two weeks after the first test. Between test and retest, the reliability of individual items ranged from moderate to almost perfect for the VM (k = 0.53–1.00) and NVNM (k = 0.63–1.00) domains. None of the items had “fair” or ”poor” agreement. Various correlation coefficients can be obtained for the DiSQ but are generally reliable over time for assessing information on the consumption of supplements among the adolescent population.

Test-retest reliability of a self-reported physical activity environment instrument for use in rural settings.

Little is known about how the physical environment impacts physical activity behaviour among rural populations, who are typically less active and at higher risk of chronic disease than urban dwellers. The lack of individual-level instruments to assess the physical environment in rural areas limits advancement of this field. Among rural adults, this study aimed to evaluate (a) the test-retest reliability of a self-reported questionnaire of individual-level perceptions of the physical activity environment, and (b) the stability of a self-reported physical activity questionnaire. Cross-sectional questionnaire repeated twice, 2weeks apart. The questionnaire included 94 items relating to the perceived physical environment (representing nine summary scores), demographic characteristics and physical activity. Rural Australia. Rurally residing adults (≥18years) across three Australian states. Test-retest reliability evaluated by weighted Kappa statistics (individual items) and intra-class correlations (summary scores). A total of 292 participants (20% men) completed both questionnaires, on average 22days apart. Test-retest reliability of individual items ranged from weighted Kappa 0.37-0.85 (median: 0.59). Internal reliability for five summary scores was good to excellent (Cronbach's alpha: 0.81-0.97). Test-retest reliability was good to excellent for six summary scores (intra-class correlations: 0.67-0.77). The findings indicated good to excellent test-retest reliability for most items, particularly "fixed" constructs for this new questionnaire measuring the perceived physical environment in rural populations. This study represents an important step towards improving measurement of physical activity environments in rural populations, potentially leading to better tailored interventions to promote active and healthy living in rural areas.

Patient-reported quality indicators to evaluate physiotherapy care for hip and/or knee osteoarthritis- development and evaluation of the QUIPA tool

BackgroundThere is no physiotherapy-specific quality indicator tool available to evaluate physiotherapy care for people with hip and/or knee osteoarthritis (OA). This study aimed to develop a patient-reported quality indicator tool (QUIPA) for physiotherapy management of hip and knee OA and to assess its reliability and validity.MethodsTo develop the QUIPA tool, quality indicators were initially developed based on clinical guideline recommendations most relevant to physiotherapy practice and those of an existing generic OA quality indicator tool. Draft items were then further refined using patient focus groups. Test-retest reliability, construct validity (hypothesis testing) and criterion validity were then evaluated. Sixty-five people with hip and/or knee OA attended a single physiotherapy consultation and completed the QUIPA tool one, twelve- and thirteen-weeks after. Physiotherapists (n = 9) completed the tool post-consultation. Patient test-retest reliability was assessed between weeks twelve and thirteen. Construct validity was assessed with three predefined hypotheses and criterion validity was based on agreement between physiotherapists and participants at week one.ResultsA draft list of 23 clinical guideline recommendations most relevant to physiotherapy was developed. Following feedback from three patient focus groups, the final QUIPA tool contained 18 items (three subscales) expressed in lay language. The test-retest reliability estimates (Cohen’s Kappa) for single items ranged from 0.30–0.83 with observed agreement of 64–94%. The intraclass correlation coefficient (ICC) and 95% confidence interval (CI) for the Assessment and Management Planning subscale was 0.70 (0.54, 0.81), Core Recommended Treatments subscale was 0.84 (0.75, 0.90), Adjunctive Treatments subscale was 0.70 (0.39, 0.87) and for the total QUIPA score was 0.80 (0.69, 0.88). All predefined hypotheses regarding construct validity were confirmed. However, agreement between physiotherapists and participants for single items showed large measurement error (Cohen’s Kappa estimates ranged from − 0.04-0.59) with the ICC (95% CI) for the total score being 0.11 (− 0.14, 0.34).ConclusionsThe QUIPA tool showed acceptable test-retest reliability for subscales and total score but inadequate reliability for individual items. Construct validity was confirmed but criterion validity for individual items, subscales and the total score was inadequate. Further research is needed to refine the QUIPA tool to improve its clinimetric properties before implementation.