Reliability Of Self Research Articles

Reliability of self driving cars

Reliability of self driving cars

Effects of learner factors on the scorer reliability of self- and peer-assessment of Chinese college students’ EFL writing

ABSTRACT Learner autonomy has received growing interest from researchers and educators since the 1980s. Autonomous learners are supposed to monitor their progress and assess their performance. The present study investigated the effects of learner factors on the scorer reliability of self- and peer-assessment of EFL (English as foreign language) writing among Chinese college students. The learner factors involved are second language (L2) proficiency and English self-concept. The experiment was conducted on 52 Chinese college students. The results show that: 1) Though L2 proficiency had a limited effect, high-achievers seemed to perform better in self- and peer-assessment to some extent; 2) high English self-concept led to a higher reliability of self-assessment; and 3) on the whole, the subjects’ self-assessment was more accurate than peer-assessment, but they tended to overestimate their own performance while underestimate their peers’ regardless of their L2 proficiency and English self-concept.

A clinical test to assess isometric cervical strength in chronic whiplash associated disorder (WAD): a reliability study

BackgroundCervical spine muscle weakness is well demonstrated in individuals with chronic neck pain. There is a lack of literature evaluating clinically applicable means of assessing isometric cervical strength in chronic whiplash associated disorder (WAD). This study assessed the reliability of self-resisted isometric cervical strength testing using a handheld dynamometer. The relationship between strength and neck pain-related disability and kinesiophobia was also investigated.MethodsTwenty subjects with chronic WAD performed maximum-effort isometric cervical flexion, extension, side flexion, and rotation against a hand held dynamometer. The dynamometer was held by the subject, who provided self-resistance. Subjects completed two sessions of testing on one day with two different examiners, and one session on a subsequent day with one of the original examiners. Subjects completed the Neck Disability Index (NDI) and Tampa Scale for Kinesiophobia (TSK) prior to the first testing session.ResultsIntraclass correlation coefficients (ICC) for directional strength measures were fair to high (0.71–0.88 for intra-rater and 0.79–0.91 for inter-rater). Total strength (sum of all directional strengths) ICCs were high for both intra-rater (ICC = 0.91) and inter-rater (ICC = 0.94) measures. All statistical tests for ICCs demonstrated significance (α < 0.05). Agreement was assessed using Bland Altman (BA) analysis with 95% limits of agreement. BA analysis demonstrated difference scores between the two testing sessions that ranged from 3.0—17.3% and 4.5—28.5% of the mean score for intra and inter-rater measures, respectively. Most measures did not meet the a priori standard for agreement. A moderate to good inverse relationship was demonstrated between kinesiophobia (TSK score) and six out of seven strength measures (α < .05). No significant correlation was found between neck disability (NDI) and cervical strength in any direction.ConclusionThis study demonstrated fair to high reliability of self resisted isometric cervical strength testing in the chronic WAD population. All directional strength measures except flexion demonstrated a significant inverse relationship with kinesiophobia. No cervical strength measures were correlated with neck disability. These results support testing cervical strength in this manner to reliably assess change over time within individual patients. The value of such measurement requires further consideration given the lack of correlation between cervical strength and disability. Further research is required to establish normative values and enhance clinical utility.

Practicality and Reliability of Self Vs Administered Rapid Geriatric Assessment Mobile App.

ObjectivesTo develop and cross-validate self-administered Rapid Geriatric Assessment (SA-RGA) app against administered Rapid Geriatric Assessment (A-RGA) to identify seniors with geriatric syndromes such as frailty, sarcopenia, and anorexia of ageing who may benefit from targeted intervention.DesignProspective observational study.SettingPrimary Care and Community.ParticipantsA-RGA and SA-RGA app were administered to older adults ≥ 60 years old from December 2020 to April 2021.MeasurementsThe RGA app screens for frailty (FRAIL), sarcopenia (SARC-F), anorexia of aging (SNAQ) and cognition (Rapid Cognitive Screen) with assisted management pathway. Patient Health Questionnaire 9 is administered for those who score positive for fatigue. The diagnostic performance of SA-RGA was compared against A-RGA as a reference by calculating the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) and positive likelihood ratio (+LR).Results123 participants with a mean age of 71 ± 5.9 years completed both the SA-RGA and A-RGA. Questions on fatigue, 5 or more illnesses, loss of weight and falls in the past year performed better with high sensitivity, specificity, NPV and +LR than self-functional assessment where SA-RGA participants reported lower prevalence on the FRAIL scale aerobic and resistance components, and higher prevalence on the SARC-F strength and rising from a chair components.ConclusionThe SA-RGA app performed well in certain domains such as assessment for weight loss, falls, number of chronic illness and fatigue. Self-functional assessment can be improved further by removing ambiguity in wordings such as “some” or “a lot” and replacing it with functional difficulty scale. SA-RGA has the potential to be incorporated in the eHEALTH platforms worldwide for early identifications of older adults at risk and to reduce health inequalities, at the same time building community resilience in the era of Covid-19 pandemic.

Analysis Validity and Reliability of Self -Efficacy and Metacognitive Awareness Instrument Toward Mathematical Reasoning

This study was conducted to analyze the degree of validity and reliability of an instrument to measure self-efficacy and metacognitive awareness of university students toward mathematics reasoning. A total of 184 respondent of a public university in Malaysia has been chosen to answer the instrument. Findings from Exploratory Factor Analysis (EFA) support three dimensions of self-efficacy and six dimensions of metacognitive awareness of students toward mathematics reasoning that has been conceptualized. The overall internal consistency reliability of Cronbach Alpha coefficients was above 0.9. Based on the analysis performed, it can be concluded that developed instrument has sufficient evidence of validity and reliability to measure self-efficacy and metacognitive awareness of university students toward mathematics reasoning.

Multidimensional Apathy: The Utility of the Dimensional Apathy Scale in Huntington's Disease.

Apathy is a disorder of motivation common to Huntington's disease (HD). Recent conceptual frameworks suggest that apathy is not unitary but consists of discrete subtypes ("dimensions"). Which of the proposed dimensions are preferentially affected in HD, and how these dimensions evolve with disease progression is unknown. The Dimensional Apathy Scale (DAS) separates apathy into Executive, Initiation and Emotional subscales. Using the DAS, we aimed to: 1) Determine the apathy subtypes prevalent in HD; 2) Compare the DAS against a unitary measure of apathy (Apathy Evaluation Scale, AES); 3) Assess the reliability of self- and observer-ratings; and 4) Determine the relationship between the DAS, and disease burden, total functional capacity (TFC) and the AES. Fifty pre-manifest, 51 manifest-HD, 87 controls, and 50 HD-observers completed the DAS, AES, and TFC. Manifest-HD participants had the highest levels of apathy across all dimensions (30.4% on Executive subscale, 34.8% on Initiation subscale, and 15.2% on Emotional subscale), relative to pre-manifest and control participants. Self- and observer-ratings on the DAS did not differ. Hierarchical regressions across the entire gene-expanded sample showed that scores on the Initiation subscale correlated with AES scores; higher Executive subscale scores were related to higher disease burden; and Emotional subscale scores with lower total functional capacity. In this first study of the DAS in HD, manifest-HD participants were more apathetic than pre-manifest and control participants across all apathy subtypes. The DAS may be a useful tool for measuring different aspects of apathy in people with HD.

The Reliability of Self- and Peer Assessment and Students’ Perceptions toward Peer and Teacher Assessment

The Reliability of Self- and Peer Assessment and Students’ Perceptions toward Peer and Teacher Assessment

Reliability of Self Reported Sexual Behaviour History

Abstract 66 Sexual behaviour is an important risk factor for HPV associated cancers, which include nearly all cervical cancers, most anal cancers, and many oropharyngeal, vaginal, vulvar and penile cancers. However, in studies assessing risk of sexual behaviour and disease in low and middle income countries, there are often questions about the validity of self-reported sexual behaviour. In this study, we evaluate the reliability of self-reported sexual history among participants in a cervical cancer and HPV study in Nigeria. We studied 720 participants in a prospective cohort. We collected general sexuality and specific sexual practices information at study entry and administered the same questions at follow up after a mean period of 8.6 months. To assess reliability, we used the root mean squared approach to calculate within-person coefficient of variation(CVw) and calculated the intra-class correlation coefficient (ICC) using a two way, mixed effects model (continuous variables) and κ statistics (discrete variables). Of the 720 participants, 48.1% were HIV+, 49.2% were HIV- and 2.8% were unaware of their status. Agreement was higher for HIV- women than HIV+ women. Agreement for ever engaged in oral sex was moderate for HIV- women (κ = 0.56, 95%CI = 0.49 – 0.70) and fair for HIV+ women (κ = 0.37, 95%CI = 0.24 – 0.54). Similarly, agreement for ever engaging in anal sex was good among HIV- women (κ = 0.61, 95%CI = 0.10 – 0.83) and poor among HIV+ women (κ = 0.19, 95%CI = 0.10 – 0.60). Overall, the within person variability for age at sexual debut for vaginal sex (CVw =10.7, 95%CI = 10.6 – 10.7) and oral sex (CVw= 11.5, 95%CI = 11.5 – 11.6) was low. In contrast, the variability was much higher for lifetime number of partners for vaginal sex (CVw =35.2, 95% CI = 35.1 – 35.3) and oral sex (CVw = 34.0, 95%CI = 34.0– 34.1). We found report of sexual behaviour was more reliable among HIV- women than HIV+ women, and self-report of ever engaged in a sexual practice and age at initiation were more reliable than reports of frequency or number of partners. AUTHORS' DISCLOSURES OF POTENTIAL CONFLICTS OF INTEREST: No COIs from the authors.

The Dysexecutive Questionnaire Revised (DEX-R): An extended measure of everyday dysexecutive problems after acquired brain injury

ABSTRACTThe Dysexecutive Questionnaire (DEX) is a tool for measuring everyday problems experienced with the dysexecutive syndrome. This study investigated the psychometric properties of a revised version of the measure (DEX-R), a comprehensive tool, grounded in current theoretical conceptualisations of frontal lobe function and dysexecutive problems. The aim was to improve measurement of dysexecutive problems following acquired brain injury (ABI). Responses to the DEX-R were collected from 136 men and women who had experienced an ABI (the majority of whom had experienced a stroke or subarachnoid haemorrhage) and where possible, one of their carers or family members (n = 71), who acted as an informant. Rasch analysis techniques were employed to explore the psychometric properties of four newly developed, theoretically distinct subscales based on Stuss model of frontal lobe function and to evaluate the comparative validity and reliability of self and informant ratings of these four subscales. The newly developed subscales were well targeted to the range of dysexecutive problems reported by the current sample and each displayed a good level of internal validity. Both self- and independent-ratings were found to be performing reliably as outcome measures for at least a group-level. This new version of the tool could help guide selection of interventions for different types of dysexecutive problems and provide accurate measurement in neurorehabilitation services.

Reliability of Self and Peer Assessment of Group Work in Higher Education

Self and Peer Assessment (SPA) is commonly used by higher educational institutions to differentiate marks in group work based assessments. The paper demonstrates that the structure of SPA resembles that of a strategic form game, and the truthful reporting of self and peer contributions is not a dominant strategy in SPA. However, the paper through analyzing data of a case study, shows that, students may not report valuations as per the dominant strategies of the game. The result indicates the possibility of other factors such as reciprocity, altruism, guilt aversion and trust influencing SPA of the students. As these factors are not controlled by the designer (the assessor) of SPA, the statistics of SPA can not be treated as reliable indicators of the contribution of students being assessed.

Accuracy of self and informant reports of symptom severity and insight in Hoarding Disorder

BackgroundPrevious literature on Hoarding Disorder (HD) has largely recruited individuals with self-identified hoarding difficulties or informant-ratings of individuals who are not seeking help. Little is known about the reliability of self- and informant-ratings of hoarding severity and insight, and whether individuals who self-identify with HD differ from those who do not. MethodTwenty-four pairs of individuals meeting criteria for HD and their relatives took part in the study, plus 40 relatives of individuals meeting likely criteria for HD who did not agree to participate. All participants completed a clinician-administered diagnostic interview for HD and online questionnaires assessing hoarding severity, squalor and insight. ResultsGood correspondence was found between self- and informant-ratings of hoarding severity, although informants gave significantly higher squalor ratings. Relative to clinician-ratings, informants under-estimated the insight of HD individuals. Higher hoarding severity and lower insight informant-ratings were made for individuals with HD who did not agree to participate, compared to those who did. ConclusionsA multi-informant approach guided by expert clinicians is desirable for the assessment of HD, particularly in low-insight individuals. When individuals do not seek help for HD, family members may benefit from education and support to help them understand how best to assist their relatives.

Reliability of self, parental, and researcher measurements of head circumference.

BackgroundThe measurement of head circumference (HC) is widely used in clinical and research settings as a proxy of neural growth. Although it could aid data collection, no studies have explored either the reliability of adult self-measurements or parental measurements of young children. This study therefore aimed to examine whether adult self and parental measurement of HC constitute reliable data.FindingsA total of 57 adults (32 male) were asked to measure their HC twice following written instructions (adult self-measurement). These measures were compared to those of a researcher independently measuring the same participant’s HC twice. Additionally, mothers of 25 children (17 male) were also asked to measure their child’s HC (parental measure), and again this was compared to researcher measurements of the child’s HC. The intraclass correlation coefficient between adult self- and researcher measurement was 0.84 and between parent and researcher measurement was 0.99. The technical error of measurement was also acceptable, within the range of a skilled anthropometrist.ConclusionsThe high degree of agreement between researcher and adult self-measurement/parental measurement of HC demonstrates that these different assessors produce similarly reliable and reproducible data. This suggests adult self- and parental measurements can reliably be used for data collection to enable valid large-scale developmental and clinical studies of HC.

A framework for explaining reliance on decision aids

This study presents a framework for understanding task and psychological factors affecting reliance on advice from decision aids. The framework describes how informational asymmetries in combination with rational, motivational and heuristic factors explain human reliance behavior. To test hypotheses derived from the framework, 79 participants performed an uncertain pattern learning and prediction task. They received advice from a decision aid either before or after they expressed their own prediction, and received feedback about performance. When their prediction conflicted with that of the decision aid, participants had to choose to rely on their own prediction or on that of the decision aid. We measured reliance behavior, perceived and actual reliability of self and decision aid, responsibility felt for task outcomes, understandability of one's own reasoning and of the decision aid, and attribution of errors. We found evidence that (1) reliance decisions are based on relative trust, but only when advice is presented after people have formed their own prediction; (2) when people rely as much on themselves as on the decision aid, they still perceive the decision aid to be more reliable than themselves; (3) the less people perceive the decision aid's reasoning to be cognitively available and understandable, the less people rely on the decision aid; (4) the more people feel responsible for the task outcome, the more they rely on the decision aid; (5) when feedback about performance is provided, people underestimate both one's own reliability and that of the decision aid; (6) underestimation of the reliability of the decision aid is more prevalent and more persistent than underestimation of one's own reliability; and (7) unreliability of the decision aid is less attributed to temporary and uncontrollable (but not external) causes than one's own unreliability. These seven findings are potentially applicable for the improved design of decision aids and training procedures.

Self-collected vaginal swabs for the quantitative real-time polymerase chain reaction assay of Atopobium vaginae and Gardnerella vaginalis and the diagnosis of bacterial vaginosis

The aim of this study was to assess the feasibility of using self-collected vaginal specimens for the quantitative real-time polymerase chain reaction (qPCR) assays of bacterial vaginosis (BV)-associated bacteria versus practitioner-collected swabs. A cross-sectional study included 190 pregnant women enrolled before 20weeks' gestation from September 2008 to November 2009. Self- and practitioner-collected swabs were taken during the same prenatal visit for each woman, qPCR assays performed for each, and the results compared. The quantification of the human albumin gene was used as an internal control to ensure sampling quality and accurate comparisons. The level of agreement of the qPCR assays for each microorganism was calculated with the Spearman product moment correlation coefficient and the kappa statistic. In all, 370 vaginal samples (185 self- and 185 practitioner-collected swabs) had a narrow range of values for the number of albumin gene copies and a significant correlation coefficient (Spearman's rho = 0.532; p < 0.001). The agreement between both sampling methods was excellent (Spearman's rho was 0.748 for Atopobium vaginae, 0.918 for Lactobacillus species, 0.940 for Gardnerella vaginalis; p < 0.001), especially for high concentrations of A. vaginae (≥10(8) copies/mL; kappa value = 0.973; p < 0.001) and G. vaginalis (≥10(9) copies/mL; kappa value = 0.903; p < 0.001). This study demonstrates the validity and reliability of self- versus practitioner-collected swabs for the molecular quantification of Lactobacillus species, G. vaginalis, and A. vaginae.

A systematic review of the validity and reliability of sedentary behaviour measures used with children and adolescents

The aim of this review was to evaluate the reliability and validity of methods used to assess the multiple components of sedentary behaviour (i.e. screen time, sitting, not moving and existing at low energy expenditure) in children and adolescents. Twenty-six studies met our inclusion criteria and were reviewed. Thirteen studies reported the reliability of self- and proxy-report measures of sedentary behaviour and seven of these were found to have acceptable test-retest reliability. Evidence for the criterion validity of self- and proxy-report measures was examined in three studies with mixed results. Seven studies examined the reliability and/or validity of direct observation and the findings were generally positive. Five studies demonstrated the utility of accelerometers to accurately classify sedentary behaviour. Self-report measures provide reliable estimates of screen time, yet their validity remains largely untested. While accelerometers can accurately classify participants' behaviour as sedentary, they do not provide information about type of sedentary behaviour or context. Studies utilizing measures of sedentary behaviour need to more adequately report on the validity and reliability of the measures used. We recommend the use of objective measures of sedentary behaviour such as accelerometers, in conjunction with subjective measures (e.g. self-report), to assess type and context of behaviour.

Reliance on self-reporting underestimates pregnancy smoking rates in Scotland, with more than 2400 pregnant smokers estimated to be missed annually

Commentary on: D Shipton, DM Tappin, T Vadiveloo, et al.. Reliability of self reported smoking status by pregnant women for estimating smoking prevalence: a retrospective, cross sectional study. BMJ2009;339:b4347.

Reliability of self reported smoking status by pregnant women for estimating smoking prevalence: a retrospective, cross sectional study

Objective To determine what impact reliance on self reported smoking status during pregnancy has on both the accuracy of smoking prevalence figures and access to smoking cessation services for pregnant...

Assessing the reliability of self‐ and peer rating in student group work

Peer and self‐ratings have been strongly recommended as the means to adjust individual contributions to group work. To evaluate the quality of student ratings, previous research has primarily explored the validity of these ratings, as indicated by the degree of agreement between student and teacher ratings. This research describes a Generalizability Theory framework to evaluate the reliability of student ratings in terms of the degree of consistency among students themselves, as well as group and rater effects. Ratings from two group projects are analyzed to illustrate how this method can be applied. The reliability of student ratings differs for the two group projects considered in this research. While a strong group effect is present in both projects, the rater effect is different. Implications of this research for classroom assessment practice are discussed.

Commentary on Fok MSM &amp; Tsang WYW (2005) Development of an instrument measuring Chinese adolescent beliefs and attitudes towards substance use. Journal of Clinical Nursing 14, 986–994

Commentary on Fok MSM &amp; Tsang WYW (2005) Development of an instrument measuring Chinese adolescent beliefs and attitudes towards substance use. <i>Journal of Clinical Nursing</i> 14, 986–994

Reliability of self reported form of female genital mutilation and WHO classification: cross sectional study

Objective To assess the reliability of self reported form of female genital mutilation (FGM) and to compare the extent of cutting verified by clinical examination with the corresponding World Health...