Agreement For Total Score Research Articles

Revolutionizing Neonatal Care: A Comprehensive Assessment of Neuromotor Development in At-Risk Infants Using the Novel Neonatal Infant Motor Assessment Scale (NIMAS) Test Battery.

A total of 68 infants (28-41 Gestational weeks) hospitalised in the Neonatal Intensive Care Unit were included in the study. The NIMAS is a scale consisting of Automatic Motor Area, Functional Motor Area and sociodemographic form. The Dubowitz Neurological Examination and the Amiel-Tison Neurological Assessment Tests were also applied to evaluate the construct validity of the test. The mean gestational age at birth was 34.62 ± 3.07 weeks and birth weight was 2305.66 ± 738.95. Fifty-one (75%) of the babies were premature and 17 (25%) were term babies. The KMO value to test the adequacy of the distribution for factor analysis was found to be at a very good level. Barlett's test result was 2198.389 (p < 0.05). The amount of variance obtained as 44.76% in the study was at a sufficient level. The factor loads of the questions in the automatic motor domain dimension varied between 0.523 and 0.694 and the factor loads of the questions in the functional motor domain dimension varied between 0.619 and 0.772. Since Cronbach's alpha was above 0.70, the reliability was adequate. Inter-rater scale agreement in the automatic motor domain was 81.1%; scale agreement in the functional motor domFain was 92.9%; and the NIMAS total score agreement was 93.4%. These agreements were statistically significant (p < 0.05). Total correlation above 0.20 indicates that the item is important for the question. According to the results obtained, total correlation values were between 0.258 and 0.720. The NIMAS is the first test battery to assess the "Functional Motor Area" and this questionnaire, based on the results of the analyses, is a valid, reliable and clinically usable measurement tool for the infant at-risk at the neonatal period.

Trust the “Process”? When Fundamental Motor Skill Scores are Reliably Unreliable

ABSTRACT The typical process for assessing inter-rater reliability is facilitated by training raters within a research team. Lacking is an understanding if inter-rater reliability scores between research teams demonstrate adequate reliability. This study examined inter-rater reliability between 16 researchers who assessed fundamental motor skills using the Test of Gross Motor Development-3rd edition. Total score agreement (ICC = 0.363) and locomotor subscale agreement (ICC = 0.383) were “very poor,” while ball skills subscale agreement (ICC = 0.478) was “poor.” Consistencies of total (ICC = 0.757), locomotor (ICC = 0.730), and ball skills (ICC = 0.746) scores were “fair.” Component percentage agreement ranged from 40.5% to 96.2%. These data suggest that there are significant differences in how different research groups evaluate fundamental motor skills based on the subjective nature of scoring. Consistency and agreement among users need to be addressed in motor development research to allow for direct comparisons across studies that use process-oriented measures.

Validation of the 14-item mediterranean diet adherence screener

The Mediterranean diet (MedDiet) is suggested as a healthy dietary pattern. 14-point Mediterranean Diet Adherence Screener (MEDAS) questionnaire is a valid and rapid tool to estimate the adherence to the Mediterranean diet. The aim of this study was to assess the validity of the 14-point Mediterranean Diet Adherence Screener in Turkish population. A total of 188 people (%58 females) participated in this study (31.7±10.97 years). Turkish version of the MEDAS questionnaire was applied with 3-day food record, and mean total Mediterranean Diet (MedDiet) score and each of the MedDiet component scores was calculated from both 3-day food records and MEDAS tool. Intra-class correlation coefficient (ICC) was used to evaluate the total score agreement between the two dietary assessment methods, and each of the MedDiet components was estimated using Cohen's kappa. This project was a cross-sectional study. There was good correlation between the food record total MEdDiet score and MEDAS-derived MedDiet score (r=0.750, p<0.001; ICC=0.749, 95% CI 0.679-0.806, p<0.001). Highest concordance was observed for olive oil for cooking (К=0.763), sugar sweetened beverages (К=0.666), sweets, pastries (К=0.753), and sofrito (К=0.796) while the lowest was for fish and seafood (К=0.196). Re-test analysis showed a similar mean total MedDiet score for both administrations of MEDAS. The MEDAS is a valid and reliable tool to assess adherence to the Mediterranean diet in Turkish population.

Prediction of Progression Along the Transition Points within the Continuum of Cognitive Impairment from Subjective Cognitive Complaints to Dementia Using Dyadic Patterns of Subjective Reporting

AbstractBackgroundThe validity of Subjective Cognitive Complaints (SCCs) from dyadic patterns to predict progression to dementia is not yet clear. Some studies suggest that the validity of informant report in predicting dementia increases as cognitive function and awareness of symptoms decline. Our aim was to compare validity of informant and participant reports, and its agreement, to predict progression to MCI and conversion to dementia.MethodA total of 226 participants from the CompAS study were longitudinally assessed (intervals 18–24 months). The sample consisted of SCD (198) and MCI (28) participants. SCCs from participants and informants were assessed at baseline, 1st and 2nd follow‐ups using the QAM questionnaire. Informant‐participant total score agreement (disagreement, over‐ and under‐estimation, were identically considered) were calculated. Logistic regressions were separately performed to distinguish SCD stables and participants progressing either from SCD to MCI/dementia or from MCI to dementia using SCCs reports from participants, informants and agreement as predictive variables.ResultsInformant report at baseline significantly predicted conversion to dementia from baseline to the 3rd follow‐up (β = .173; SE = .048; p&lt;.001; OR = 1.189, CI = 1.082‐1.306), similarly to that observed for informant reports at 1st follow‐up to predict conversion from 1st to the 3rd follow‐up (β = .225; SE = .050; p = .001; OR = 1.252; CI = 1.135‐1.381), and at 2nd follow‐up to predict conversion from 2nd to the 3rd follow‐up (β = .271; SE = .083; p&lt;.001; OR = 1.313; CI = 1.110–1.552) (see Table 1).Informant report at baseline also successfully predicted the progression to MCI from baseline to the 3rd follow‐up (β = .139; SE = .057; p = .017; OR = 1.49; CI = 1.025‐1.288), similarly to that observed for informant reports at 1st (β = .124; SE = .056; p = .026; OR = 1.132; CI = 1.015‐1.264), and the 2nd follow‐ups (β = .195; SE = .073; p = .008; OR = 1.216; CI = 1.053‐1.404) (see Table 2).Conversion to dementia (β = .113; SE = .048; p = .018; OR = 1.119; CI = 1.020‐1.229) and progression to MCI (β = .138; SE = .054; p = .011; OR = 1.148; CI = 1.032‐1.277) using Self‐report were only significantly predicted using 1st follow‐up reports.Agreement did not significantly predict the progression to MCI or dementia at any of measurement points.ConclusionsInformant report successfully predicted progression and conversion at any transition point. Self‐reports were only predictive at 1st follow‐up. Agreement did not significantly predict progression and conversion.

Agreement between older adult patient and caregiver proxy symptom reports

BackgroundProxy report is essential for patients unable to complete patient-reported outcome (PRO) measures themselves and potentially beneficial when the caregiver perspective can complement patient report. In this study, we examine agreement between self-report by older adults and proxy report by their caregivers when completing PROs for pain, anxiety, depression, and other symptoms/impairments.MethodsFour PROs were administered by telephone to older adults and their caregivers followed by re-administration within 24 h in a random subgroup. The PROs included the PHQ-9 depression, GAD-7 anxiety, PEG pain, and SymTrak multi-dimensional symptom and functional status scales.ResultsThe sample consisted of 576 older adult and caregiver participants (188 patient-caregiver dyads, 200 patients without identified caregiver). The four measures had good internal (Cronbach’s alpha, 0.76 to 0.92) and test–retest (ICC, 0.63 to 0.92) reliability whether completed by patients or caregivers. Total score and item-level means were relatively similar for both patient and caregiver reports. Agreement for total score as measured by intraclass correlation coefficient (ICC) was better for SymTrak-23 (0.48) and pain (0.58) than for anxiety (0.28) and depression (0.25). Multinomial modeling showed higher (worse) patient-reported scale scores were associated with caregiver underreporting, whereas higher caregiver task difficulty was associated with overreporting.ConclusionWhen averaged over individuals at the group level, proxy reports of PRO scores by caregivers tend to approximate patient reports. For individual patients, proxy report should be interpreted more cautiously for psychological symptoms as well as when patient-reported symptoms are more severe, or caregiver task difficulty is high.

Pediatric Tracheostomy Care Simulation: Real-Life Scenarios in a Safe Learning Environment.

Pediatric patients require tracheostomy tube placement as a last resort for critical airway management. Around-the-clock care is needed at discharge because of the high risk of morbidity and mortality associated with a tracheostomy. The potential for catastrophic sequalae can create a high stress home environment. A simulation program that used a high-fidelity manikin was implemented to reduce complications, morbidity and mortality, and improve skills for real-life medical scenarios. A tracheostomy care simulation program was implemented at a large tertiary care children's hospital from October 2019 to October 2020. Caregivers participated in a pre-post program survey and rated 9 statements on a 5-point scale with regard to knowledge, confidence, and comfort level of taking care of their child at home. Emergency scenarios included accidental tracheostomy tube dislodgement, tracheostomy tube plugging, cardiac arrest, and ventilator failure. Classes were recorded for objective start-to-finish scenario time stamps and prompt rates. A medical chart review was performed 90 d after discharge. Eighteen caregivers for 10 children participated. For the 10 children, there was a 9.1% increase in the average total score agreement from pre to post survey, with scores going from "agree" to "strongly agree" (P = .001). Each subset of questions had a significant increase in scores after participation: knowledge, P = .002; confidence, P = .006; and comfort, P = .01. The caregivers required an average 20% prompt rate for the next step in the scenario. Children were 70% female, 80% white, and 60% had public insurance and had their tracheostomy tube placed at a median age of 4 months (range, 0 months to 24 years). Three children (n = 3/9 [33.3%]) were readmitted for tracheitis within 90 d after being discharged to home. Caregiver knowledge, confidence, and comfort levels were increased after participation. Pediatric patients with a tracheostomy are medically fragile, therefore, it is important for caregivers to be aware of and prepared for common tracheostomy emergencies and to "experience" emergency situations firsthand.

Validation of the Brazilian Portuguese version of the Rapid Eye Movement Sleep Behavior Disorder Screening Questionnaire (RBDSQ-BR).

A diagnosis of rapid eye movement sleep behavior disorder (RBD) currently requires confirmation with polysomnography (PSG). However, PSG may not be sufficiently available. In these situations, a clinical diagnostic measure might be useful. To validate the Brazilian Portuguese version of RBD screening questionnaire (RBDSQ) for patients with Parkinson's disease (PD). Using detailed clinical interviews and PSG analysis (diagnostic gold standard), a convenience sample of 69 subjects was divided into the following subgroups: patients with PD and RBD (PD+RBD; n=50) and patients with PD alone (PD-RBD; n=19). RBDSQ-BR showed adequate internal consistency (Cronbach's α=0.809) and, except for item 8, adequate item-test correlation. The retest performed in a second sample (n=13, consecutive) showed high agreement for total score (intraclass correlation coefficient, ICC=0.863) and acceptable agreement for items 2, 3, 6.2, 6.3, 7, and 8 (K>0.60). The receiver operating characteristic (ROC) curve analysis had an area under the curve (AUC) of 0.728. A cut-off score of 4 enabled the correct diagnosis of 76.8% subjects and provided the best balance between sensitivity (84%) and specificity (57.9%), with a 2.0 likelihood ratio of a positive result (LR+) and a 0.3 likelihood ratio of a negative result (LR-). Items 2 and 6.2 had 84.2% specificity and 3.2 LR+. Combined items 1+2+6.2, 2+6.1, and 6.1+6.2 increased the specificity to 94.7%, with LR+ ranging from 6.1 to 7.6. RBDSQ-BR is a reliable instrument, which may be useful for RBD diagnosis of Brazilian patients with PD. The instrument is also valid and may help in a better selection of cases for a more detailed clinical evaluation or even PSG analysis.

Development and reliability of the AOSpine CROST (Clinician Reported Outcome Spine Trauma): a tool to evaluate and predict outcomes from clinician\u2019s perspective

PurposeTo report on the development of AOSpine CROST (Clinician Reported Outcome Spine Trauma) and results of an initial reliability study.MethodsThe AOSpine CROST was developed using an iterative approach of multiple cycles of development, review, and revision including an expert clinician panel. Subsequently, a reliability study was performed among an expert panel who were provided with 20 spine trauma cases, administered twice with 4-week interval. The results of the developmental process were analyzed using descriptive statistics, the reliability per parameter using Kappa statistics, inter-rater rater agreement using intraclass correlation coefficient (ICC), and internal consistency using Cronbach’s α.ResultsThe AOSpine CROST was developed and consisted of 10 parameters, 2 of which are only applicable for surgically treated patents (‘Wound healing’ and ‘Implants’). A dichotomous scoring system (‘yes’ or ‘no’ response) was incorporated to express expected problems for the short term and long term. In the reliability study, 16 (84.2%) participated in the first round and 14 (73.7%) in the second. Intra-rater reliability was fair to good for both time points (κ = 0.40–0.80 and κ = 0.31–0.67). Results of inter-rater reliability were lower (κ = 0.18–0.60 and κ = 0.16–0.46). Inter-rater agreement for total scores showed moderate results (ICC = 0.52–0.60), and the internal consistency was acceptable (α = 0.76–0.82).ConclusionsThe AOSpine CROST, an outcome tool for the surgeons, was developed using an iterative process. An initial reliability analysis showed fair to moderate results and acceptable internal consistency. Further clinical validation studies will be performed to further validate the tool.

Ultrasound Evaluation of Primary Alveolar Grafting in Cleft Lip/Palate Treatment: Development of a Novel Sonographic Grading System.

To explore ultrasonographic evaluation of primary alveolar repair in cleft lip/palate patients and develop a grading system to assess outcomes of graft success. Sixteen patients with an average age of 2 years 1 month had sonograms performed at various points in their treatment to determine the feasibility of ultrasound in visualizing alveolar bone defects and changes over time postgrafting. A total of 23 sonograms were performed: 21 at an average of 12 months postoperatively and 2 at an average of 1 month preoperatively. A 10-point grading system was developed assessing three categories: locations of lateral bone bridging across the cleft, quantification of residual defects with air or fluid channels, and locations of calcification. Three operators graded 10 sonograms to assess interobserver reliability, and the scores were also validated against dental radiographs in patients old enough for radiographic imaging. Linear weighted kappa statistics revealed substantial interobserver agreement for total scores, with an average kappa value of .708. In limited patients with radiographs, a total score of 9/10 correlated with a Chelsea score of 6.5/8 and category A. Sonographic evaluation, coupled with this novel grading system, shows potential for early assessment of outcomes of graft success when evaluating new techniques of primary alveolar grafting.

Children's Quality of Life Based on the KIDSCREEN-27: Child Self-Report, Parent Ratings and Child-Parent Agreement in a Swedish Random Population Sample.

BackgroundThe KIDSCREEN-27 is a measure of child and adolescent quality of life (QoL), with excellent psychometric properties, available in child-report and parent-rating versions in 38 languages. This study provides child-reported and parent-rated norms for the KIDSCREEN-27 among Swedish 11–16 year-olds, as well as child-parent agreement. Sociodemographic correlates of self-reported wellbeing and parent-rated wellbeing were also measured.MethodsA random population sample consisting of 600 children aged 11–16, 100 per age group and one of their parents (N = 1200), were approached for response to self-reported and parent-rated versions of the KIDSCREEN-27. Parents were also asked about their education, employment status and their own QoL based on the 26-item WHOQOL-Bref. Based on the final sampling pool of 1158 persons, a 34.8% response rate of 403 individuals was obtained, including 175 child-parent pairs, 27 child singleton responders and 26 parent singletons. Gender and age differences for parent ratings and child-reported data were analyzed using t-tests and the Mann-Whitney U-test. Post-hoc Dunn tests were conducted for pairwise comparisons when the p-value for specific subscales was 0.05 or lower. Child-parent agreement was tested item-by-item, using the Prevalence- and Bias-Adjusted Kappa (PABAK) coefficient for ordinal data (PABAK-OS); dimensional and total score agreement was evaluated based on dichotomous cut-offs for lower well-being, using the PABAK and total, continuous scores were evaluated using Bland-Altman plots.ResultsCompared to European norms, Swedish children in this sample scored lower on Physical wellbeing (48.8 SE/49.94 EU) but higher on the other KIDSCREEN-27 dimensions: Psychological wellbeing (53.4/49.77), Parent relations and autonomy (55.1/49.99), Social Support and peers (54.1/49.94) and School (55.8/50.01). Older children self-reported lower wellbeing than younger children. No significant self-reported gender differences occurred and parent ratings showed no gender or age differences. Item-by-item child-parent agreement was slight for 14 items (51.9%), fair for 12 items (44.4%), and less than chance for one item (3.7%), but agreement on all dimensions as well as the total score was substantial according to the PABAK-OS. Visual interpretation of the Bland-Altman plot suggested that when children’s average wellbeing score was lower parents seemed to rate their children as having relatively higher total wellbeing, but as children’s average wellbeing score increased, parents tended to rate their children as having relatively lower total wellbeing. Children living with both parents had higher wellbeing than those who lived with only one parent.ConclusionsResults agreed with European findings that adolescent wellbeing decreases with age but contrasted with some prior Swedish research identifying better wellbeing for boys on all dimensions but Social support and peers. The study suggests the importance of considering children’s own reports and not only parental or other informant ratings. Future research should be conducted at regular intervals and encompass larger samples.

Inter-Rater Reliability and Intra-Rater Reliability of Assessing the 2-Minute Push-Up Test.

The purpose of this study was to assess inter-rater reliability and intra-rater reliability of the 2-minute, 90° push-up test as utilized in the Army Physical Fitness Test. Analysis of rater assessment reliability included both total score agreement and agreement across individual push-up repetitions. This study utilized 8 Raters who assessed 15 different videotaped push-up performances over 4 iterations separated by a minimum of 1 week. The 15 push-up participants were videotaped during the semiannual Army Physical Fitness Test. Each Rater randomly viewed the 15 push-up and verbally responded with a "yes" or "no" to each push-up repetition. The data generated were analyzed using the Pearson product-moment correlation as well as the kappa, modified kappa and the intra-class correlation coefficient (3,1). An attribute agreement analysis was conducted to determine the percent of inter-rater and intra-rater agreement across individual push-ups.The results indicated that Raters varied a great deal in assessing push-ups. Over the 4 trials of 15 participants, the overall scores of the Raters varied between 3.0 and 35.7 push-ups. Post hoc comparisons found that there was significant increase in the grand mean of push-ups from trials 1-3 to trial 4 (p < 0.05). Also, there was a significant difference among raters over the 4 trials (p < 0.05). Pearson correlation coefficients for inter-rater and intra-rater reliability identified inter-rater reliability coefficients were between 0.10 and 0.97. Intra-rater coefficients were between 0.48 and 0.99. Intra-rater agreement for individual push-up repetitions ranged from 41.8% to 84.8%. The results indicated that the raters failed to assess the same push-up repetition with the same score (below 70% agreement) as well as failed to agree when viewed between raters (29%). Interestingly, as previously mentioned, scores on trial 4 increased significantly which might have been caused by rater drift or that the Raters did not maintain the push-up standard over the trials. It does appear that the final push-up scores received by each participant was a close approximation of actual performance (within 65%) but when assessing physical performance for retention in the Army, a more reliable test might be considered.

Improving Students' Functional Modeling Skills: A Modeling Approach and a Scoring Rubric

An engineering design curriculum that introduces functional modeling methods is believed to enhance the ability to abstract complex systems, assist during the concept generation phase of design, and reduce design fixation. To that end, a variety of techniques for considering function during design have been proposed in the literature, yet there are a lack of validated approaches for teaching students to generate functional models and no reliable method for the assessment of functional models. This paper presents a study investigating students' ability to generate functional models during a homework assignment; the study includes three different treatment conditions: (1) students who receive only a lecture on functional modeling, (2) students who receive a lecture on functional modeling as well as a step-by-step example, and (3) students who receive a lecture, a step-by-step example, and an algorithmic approach with grammar rules. The experiment was conducted in a cornerstone, undergraduate engineering design course, and consequently, was the students' first exposure to functional modeling. To assess student generated functional models across all three conditions, an 18 question functional model scoring rubric was developed based on flow-based functional modeling standards. Use of the rubric to assess the student generated functional models resulted in high inter-rater agreement for total score. Results show that students receiving the step-by-step example perform as well as students receiving the step-by-step example and an algorithmic approach with grammar rules; both groups perform better than the lecture-only group.

Psychometric Evaluation of the Ostomy Complication Severity Index

The purpose of this study was to evaluate the psychometric properties of a new instrument to measure incidence and severity of ostomy complications early in the postoperative period. 71 participants were enrolled, most were men (52%), white (96%), and married or partnered (55%). The mean age of participants was 57 ± 15.09 years (mean ± SD). Fifty-two participants (84%) experienced at least 1 ostomy complication in the 60-day postoperative period. The research setting was 3 acute care settings within a large healthcare system in the Midwestern United States. We developed an evidence-based conceptual model to guide development and evaluation of a new instrument, the Pittman Ostomy Complication Severity Index (OCSI). The OCSI format includes Likert-like scale with 9 individual items scored 0 to 3 and a total score computed by summing the individual items. Higher scores indicate more severe ostomy complications. This study consisted of 2 phases: (1) an expert review, conducted to establish content validity; and (2) a prospective, longitudinal study design, to examine psychometric properties of the instrument. A convenience sample of 71 adult patients who underwent surgery to create a new fecal ostomy was recruited from 3 hospitals. Descriptive analyses, content validity indices, interrater reliability testing, and construct validity testing were employed. Common complications included leakage (60%), peristomal moisture-associated dermatitis (50%), stomal pain (42%), retraction (39%), and bleeding (32%). The OCSI demonstrated acceptable evidence of content validity index (CVI = 0.9) and interrater reliability for individual items (k = 0.71-1.0), as well as almost perfect agreement for total scores among raters (ICC = 0.991, P ≤ .001). Construct validity of the OCSI was supported by significant correlations among variables in the conceptual model (complications, risk factors, stoma care self-efficacy, and ostomy adjustment). OCSI demonstrated acceptable validity and reliability and can be used to assess incidence and severity of ostomy complications in the early postoperative period. We found the OCSI to be brief, easy-to-use, and clinically practical. It can be used to (a) identify priority areas for nursing intervention related to the ostomy, (b) determine appropriate interventions to prevent or treat complications, and (c) evaluate the effects of nursing interventions designed to improve outcomes for patients with ostomies.

Validation of the Italian version of Mini-ICF-APP, a short instrument for rating activity and participation restrictions in psychiatric disorders

Aims. The assessment of limitations in social capacities can be done with the Mini-ICF-APP, a rating scale built in reference to the International Classification of Functioning, Disability and Health (ICF). The aim of this study was to assess the reliability and the convergent validity of the Italian version of this scale. Methods. We recruited 120 consecutive patients diagnosed with schizophrenia, major depression, bipolar I disorder and anxiety disorders. Included measures were the Brief Psychiatric Rating Scale (BPRS), the Clinical Global Impression Scale (CGI-S), the Personal and Social Performance Scale (PSP) and the Social and Occupational Functioning Assessment Scale (SOFAS). Results. The median CGI-S and BPRS scores were 5 and 16.5. Mean Mini-ICF-APP total score was 18.1. Schizophrenics' Mini-ICF-APP score was higher, while that of anxious patients was lower than in the other diagnoses. Intra-class correlations (ICC) revealed a significant inter-rater agreement for total score (ICC 0.987) and for each item of the Mini-ICF-APP. The test-retest agreement was also highly significant (ICC 0.993). The total score of the Mini-ICF-APP obtained good negative correlations with PSP (r s=-0.767) and with SOFAS scores (r s=-0.790). The distribution items of the Mini-ICF-APP showed some skewness, indicating that self-care (item 12) and mobility (item 13) were amply preserved in most patients. The Mini-ICF-APP total score was significantly correlated with both CGI-S (r s=0.777) and BPRS (r s=0.729). Conclusions. As a short instrument, the Mini-ICF-APP scale seems to be well suited to everyday psychiatric practice as a means of monitoring changes in psychosocial functioning, in particular in schizophrenic patients.

Technical note on the validation of a semi-automated image analysis software application for estrogen and progesterone receptor detection in breast cancer

BackgroundThe immunohistochemical detection of estrogen (ER) and progesterone (PR) receptors in breast cancer is routinely used for prognostic and predictive testing. Whole slide digitalization supported by dedicated software tools allows quantization of the image objects (e.g. cell membrane, nuclei) and an unbiased analysis of immunostaining results. Validation studies of image analysis applications for the detection of ER and PR in breast cancer specimens provided strong concordance between the pathologist's manual assessment of slides and scoring performed using different software applications.MethodsThe effectiveness of two connected semi-automated image analysis software (NuclearQuant v. 1.13 application for Pannoramic™ Viewer v. 1.14) for determination of ER and PR status in formalin-fixed paraffin embedded breast cancer specimens immunostained with the automated Leica Bond Max system was studied. First the detection algorithm was calibrated to the scores provided an independent assessors (pathologist), using selected areas from 38 small digital slides (created from 16 cases) containing a mean number of 195 cells. Each cell was manually marked and scored according to the Allred-system combining frequency and intensity scores. The performance of the calibrated algorithm was tested on 16 cases (14 invasive ductal carcinoma, 2 invasive lobular carcinoma) against the pathologist's manual scoring of digital slides.ResultsThe detection was calibrated to 87 percent object detection agreement and almost perfect Total Score agreement (Cohen's kappa 0.859, quadratic weighted kappa 0.986) from slight or moderate agreement at the start of the study, using the un-calibrated algorithm. The performance of the application was tested against the pathologist's manual scoring of digital slides on 53 regions of interest of 16 ER and PR slides covering all positivity ranges, and the quadratic weighted kappa provided almost perfect agreement (κ = 0.981) among the two scoring schemes.ConclusionsNuclearQuant v. 1.13 application for Pannoramic™ Viewer v. 1.14 software application proved to be a reliable image analysis tool for pathologists testing ER and PR status in breast cancer.

The reliability of pre-transplant donor renal biopsies (PTDB) in predicting the kidney state. A comparative single-centre study on 154 untransplanted kidneys

Pre-transplant donor biopsy (PTDB) is a common practice in marginal donors, taking for granted that it represents the whole kidney state, but its reliability has not yet been thoroughly investigated. This prompted us to carry out a comparative study on a needle biopsy group (NBG) and a wedge biopsy group (WBG) and their corresponding untransplanted kidneys. One hundred and fifty-four biopsies and matched kidneys were scored for four morphologic indexes, i.e. tubular atrophy, interstitial fibrosis, vascular damage and global glomerulosclerosis. Categorical indexes were statistically evaluated for concordance with the k index, and the percentage of sclerotic glomeruli with correlation and linear regression analysis. Agreement between biopsies and kidneys was similar in both NBG and WBG with high scores for vascular damage (k 0.74 and 0.75) and intermediate ones for tubular atrophy (k 0.54 and 0.50). Agreement as to fibrosis and glomerular sclerosis was intermediate in the WBG (k 0.56 and 0.55) and poor in the NBG (k 0. 34 and 0.18). Vascular damage was underscored and glomerulosclerosis overscored in both groups, whereas interstitial fibrosis was underscored in the NBG and overscored in WBG. The agreement for the total score, i.e. the sum of the single indexes, was high in the NBG (k 0.73) and intermediate in WBG (k 0.57). Agreement for glomerulosclerosis and total score rose consistently in both groups along with the increasing number of biopsy glomeruli. There was an agreement as to biopsy and kidney evaluation for fitness for transplantation in 85% of NBG and 81% of WBG. PTDB supplies reliable data on the actual kidney state, with better results for needle biopsy. Although the biopsy size plays a role, samples with over 10 glomeruli suffice for clinical purposes. Vascular damage is the most faithful single parameter, whereas global glomerulosclerosis estimation requires some caution.

The International Standards for Neurological Classification of Spinal Cord Injury: Intra-Rater Agreement of Total Motor and Sensory Scores in the Pediatric Population

Background: The International Standards for Neurological Classification of Spinal Cord Injury (ISCSCI) is the gold standard for evaluating and classifying the neurological consequence of spinal cord injury (SCI). Objective: To determine the within-rater agreement for total scores of light touch (LT), pin prick (PP), and total motor (TM) in children and youth.Design: Part of a larger cross-sectional study to determine the intra-rater reliability of the standards when applied to children and youth.Participants/Methods: A total of 187 subjects participated in 2 repeated examinations performed by the same rater. A total of 7 raters participated in this study. Intraclass correlations coefficients (ICCs), with 95% Cl were calculated to determine agreement between the 2 examinations for LT, PP, and TM.Results: With the exception of subjects younger than 6 years, agreement on repeated total PP, LT, and TM scores were good to excellent, as shown by ICC values of 0.92 or higher. Although agreement was high for the youngest age group for LT (ICC = 0.920), PP (ICC = 0.957), and TM (ICC = 0.971), all of the lower 95% Cl values fell well below 0.66, indicating poor precision. All subgroups had good to high agreement for total PP, LT, and TM scores, as indicated by ICC values of 0.87 and higher. There were lower 95% Cl (LCI) values for the 6- to 11-year-old group with incomplete paraplegia due to the low number of subjects in that subgroup (N = 4). The LCI values were poor for PP for the subgroups with 6- to 11-year-olds with incomplete tetraplegia (LCI = 0.675) and the 12- to 15-year-old group with incomplete paraplegia (LCI = 0.707) and for TM for 16- to 21-year-old group with complete paraplegia (LCI = 0.706).Conclusions: In children as young as 6 years, within-rater agreement on LT, PP, and TM exceeded recommended values for clinical measures. With the exception of 6- to 11-year-olds with incomplete injuries, type of injury and severity of injury were not factors in agreement. Although more work is needed to define the lower age limit in which the ISCSCI have utility, these data represent growing evidence supporting the use of the ISCSCI when evaluating the neurological consequence of SCI in children.

Further evidence for the agreement between patients with stroke and their proxies on the Frenchay Activities Index

To determine item, subscale and total score agreement on the Frenchay Activities Index (FAI) between stroke patients and proxies six months after discharge from rehabilitation. Prospective study design. Fifty patient-proxy pairs, interviewed separately, in the patient's residence. Modified FAI using 13 items. Individual FAI items, subscales and total score agreement as measured by weighted kappa and intraclass correlation coefficients (ICC). Excellent agreement was found for the total FAI (ICC 0.87, 95% confidence interval (CI) 0.78-0.93), and domestic (ICC 0.85, 95% CI 0.73-0.91) and outdoor (ICC 0.87, 95% CI 0.78-0.95) subscales, with moderate agreement found for the work/leisure subscale (ICC 0.63, 95% CI 0.34-0.78). For the individual FAI items, good, moderate, fair and poor agreement was found for five, three, four and one item, respectively. The best agreement was for objective items of preparing meals, washing-up, washing clothes, shopping and driving. The poorest agreement was for participation in hobbies, social outings and heavy housework. Scoring biases associated with patient or proxy demographic characteristics were found. Female proxies, and those who were spouses, scored patients lower on domestic activities; male patients, and those who were younger, scored themselves higher on outdoor activities and higher patient FIM scores were positively correlated with higher FAI scores. While total and subscale agreement on the FAI was high, individual item agreement varied. Proxy scores should be used with caution due to bias.