High Level Of Interobserver Agreement Research Articles

A Deep Learning Application of Capsule Endoscopic Gastric Structure Recognition Based on a Transformer Model.

Gastric structure recognition systems have become increasingly necessary for the accurate diagnosis of gastric lesions in capsule endoscopy. Deep learning, especially using transformer models, has shown great potential in the recognition of gastrointestinal (GI) images according to self-attention. This study aims to establish an identification model of capsule endoscopy gastric structures to improve the clinical applicability of deep learning to endoscopic image recognition. A total of 3343 wireless capsule endoscopy videos collected at Nanfang Hospital between 2011 and 2021 were used for unsupervised pretraining, while 2433 were for training and 118 were for validation. Fifteen upper GI structures were selected for quantifying the examination quality. We also conducted a comparison of the classification performance between the artificial intelligence model and endoscopists by the accuracy, sensitivity, specificity, and positive and negative predictive values. The transformer-based AI model reached a relatively high level of diagnostic accuracy in gastric structure recognition. Regarding the performance of identifying 15 upper GI structures, the AI model achieved a macroaverage accuracy of 99.6% (95% CI: 99.5-99.7), a macroaverage sensitivity of 96.4% (95% CI: 95.3-97.5), and a macroaverage specificity of 99.8% (95% CI: 99.7-99.9) and achieved a high level of interobserver agreement with endoscopists. The transformer-based AI model can accurately evaluate the gastric structure information of capsule endoscopy with the same performance as that of endoscopists, which will provide tremendous help for doctors in making a diagnosis from a large number of images and improve the efficiency of examination.

Prognostic role of magnetic resonance imaging of the abdomen with intravenous contrast and magnetic resonance cholangiopancreatography in primary sclerosing cholangitis.

To evaluate the usefulness of Anali scores, determined by magnetic resonance imaging, for predicting the prognosis of primary sclerosing cholangitis (PSC) and to analyze interobserver variability, as well as to assess the impact of periportal edema and heterogeneous signal intensity on diffusion-weighted imaging of the liver. This was a retrospective cohort study of 29 patients with PSC and baseline magnetic resonance imaging. Anali scores, without gadolinium (0-5 points) and with gadolinium (0-2 points), were calculated by two radiologists. Clinical end-points included liver transplantation, cirrhotic decompensation, and death. We calculated intraclass correlation coefficients (ICCs) for interobserver agreement on the Anali scores, performed Kaplan-Meier survival analysis comparing event-free survival among the score strata, and calculated the areas under receiver operating characteristic curves to determine sensitivity and specificity. Among the patients with a clinical event, the median Anali score was 4 (interquartile range [IQR], 2-5) without gadolinium and 2 (IQR, 1-2) with gadolinium, compared with 1 (IQR, 1.0-2.5) and 1 (IQR, 0.25-1.0), respectively, among those without a clinical event. The ICC was 0.79 (95% confidence interval: 0.57-0.91) for the Anali score with gadolinium and 0.99 (95% confidence interval: 0.98-0.99) for the Anali score without gadolinium. Periportal edema and heterogeneous signal intensity in the liver on diffusion-weighted imaging showed no statistical impact on clinical events (p = 0.65 and p = 0.5, respectively). Anali scores correlate with clinical events in PSC, with a high level of interobserver agreement.

Magnetic resonance imaging of the knee anteromedial quadrant

ObjectiveThis study aims to evaluate the possibility of characterizing an extra-articular thickening in the knee anteromedial quadrant in routine MRI scans.Materials and methodsFirstly, in a pilot study, for a better understanding of this extra-articular thickening trajectory in MRI, polytetrafluoroethylene (PTFE) tubes were attached to the ligament structure topography in two dissected pieces. Afterward, 100 knee MRI studies were randomly selected from our database, and 97 met the inclusion criteria. Two musculoskeletal radiologists interpreted the exams separately. Both had previously studied the ligament in the cadaveric knee MRI with the PTFE tube.ResultsThe intraobserver and interobserver agreement for the ligament identification was calculated using Cohen’s Kappa coefficient. The first radiologist identified the structure in 41 of the 97 scans (42.2%), and the second radiologist in 38 scans (39.2%). The interobserver agreement was substantial, with a Kappa of 0.68 and an agreement of 84.5%. The results suggest that this extra-articular thickening, recently called Anterior Oblique Ligament (AOL) in the literature, is a structure that can be frequently visualized on MRI scans with a high level of interobserver agreement in a relatively large number of exams.ConclusionTherefore, this study indicates that MRI is a promising method for evaluating this anteromedial thickening, and it may be used for future studies of the Anterior Oblique Ligament.

Reliability of whole mount radical prostatectomy histopathology as the ground truth for artificial intelligence assisted prostate imaging

The development of artificial intelligence–based imaging techniques for prostate cancer (PCa) detection and diagnosis requires a reliable ground truth, which is generally based on histopathology from radical prostatectomy specimens. This study proposes a comprehensive protocol for the annotation of prostatectomy pathology slides. To evaluate the reliability of the protocol, interobserver variability was assessed between five pathologists, who annotated ten radical prostatectomy specimens consisting of 74 whole mount pathology slides. Interobserver variability was assessed for both the localization and grading of PCa. The results indicate excellent overall agreement on the localization of PCa (Gleason pattern ≥ 3) and clinically significant PCa (Gleason pattern ≥ 4), with Dice similarity coefficients (DSC) of 0.91 and 0.88, respectively. On a per-slide level, agreement for primary and secondary Gleason pattern was almost perfect and substantial, with Fleiss Kappa of .819 (95% CI .659–.980) and .726 (95% CI .573–.878), respectively. Agreement on International Society of Urological Pathology Grade Group was evaluated for the index lesions and showed agreement in 70% of cases, with a mean DSC of 0.92 for all index lesions. These findings show that a standardized protocol for prostatectomy pathology annotation provides reliable data on PCa localization and grading, with relatively high levels of interobserver agreement. More complicated tissue characterization, such as the presence of cribriform growth and intraductal carcinoma, remains a source of interobserver variability and should be treated with care when used in ground truth datasets.

External validation of blue light imaging (BLI) criteria for the optical characterization of colorectal polyps by endoscopy experts.

Recently, the BLI Adenoma Serrated International Classification (BASIC) system was developed by European experts to differentiate colorectal polyps. Our aim was to validate the BASIC classification system among the US-based endoscopy experts. Participants utilized a web-based interactive learning system where the group was asked to characterize polyps using the BASIC criteria: polyp surface (presence of mucus, regular/irregular and [pseudo]depressed), pit appearance (featureless, round/non-round with/without dark spots; homogeneous/heterogeneous distribution with/without focal loss), and vessels (present/absent, lacy, peri-cryptal, irregular). The final testing consisted of reviewing BLI images/videos to determine whether the criteria accurately predicted the histology results. Confidence in adenoma identification (rated "1" to "5") and agreement in polyp (adenoma vs non-adenoma) identification and characterization per BASIC criteria were derived. Strength of interobserver agreement with kappa (k) value was reported for adenoma identification. Ten endoscopy experts from the United States identified conventional adenoma (vs non-adenoma) with 94.4% accuracy, 95.0% sensitivity, 93.8% specificity, 93.8% positive predictive value, and 94.9% negative predictive value using BASIC criteria. Overall strength of interobserver agreement was high: kappa 0.89 (0.82-0.96). Agreement for the individual criteria was as follows: surface mucus (93.8%), regularity (65.6%), type of pit (40.6%), pit visibility (66.9%), pit distribution (57%), vessel visibility (73%), and being lacy (46%) and peri-cryptal (61%). The confidence in diagnosis was rated at high ≥4 in 67% of the cases. A group of US-based endoscopy experts have validated a simple and easily reproducible BLI classification system to characterize colorectal polyps with >90% accuracy and a high level of interobserver agreement.

Clinical T category for lung cancer staging: A pragmatic approach for real-world practice.

BackgroundTo determine which components should be measured and which window settings are appropriate for computerized tomography (CT) size measurements of lung adenocarcinoma (ADC) and to explore interobserver agreement and accuracy according to the eighth edition of TNM staging.MethodsA total of 165 patients with surgically resected lung ADC earlier than stage 3A were included in this study. One radiologist and two pulmonologists independently measured the total and solid sizes of components of tumors on different window settings and assessed solidity. CT measurements were compared with pathologic size measurements.ResultsIn categorizing solidity, 25% of the cases showed discordant results among observers. Measuring the total size of a lung adenocarcinoma predicted pathologic invasive components to a degree similar to measuring the solid component. Lung windows were more accurate (intraclass correlation [ICC] = 0.65–0.81) than mediastinal windows (ICC = 0.20–0.72) at predicting pathologic invasive components, especially in a part‐solid nodule. Interobserver agreements for measurement of solid components were good with little significant difference (lung windows, ICC = 0.89; mediastinal windows, ICC = 0.91). A high level of interobserver agreement was seen between the radiologist and pulmonologists and between residents (from the division of pulmonology and critical care) versus a fellow (from the division of pulmonology and critical care) on different windows.ConclusionsA considerable percentage (25%) of discrepancies was encountered in categorizing the solidity of lesions, which may decrease the accuracy of measurements. Lung window settings may be superior to mediastinal windows for measuring lung ADCs, with comparable interobserver agreement and moderate accuracy for predicting pathologic invasive components.Key pointsSignificant findings of the study Lung window settings are better for evaluating part‐solid lung adenocarcinoma (ADC), with comparable interobserver agreement and moderate accuracy for predicting pathologic invasive components. The considerable percentage (25%) of discrepancies in categorizing solidity of the lesions may also have decreased the accuracy of measurements. What this study adds For accurate measurement and categorization of lung ADC, robust quantitative analysis is needed rather than a simple visual assessment.

Teacher-student -task -interactions in a motor skills programme for an adolescent boy with autism spectrum disorder: a systematic observation study (Interacción profesor-alumno-tarea en un programa de desarrollo de capacidades motrices en un adolescente con TEA: un estudio de observación sistemática)

This study illustrates the potential offered by observational methodology for analysing spontaneous behaviours and interactions by students with autism spectrum disorder (ASD). We present a case study in which we observed, analysed and interpreted how an adolescent boy with ASD interacted both verbally and non-verbally with his physical education teacher and with different gym- and pool-based tasks within a motor skills development programme. The data were annotated in the free software LINCE using an ad hoc observation instrument combining a field format and category systems. The quality of the data was confirmed by high levels of interobserver agreement (calculated quantitatively using Cohen’s kappa statistic). Two diachronic techniques at the forefront of observational methodology, lag sequential analysis (GSEQ) and polar coordinate analysis (HOISAN), were used to investigate activating and inhibitory relationships corresponding to desirable and undesirable verbal and non-verbal interactions between the boy and the different zones in the motor skills circuits and the teacher’s responses to these interactions.

P156 Interobserver variation of visual assessment vs. measuring ulcer size in Crohn’s disease using the RAPID9 Software in PillCam COLON2

Abstract Background Ulcer size is important when assessing mucosal healing in Crohn’s disease (CD) and commonly assessed with visual estimation. There is a new built-in measurement tool in the RAPID9 reader software used in colon capsule endoscopy (CCE). We aimed to assess the agreement between visually estimating ulcer size vs. using the estimation tool and the interobserver agreement for both methods independently using PillCam Colon studies in patients with Crohn’s disease. Methods 7 experts of PillCam readers were recruited to assess CCE in this study. 7 CCE recordings were thumbnailed for the presence of ulcers. A total of 43 ulcers were consecutively selected for this study. The readers were provided with an instruction manual which specified that they were to first visually estimate the ulcer and then subsequently measure the ulcer with the size estimation tool in RAPID9 software. Two measurements were taken, A – longest distance of the ulcer end to end, and B – longest distance that is perpendicular to A. Results were analysed using Kendall’s Coefficient of Concordance (Kendall’s W). Results When comparing visual assessment of ulcer size vs. using the estimation tool, both measurements A and B demonstrated statistically significant agreement (p of A = 0.000, p of B = 0.000; W of A=0.90, W of B=0.82). For measurement A, our results demonstrated higher interobserver agreement when assessing ulcer size using the estimation tool (W=0.84) as compared with visually assessing ulcer size (W=0.80). This contrasts with measurement B where there was higher interobserver agreement when visually assessing ulcer size (W=0.75) as compared with using the measurement tool (W=0.73). Nevertheless, there was no statistically significant variability amongst measurement A nor B (p = 0.000) in visual assessment and measurement tool. Conclusion The conventional visual estimation of ulcer size in CD using CCE was just as accurate as the measurement tool. Furthermore, consistency between readers was demonstrated with the high level of interobserver agreement for the measurement tool and visual estimation. This novel finding is reassuring given the decade of capsule studies done with older software, where a measurement tool was not available. Further study should be conducted to assess and consolidate the validity of the estimation tool in assessing ulceration and mucosal healing in CD with a larger number and variety of lesions studied.

The accuracy of 3T magnetic resonance cholangiopancreatography in suspected choledocholithiasis.

PurposeThe purpose of this study was to investigate interobserver agreement during magnetic resonance cholangio-pancreatography (MRCP) evaluation and the sensitivity and specificity of MRCP obtained with 3T scanners in cases of bile duct obstruction.Material and methodsA total of 37 patients who had MRCP and endoscopic retrograde cholangiography (ERCP) were included. Choledochal pathology was divided into two groups regarding the presence of stones as “there is stone or not”. MRCPs were performed with a 3-Tesla system using respiratory triggered HASTE technique in axial and coronal planes and with T2 SPACE sequence in the coronal plane. Sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV) were calculated separately for each observer. The average of both observers was calculated for comparison with other studies.ResultsThirty-seven patients were in the study population. Agreement between the observers was analysed, and Cohen’s κ value was evaluated as 0.84. For two observers, the sensitivity of MRCP was 93%, whereas the specificity was 75% for the first observer and 62% for the second.ConclusionsIn this study we found a high level of interobserver agreement in evaluating MRCP. MRCP has a high sensitivity in detecting choledocholithiasis.

Treatment of Food Selectivity in a Child with Avoidant/Restrictive Food Intake Disorder Through Parent Teleconsultation.

Avoidant/restrictive food intake disorder (ARFID) is a diagnosis for those who display impaired and distressing eating behaviors and symptoms. Behavioral feeding strategies have been shown to be effective at improving food variety and decrease problematic mealtime behaviors in children and adolescents. This study examined the use of teleconsultation for the implementation of a behavioral feeding intervention to increase food variety with a child with avoidant/restrictive food intake disorder. A series of changing criterion designs across foods and food groups was used. Results show that there was an increase in the frequency of bites of nonpreferred foods consumed following successive increases in the criteria. High levels of acceptability of the intervention and technology process were also noted. Additionally, high levels of interobserver agreement, high levels of consultant procedural integrity, and high levels of parent treatment integrity were observed.

Inter-observer agreement of the General Movements Assessment with infants following surgery

BackgroundThe General Movements Assessment (GMA) is a validated and reliable method of identifying infants at risk of adverse neurodevelopmental outcomes, however there is minimal data available on the use of the GMA with infants following surgery. AimsThe aim of this study was to investigate the inter-observer agreement for the GMA with this infant population. Study designReliability and agreement study. SubjectsThis was a prospective cohort study of 190 infants (male n=112) born at term (mean 38weeks, SD 2weeks). Outcome measuresA GMA was conducted in the Neonatal Intensive Care Unit (NICU) following either cardiac surgery (n=92), non-cardiac surgery (n=93) or both types of surgery (n=5), and then again at three months of age. All videos were independently assessed by three advanced trained clinicians. Agreement and reliability statistics were calculated between each pair. ResultsWe found moderate to substantial levels of agreement in the writhing period (66–77%, AC1=0.53–0.69). For fidgety general movements, agreement was classified as almost perfect, ranging from 86 to 89% (AC1=0.84–0.88). ConclusionsThe GMA has high levels of inter-observer agreement when used with infants who have undergone surgery in the neonatal period, making it a valid, complementary assessment tool. Research is now underway to determine the ability of the GMA to predict neurodevelopmental outcomes in this population.

Development and Validation of a Classification System to Identify High-Grade Dysplasia and Esophageal Adenocarcinoma in Barrett’s Esophagus Using Narrow-Band Imaging

Although several classification systems have been proposed for characterization of Barrett's esophagus (BE) surface patterns based on narrow-band imaging (NBI), none have been widely accepted. The Barrett's International NBI Group (BING) aimed to develop and validate an NBI classification system for identification of dysplasia and cancer in patients with BE. The BING working group, composed of NBI experts from the United States, Europe, and Japan, met to develop a validated, consensus-driven NBI classification system for identifying dysplasia and cancer in BE. The group reviewed 60 NBI images of nondysplastic BE, high-grade dysplasia, and esophageal adenocarcinoma to characterize mucosal and vascular patterns visible by NBI; these features were used to develop the BING criteria. We then recruited adult patients undergoing surveillance or endoscopic treatment for BE at 4 institutions in the United States and Europe, obtaining high-quality NBI images and performing histologic analysis of biopsies. Experts individually reviewed 50 NBI images to validate the BING criteria, and then evaluated 120 additional NBI images (not previously viewed) to determine whether the criteria accurately predicted the histology results. The BING criteria identified patients with dysplasia with 85% overall accuracy, 80% sensitivity, 88% specificity, 81% positive predictive value, and 88% negative predictive value. When dysplasia was identified with a high level of confidence, these values were 92%, 91%, 93%, 89%, and 95%, respectively. The overall strength of inter-observer agreement was substantial (κ = 0.681). The BING working group developed a simple, internally validated system to identify dysplasia and EAC in patients with BE based on NBI results. When images are assessed with a high degree of confidence, the system can classify BE with >90% accuracy and a high level of inter-observer agreement.

Pattern of Fascicular Involvement in Midportion Achilles Tendinopathy at Ultrasound

Background:The Achilles tendon is composed of fascicles from the soleus and gastrocnemius muscles, which are identifiable as discrete components at anatomical dissection.Hypothesis:The pattern of fascicular involvement in Achilles tendinopathy may be characterized at ultrasound, and this characterization is reliable between different observers.Study Design:Cross-sectional diagnostic study.Level of Evidence:Level 3.Methods:One hundred cases of Achilles tendinopathy were retrospectively evaluated by 2 blinded musculoskeletal radiologists. Using a short-axis anatomical map, each case was categorized as involving the fascicular territories of the medial head of gastrocnemius, lateral head of gastrocnemius, soleus, or combinations of these, or as indeterminate.Results:Both radiologists agreed on the fascicular involvement pattern in 93 of 100 cases; 20 involved only medial gastrocnemius territories, 8 lateral gastrocnemius, 15 soleus, 3 medial and lateral gastrocnemius, 21 medial gastrocnemius and soleus, 9 soleus and lateral gastrocnemius, and 16 the entire tendon, and 1 case was classified as indeterminate. In 7 cases, the interpretations were discordant. The kappa value was calculated as 0.92 (95% CI, 0.86-0.98) in keeping with a high level of interobserver agreement.Conclusion:As assessed at ultrasound, most cases of Achilles tendinopathy involve the medial head of gastrocnemius and/or soleus fascicles.Clinical Relevance:The provided observational data will increase understanding of patterns of Achilles tendinopathy.

Functional status after critical illness: agreement between patient and proxy assessments.

assessment of baseline functional status of older patients during and after intensive care unit (ICU) admission is often hampered by challenges related to the critical illness such as cognitive dysfunction, neuropsychological morbidity and pain. To explore the reliability of assessments by carefully chosen proxies, we designed a discriminating selection of proxies and evaluated agreement between patient and proxy responses by assessing activities of daily living (ADLs) at 1 month post-ICU discharge. patients ≥60 years old admitted to the medical ICU were enrolled in a prospective parent cohort studying delirium. Proxies were carefully screened at ICU admission to choose the best available respondent. Follow-up interviews, including instruments for ADLs, were conducted 1 month after ICU discharge. We examined 179 paired patient-proxy follow-up interviews. Kappa statistics assessed inter-observer agreement, and McNemar's exact test assessed response differences. patients averaged 73.3 ± 8.1 years old with 29% having evidence of cognitive impairment. Proxies were most commonly spouses (38%) or children (39%). Overall, there was substantial (κ ≥ 0.6) to excellent agreement (κ ≥ 0.8) between patients and proxies on assessment of all but one basic and one instrumental ADL. proxies carefully chosen at ICU admission show high levels of inter-observer agreement with older patients when assessing current functional status at 1 month post-ICU discharge. This motivates further study of proxy assessments that could be used earlier in critical illness to assess premorbid functional status.

Interocular symmetry in macular choroidal thickness in children.

Objective. To report interocular differences in choroidal thickness in children using spectral domain optical coherence tomography (SD-OCT) and correlate findings with biometric data. Methods. This observational cross-sectional study included 91 (182 eyes) healthy children aged 6 to 17 years with no ocular abnormality except refractive error. After a comprehensive eye exam and axial length measurement, high definition macular scans were performed using SD-OCT. Two observers manually measured the choroidal thickness at the foveal center and at 1500 µm nasally, temporally, inferiorly, and superiorly. Interocular differences were computed; correlations with age, gender, refractive error, and axial length were performed. Results. Mean age was 10.40 ± 3.17 years; mean axial length and refractive error values were similar between fellow eyes. There was excellent correlation between the two observers' measurements. No significant interocular differences were observed at any location. There was only a trend for right eyes to have higher values in all thicknesses, except the superior thickness. Most of the choroidal thickness measurements correlated positively with spherical equivalent but not with axial length, age, or gender. Conclusion. Choroidal thickness measurements in children as performed using SD-OCT revealed a high level of interobserver agreement and consistent interocular symmetry. Values correlated positively with spherical equivalent refraction.

Assessment of disease activity in large vessel vasculitis: Initial results of an international Delphi exercise

Although several classification systems have been proposed for characterization of Barrett’s esophagus (BE) surface patterns based on narrow-band imaging (NBI), none have been widely accepted. The Barrett’s International NBI Group (BING) aimed to develop and validate an NBI classification system for identification of dysplasia and cancer in patients with BE.The BING working group, composed of NBI experts from the United States, Europe, and Japan, met to develop a validated, consensus-driven NBI classification system for identifying dysplasia and cancer in BE. The group reviewed 60 NBI images of nondysplastic BE, high-grade dysplasia, and esophageal adenocarcinoma to characterize mucosal and vascular patterns visible by NBI; these features were used to develop the BING criteria. We then recruited adult patients undergoing surveillance or endoscopic treatment for BE at 4 institutions in the United States and Europe, obtaining high-quality NBI images and performing histologic analysis of biopsies. Experts individually reviewed 50 NBI images to validate the BING criteria, and then evaluated 120 additional NBI images (not previously viewed) to determine whether the criteria accurately predicted the histology results.The BING criteria identified patients with dysplasia with 85% overall accuracy, 80% sensitivity, 88% specificity, 81% positive predictive value, and 88% negative predictive value. When dysplasia was identified with a high level of confidence, these values were 92%, 91%, 93%, 89%, and 95%, respectively. The overall strength of inter-observer agreement was substantial (κ = 0.681).The BING working group developed a simple, internally validated system to identify dysplasia and EAC in patients with BE based on NBI results. When images are assessed with a high degree of confidence, the system can classify BE with >90% accuracy and a high level of inter-observer agreement.

Inter-observer reliability of Qualitative Behavioural Assessments of sheep

Qualitative Behaviour Assessment (QBA) is whole-animal methodology that assesses the expressive qualities of animal demeanour using descriptors such as ‘relaxed’, ‘anxious’ or ‘content’. This study aimed to examine the inter-observer reliability of 12 fixed-list QBA descriptors for sheep that had been generated in a previous Free-Choice Profiling study by experienced animal welfare inspectors, based on the same video footage used in the current study. The 12 QBA terms were scored by two different assessor groups consisting of two veterinary science students and four veterinary surgeons (Group 1), and seven farm assurance inspectors (Group 2). The two assessor groups met and received training on different dates, and viewed the same 12 video clips of sheep showing a wide range of behavioural expressions in varying indoor and outdoor situations and housing systems. For each clip assessors scored the sheep expressions on each of the 12 QBA terms using a Visual Analogue Scale. Principal Component Analysis (covariance matrix, no rotation) was used to analyse assessor scores, both for Groups 1 and 2 separately, and together in one all-assessor group. All three analyses identified that over 70% of variance in sheep expression was described by two main components. For the all-assessor analysis the first Principal Component (PC1, 49% of variation) ranged from ‘content/relaxed/bright’ to ‘distressed/dejected/tense’, while PC2 (31%) ranged from ‘agitated/responsive/anxious’ to ‘dull/dejected/relaxed’. The 2 Principal Components identified by Groups 1 and 2 when analysed separately, were highly similar. The level of agreement between assessors in each group was evaluated using Kendall's coefficient of concordance (W). This produced W values of 0.83 (PC 1) and 0.84 (PC 2) for the all-assessor group, values of 0.90 (PC 1) and 0.86 (PC 2) for Group 1, and of 0.78 (PC 1) and 0.91 (PC 2) for Group 2. All values were significant at P<0.001. These results indicate that two trained assessor groups achieved high levels of inter-observer agreement using a list of 12 pre-fixed QBA terms developed for sheep. This study is the first to investigate QBA as a tool for assessing sheep behavioural expression, and its results support further exploration of the feasibility and validity of applying this method to the assessment of sheep welfare.

Effect of specialist decision-making on treatment strategies for colorectal liver metastases

One hundred and ten patients were treated with palliative chemotherapy, of whom 53 had liver-only disease and had not been reviewed by a specialist liver surgeon. One scan was excluded as all reviewers felt it to be of insufficient quality to assess. Improved surgical technique and better chemotherapeutic manipulation of metastatic disease has increased the number of patients eligible for potentially curative resection of colorectal liver metastases. The rapid evolution in this field suggests that non-specialist decision-making may lead to inappropriate management. This study aimed to assess the management of colorectal liver metastases by non-liver surgeons. All patients who underwent chemotherapy with palliative intent for metastatic colorectal cancer at a regional oncology centre between 1 January and 31 December 2009 were identified from a prospectively maintained local database. Six resectional liver surgeons blinded to patient management and outcome reviewed pretreatment imaging and assigned each scan a score based on their own management choice. A consensus decision was reached on the appropriateness of palliative chemotherapy. One hundred and ten patients were treated with palliative chemotherapy, of whom 53 had liver-only disease and had not been reviewed by a specialist liver surgeon. One scan was excluded as all reviewers felt it to be of insufficient quality to assess [corrected]. Tumours in 33 patients (63 per cent) were considered potentially resectable, with a high level of interobserver agreement (κ = 0 · 577). When individual approach to management was considered, interobserver agreement was less marked (κ = 0 · 378). Management of patients with colorectal liver metastases without the involvement of a specialist liver multidisciplinary team can lead to patients being denied potentially curative treatments. Management of these patients must involve a specialist liver surgeon to ensure appropriate management.

MRI after patellofemoral replacement: The preserved compartments

IntroductionThe aim of this study was to assess the reproducibility of magnet resonance imaging (MRI) analysis of preserved anatomic structures of the knee after patellofemoral replacement (PFR). It was hypothesized that evaluation of cartilage, ligaments, meniscus and tendons would result in high inter-observer reliability after PFR. Material and methodsMRI, tailored to reduce metallic artefacts of the knee, after PFR was performed in seven patients. Two independent investigators evaluated cartilage, menisci, collateral and cruciate ligaments, the quadriceps and patellar tendons and the presence of joint effusion. The reviewers used a five-point scale to give a degree of confidence to their evaluation of each parameter. Inter-observer reliability was determined by calculation of Cohen's Kappas. ResultsArtefact provoked by the implants was not observed. For all assessed structures, there was excellent inter-observer reliability, with high Cohen's Kappas. There were also high levels of inter-observer agreement and observer confidence in the evaluation of cartilage, meniscus, tendons, ligaments and joint effusion. ConclusionTailored MRI allows reproducible analysis of the preserved knee joint structures after PFR. It might prove helpful in assessment of painful knee joints after PFR.

Normative values and inter-observer agreement for liquid and solid bolus swallows in upright and supine positions as assessed by esophageal high-resolution manometry

High-resolution manometry (HRM) with spatiotemporal representation of pressure data is a recent advance in esophageal measurement. At present, normal values are available for 5mL water swallows in the supine position. This study provides reference values for liquid and solid bolus swallows in the upright seated and supine positions. A total of 23 asymptomatic volunteers (11M:12F, age 20-56) underwent HRM (Manoscan 360; Sierra Scientific Instruments) with 5mL water and 1cm3 bread swallows in the upright and supine positions. Normal values for primary parameters associated with effective bolus transport [proximal transition zone length (PTZ, assesses peristaltic coordination], contraction front velocity (CFV), distal contractile index (DCI) and integrated relaxation pressure (IRP)] are presented. For each parameter, median values along with the 5-95th percentile range are reported. Inter-observer agreement between independent observers is reported using the intra-class correlation coefficient. A higher proportion of swallows were peristaltic for liquids than solids in both the upright and supine positions (both P<0.05). As workload increases with solid bolus and on moving from the upright to the supine position the esophageal contractile response resulted in a shorter PTZ, a slower CFV, and a more vigorous DCI. Also IRP increased during solid bolus transit (all P<0.01). There was significant agreement between independent observers for HRM parameters. Normative values for esophageal function for solids as well as liquids and in the 'physiologic', upright position will optimize the utility of HRM studies. The high level of inter-observer agreement indicates that these can be applied as reference values in clinical practice.