Absolute Agreement Intraclass Correlation Research Articles

Agreement of Serial iCare HOME2 and Goldmann Applanation Tonometry

PurposeTo assess agreement of iCare HOME2 and Goldmann applanation tonometry over a wide range of IOP. DesignA prospective, observational cohort study. SubjectsTwenty-six adult patients undergoing intravitreal injection, which temporarily raises IOP, were recruited from the Palo Alto Medical Foundation Retina Clinic between October 2022 and February 2023. MethodsSubjects had serial iCare HOME2 (IOPI) and Goldmann applanation (IOPG) IOP measurements before and at 0 and 5-10 minutes after injection. Baseline IOPs and pachymetry were taken in both eyes. Main Outcome MeasuresCorrelation between IOPI and IOPG was tested by within-subjects Intraclass Correlation Coefficient (ICC) for repeated measures. Agreement between IOPI and IOPG was evaluated by a Bland-Altman plot with correction for multiple measurements. The difference between IOPI and IOPG was evaluated between eyes at baseline (Pearson’s r) and within the injected eye over different timepoint (ICC for absolute agreement). Linear regression was used to evaluate the effect of age, sex, glaucoma, and corneal thickness. ResultsThe mean IOPI and IOPG were 25.3 (range: 9 – 55) and 23.5 (range: 8 – 56) mmHg, respectively. Correlation between IOPI and IOPG was 0.99 (p<0.001). The mean difference (IOPG - IOPI) was 2.2 mmHg (95% limits of agreement: -3.4 to 7.8 mmHg). The bias in measurements was correlated between eyes (r: 0.68, p<0.001) and in the injected eye across all timepoints (ICC: 0.86, 95% CI: 0.75 to 0.93), but did not show a relationship with age, sex, glaucoma or corneal thickness. ConclusionIOPI and IOPG showed excellent correlation, however there was a stable bias toward IOPG being higher than IOPI over a large range of IOP.

Psychometric properties of a standardized protocol of muscle strength assessment by hand-held dynamometry in healthy adults: a reliability study

BackgroundMaximal isometric muscle strength (MIMS) assessment is a key component of physiotherapists’ work. Hand-held dynamometry (HHD) is a simple and quick method to obtain quantified MIMS values that have been shown to be valid, reliable, and more responsive than manual muscle testing. However, the lack of MIMS reference values for several muscle groups in healthy adults with well-known psychometric properties limits the use and the interpretation of these measures obtained with HHD in clinic.ObjectiveTo determine the intra- and inter-rater reliability, standard error of measurement (SEM) and minimal detectable change (MDC) of MIMS torque values obtained with HHD.MethodsIntra and Inter-rater Reliability Study. The MIMS torque of 17 muscle groups was assessed by two independent raters at three different times in 30 healthy adults using a standardized HHD protocol using the MEDup™ (Atlas Medic, Québec, Canada). Participants were excluded if they presented any of the following criteria: 1) participation in sport at a competitive level; 2) degenerative or neuromusculoskeletal disease that could affect torque measurements; 3) traumatic experience or disease in the previous years that could affect their muscle function; and 4) use of medication that could impact muscle strength (e.g., muscle relaxants, analgesics, opioids) at the time of the evaluation. Intra- and inter-rater reliability were determined using two-way mixed (intra) and random effects (inter) absolute agreement intraclass correlation coefficients (ICC: 95% confidence interval) models. SEM and MDC were calculated from these data.ResultsIntra- and inter-rater reliability were excellent with ICC (95% confidence interval) varying from 0.90 to 0.99 (0.85–0.99) and 0.89 to 0.99 (0.55–0.995), respectively. Absolute SEM and MDC for intra-rater reliability ranged from 0.14 to 3.20 Nm and 0.38 to 8.87 Nm, respectively, and from 0.17 to 5.80 Nm and 0.47 to 16.06 Nm for inter-rater reliability, respectively.ConclusionsThe excellent reliability obtained in this study suggest that the use of such a standardized HHD protocol is a method of choice for MIMS torque measurements in both clinical and research settings. And the identification of the now known metrological qualities of such a protocol should encourage and promote the optimal use of manual dynamometry.

Cross-cultural adaptation, validity, reliability and responsiveness of the Japanese version of the Victorian Institute of sports assessment for patellar tendinopathy (VISA-P-J)

BackgroundThis study aimed to translate, adapt, and test the psychometric properties of the Japanese version of the Victorian Institute of sports assessment for patellar tendinopathy (VISA-P-J).MethodsThis prospective cohort study registered 43 participants ≥ 18 years old with a history of painful symptoms in the inferior pole of the patella to the proximal patellar tendon lasting ≥ 1 month for patellar tendinopathy. Pain in daily life and during sports activities, symptom classification, and patient global impression of change were assessed at the baseline, 1 week, and 12 weeks. The psychometric properties, test–retest reliability, standard error of measurement, internal consistency criterion validity, construct validity, responsiveness, and interpretability, of the VISA-P-J were calculated according to the COSMIN.ResultsThe two-way random-effects, absolute agreement intraclass correlation coefficient for test–retest reliability of VISA-P-J was 0.87 (95% confidence interval: 0.78, 0.93), and the standard error of measurement of VISA-P-J was 0.89. The Cronbach's alpha for internal consistency of VISA-P-J was 0.81. A correlation between VISA-P-J and Roel’s classification, Visual Analog Scale for pain (VAS)-Active Daily Living, and VAS-Sports (r = − 0.52, r = − 0.66, r = − 0.86, p < 0.01, respectively) was observed for criterion validity. All hypotheses of the hypothesis-testing method to evaluate construct validity and responsiveness of VISA-P-J were substantiated. The minimal clinically important difference of VISA-P-J was 7 points.ConclusionWe demonstrated that the VISA-P-J was a reliable, valid, and responsive assessment method for individuals with chronic pain in the patellar tendon.

Development and Validation of the Epidemiological Tattoo Assessment Tool to Assess Ink Exposure and Related Factors in Tattooed Populations for Medical Research: Cross-sectional Validation Study.

Tattooing, whose popularity is growing worldwide, is an invasive body art that involves the injection of chemical mixtures, the tattoo ink, into the upper layer of the dermis. Although these inks may contain environmental toxins, including known human carcinogens, their long-term health effects are poorly studied. To conduct the urgently required epidemiological studies on tattoos and their long-term health effects, a validated method for assessing the complex tattoo exposure is needed. We aimed to develop and validate the Epidemiological Tattoo Assessment Tool (EpiTAT), a questionnaire to self-assess tattoo ink exposure in tattooed populations suitable for application in large epidemiological cohort studies. One of 3 preliminary versions of the EpiTAT using one of the alternative tattoo measurement units hand surface, credit card, or body schemes was randomly filled in by tattooed volunteers in Lyon, France. To identify the most suitable unit of tattoo self-assessment, a validation study was conducted with the selected respondents (N=97) to compare the self-assessments of tattoo surface, color, and coverage with validation measurements made by trained study personnel. Intraclass correlation, the Kendall rank correlation, and 2-tailed t tests were used to statistically compare tattoo size, color area, and tattoo coverage separately for each questionnaire version. Participants' opinions on the alternative measurement units were also considered in the overall evaluation. For quality control of the validation measures, digital surface analysis of 62 photographs of selected tattoos was performed using Fiji/ImageJ. In general, the results revealed overestimation of self-assessed measures compared with validation measures (eg, mean tattooed body surface 1768, SD 1547, cm2 vs 930, SD 1047, cm2, respectively, for hand surface; P<.001) and validation measures compared with digital image analysis (mean individual tattoo surface 147, SD 303.9, cm2 vs 101, SD 154.7, cm2, respectively; P=.05). Although the measurement unit credit card yielded the most accurate measures for all variables of interest, it had a much lower completion rate (78/129, 60.5%) than hand surface (89/104, 85.6%) and body schemes (90/106, 84.9%). Hand surface measured total tattoo size more accurately than body schemes (absolute agreement intraclass correlation coefficient: 0.71 vs 0.64, respectively). The final version of the EpiTAT contains 21 items and uses hand surface as a visual unit of measurement. Likert scales are used to assess color and coverage as a proportion of the total tattoo area. The overestimation of tattoo size by self-reporting merits further research to identify potential influential factors or predictive patterns that could be considered when calculating exposure.

Impact of the use of food ingredients and additives on the estimation of ultra-processed foods and beverages.

Increasing consumption of ultra-processed foods (UPF), defined by the NOVA classification, has been associated with obesity and other health outcomes. However, some authors have criticized the UPF definition because it is somewhat subjective. Most studies identify UPF using food descriptions; nevertheless, NOVA developers described a list of ingredients, including substances not commonly used for cooking and "cosmetic additives" that could be used to identify UPF. Assessing the impact of the use of different UPF definitions is particularly relevant with respect to children's diet, because several dietary policies target this age group. Thus, our study compared the frequency of UPF among foods and beverages and their share in the diet of Chilean preschoolers using three different methods of identifying UPF. We used cross-sectional 24-h dietary recall data from 962 preschoolers enrolled in the Food and Environment Chilean Cohort (FECHIC) in 2016. All foods and beverages consumed were classified according to NOVA, considering their description (classic method), the presence of ingredients markers of UPF (ingredient marker method), and the presence of markers plus all cosmetic additives (food additive method). We also estimated the caloric share and quintiles of UPF consumption using the three methods. We used kappa coefficients, consistency-of-agreement intra-class correlation (CA-ICC), absolute agreement intra-class correlation (AA-ICC), and weighted kappa coefficients for assessing agreement between methods. The proportion of UPF products were 65% in the "classic," 67% in the "ingredient marker," and 73% in the "food additive" method, and kappa coefficients between methods varied from 0.79 to 0. 91. The caloric share of UPF was 47, 52, and 58% with "classic," "ingredient marker," and "food additive" methods, respectively. Consistency-of-agreement was higher than the absolute agreement between the methods (CA-ICC = 0.81; AA-ICC = 0.74). For quintiles of UPF consumption, we found weighted kappa of 0.65 as measure of agreement between "classic" and "ingredient marker," and 0.51 between "classic" and "food additive" methods. Searching for all possible markers of UPF in the list of ingredients increased the proportion of food products identified as UPF compared to the classic method. These differences affected the estimated caloric share of UPF in Chilean preschoolers' diets.

Aging Effect, Reproducibility, and Test-Retest Reliability of a New Cerebral Amyloid Angiopathy MRI Severity Marker-Cerebrovascular Reactivity to Visual Stimulation.

Decreased cerebrovascular reactivity, measured as changes in blood-oxygen-level-dependent (BOLD) signal, is a potential new cerebral amyloid angiopathy (CAA) severity marker. Before clinical application, the effect of aging on BOLD parameters, and reproducibility and test-retest reliability of these parameters should be assessed. Assess the effect of healthy aging on cerebrovascular reactivity (BOLD amplitude, time to peak, and time to baseline). And determine reproducibility and test-retest reliability of these parameters. Prospective-observational. Eighty-six healthy adults (mean age 56 years, 55% female), 10 presymptomatic D-CAA mutation carriers (mean age 34 years, 70% female), and 10 symptomatic D-CAA mutation carriers (mean age 54 years, 70% female). 3-T, three-dimensional (3D) T1-weighted MRI and gradient echo BOLD fMRI. To assess test-retest reliability of BOLD parameters, i.e. BOLD amplitude, time to peak, and time to baseline, BOLD fMRI scans were repeated three times immediately after each other, in both controls and mutation carriers. To assess reproducibility, BOLD fMRI scans were repeated with a 3-week interval for each subject. Linear regression analyses and two-way mixed absolute agreement intra-class correlation approach. Healthy aging was associated with decreased BOLD amplitude (β=-0.711) and prolonged time to baseline (β=0.236) in the visual cortex after visual stimulation Reproducibility of BOLD amplitude was excellent (ICC 0.940) in the subgroup of healthy adults. Test-retest reliability for BOLD amplitude was excellent in healthy adults (ICC 0.856-0.910) and presymptomatic D-CAA mutation carriers (ICC 0.959-0.981). In symptomatic D-CAA mutation carriers, test-retest reliability was poor for all parameters (ICCs < 0.5). Healthy aging is associated with decreased cerebrovascular reactivity, measured by changes in BOLD response to visual stimulation. The BOLD amplitude appears to be a robust measurement in healthy adults and presymptomatic D-CAA mutation carriers, but not in symptomatic D-CAA mutation carriers.

Quality of the Forensic Case Formulation in Mental Health

The "Guide to understand and assess the quality of the case formulation in forensic mental health - TECF" is tested in order to contribute to the development of the forensic reports. Twelve mental health professionals of different Latin American traditions assessed with the TECF the quality of ten international forensic reports, both psychological and psychiatric. The guide includes the manual that describes the dimensions, criteria and guidelines to assess the quality of the forensic case formulation. Internal consistency indicators were in a rank of 0.34- 0.81 for the dimensions and 0.85 for the total TECF. The absolute agreement intraclass correlation coefficient among evaluators with similar tradition reached values of 0.72; 0.52; 0.76 and 0.77 for the dimensions and 0.84 for the total. The agreement among evaluators with different traditions was less. The TECF is a promising instrument to guide the assessment of quality and to stimulate improvement of the forensic reports. Caution is recommended in light of the traditional rating scale method due to the effect that can be produced by the different practices.

Test-Retest Reliability of the Microvascular Oxygenation Recovery Response Subsequent to Submaximal Cycling Exercise

Introduction: The purpose was to quantify the within-session and between-session reliability of halftime (HT) and monoexponential curve fitting (EXP) analyses, when assessing the microvascular tissue oxygenation (StO2) recovery response via near-infrared spectroscopy (NIRS). Methods: Seventeen subjects completed a submaximal cycling test and 6-minute cool-down on three occasions. The protocol was completed twice during session 1 and once during session 2. StO2 were collected via NIRS from a randomized vastus lateralis. StO2 response from the last minute of exercise and the entire cool-down was analyzed using HT and EXP. Within-session and between-session reliability were examined by mixed, absolute agreement intraclass correlation coefficients (ICC) and standard error of the measurement (SEM). Results: HT resulted in higher within-session reliability compared to EXP for exercising StO2 (ICCHT=0.920, ICCEXP=0.865, SEMHT=4.9 ∆BSL, SEMEXP=6.2 ∆BSL) and StO2 recovery time (ICCHT=0.772, ICCEXP=0.720, SEMHT=7 sec, SEMEXP=9 sec). Similar between-session reliability for exercising StO2 was observed (ICCHT=0.895, ICCEXP=0.879, SEMHT=5.2 ∆BSL, SEMEXP=5.4 ∆BSL), however HT elicited higher between-session reliability for StO2 recovery time (ICCHT=0.583, ICCEXP=-0.211, SEMHT=7 sec, SEMEXP=15 sec). Conclusions: Due to the better within-session (exercising StO2, StO2 recovery time) and between-session (StO2 recovery time) reliability, practitioners are encouraged to use HT when assessing exercising StO2 and StO2 recovery time.

Validation of a Musculoskeletal Digital Assessment Routing Tool: Protocol for a Pilot Randomized Crossover Noninferiority Trial.

BackgroundMusculoskeletal conditions account for 16% of global disability, resulting in a negative effect on millions of patients and an increasing demand for health care use. Digital technologies to improve health care outcomes and efficiency are considered a priority; however, innovations are rarely tested with sufficient rigor in clinical trials, which is the gold standard for clinical proof of safety and efficacy. We have developed a new musculoskeletal digital assessment routing tool (DART) that allows users to self-assess and be directed to the right care. DART requires validation in a real-world setting before implementation.ObjectiveThis pilot study aims to assess the feasibility of a future trial by exploring the key aspects of trial methodology, assessing the procedures, and collecting exploratory data to inform the design of a definitive randomized crossover noninferiority trial to assess DART safety and effectiveness.MethodsWe will collect data from 76 adults with a musculoskeletal condition presenting to general practitioners within a National Health Service (NHS) in England. Participants will complete both a DART assessment and a physiotherapist-led triage, with the order determined by randomization. The primary analysis will involve an absolute agreement intraclass correlation (A,1) estimate with 95% CI between DART and the clinician for assessment outcomes signposting to condition management pathways. Data will be collected to allow the analysis of participant recruitment and retention, randomization, allocation concealment, blinding, data collection process, and bias. In addition, the impact of trial burden and potential barriers to intervention delivery will be considered. The DART user satisfaction will be measured using the system usability scale.ResultsA UK NHS ethics submission was done during June 2021 and is pending approval; recruitment will commence in early 2022, with data collection anticipated to last for 3 months. The results will be reported in a follow-up paper in 2022.ConclusionsThis study will inform the design of a randomized controlled crossover noninferiority study that will provide evidence concerning mobile health DART system clinical signposting in an NHS setting before real-world implementation. Success should produce evidence of a safe, effective system with good usability, potentially facilitating quicker and easier patient access to appropriate care while reducing the burden on primary and secondary care musculoskeletal services. This rigorous approach to mobile health system testing could be used as a guide for other developers of similar applications.Trial RegistrationClinicalTrials.gov NCT04904029; http://clinicaltrials.gov/ct2/show/NCT04904029International Registered Report Identifier (IRRID)PRR1-10.2196/31541

Validation of Somno-Art Software, a novel approach of sleep staging, compared with polysomnography in disturbed sleep profiles.

Integrated analysis of heart rate (electrocardiogram [ECG]) and body movements (actimetry) during sleep in healthy subjects have previously been shown to generate similar evaluation of sleep architecture and continuity with Somno-Art Software compared to polysomnography (PSG), the gold standard. However, the performance of this new approach of sleep staging has not yet been evaluated on patients with disturbed sleep. Sleep staging from 458 sleep recordings from multiple studies comprising healthy and patient population (obstructive sleep apnea [OSA], insomnia, major depressive disorder [MDD]) was obtained from PSG visual scoring using the American Academy of Sleep Medicine rules and from Somno-Art Software analysis on synchronized ECG and actimetry. Inter-rater reliability (IRR), evaluated with 95% absolute agreement intra-class correlation coefficient, was rated as "excellent" (ICCAAAvg95% ≥ 0.75) or "good" (ICCAAAvg95% ≥ 0.60) for all sleep parameters assessed, except non-REM (NREM) and N3 sleep in healthy participants (ICCAAAvg95% = 0.43, ICCAAAvg95% = 0.56) and N3 sleep in OSA patients (ICCAAAvg95% = 0.59) rated as "fair" IRR. Overall sensitivity, specificity, accuracy, and Cohen's kappa coefficient of agreement (κ) on the entire sample were respectively of 93.3%, 69.5%, 87.8%, and 0.65 for wake/sleep classification and accuracy and κ were of 68.5% and 0.55 for W/N1+N2/N3/rapid eye movement (REM) classification. These performances were similar in healthy and patient population. The present results suggest that Somno-Art can be a valid sleep-staging tool in both healthy subjects and patients with OSA, insomnia, or MDD. It could complement existing non-attended techniques measuring sleep-related breathing patterns or be a useful alternative to laboratory-based PSG when this latter is not available.

Assessing the reproducibility of CBCT-derived radiomics features using a novel three-dimensional printed phantom.

Radiomics modeling is an exciting avenue for enhancing clinical decision making and personalized treatment. Radiation oncology patients often undergo routine imaging for position verification, particularly using LINAC-mounted cone beam computed tomography (CBCT). The wealth of imaging data collected in modern radiation therapy presents an ideal use case for radiomics modeling. Despite this, texture feature (TF) calculation can be limited by concerns over feature stability and reproducibility; in theory, this issue is compounded by the relatively poor image quality of CBCT, as well as variation of acquisition and reconstruction parameters. In this study, we developed and validated a novel three-dimensional (3D) printed phantom for evaluating CBCT-based TF reliability. The phantom has a cylindrical shape (22cm diameter and 25.5cm height) with five inner inserts designed to hold custom-printed rods (1cm diameter and 10-20cm height) of various materials, infill shapes, and densities. TF reproducibility was evaluated across and within three LINACs from a single vendor using sets of three consecutive CBCT taken with the head, thorax, and pelvis clinical imaging protocols. PyRadiomics was used to extract a standard set of TFs from regions of interest centered on each rod. Two-way mixed effects absolute agreement intra-class correlation coefficient (ICC) was used to evaluate TF reproducibility, with features showing ICC values above 0.9 considered robust if their Bonferroni-corrected p-value was below 0.05. A total of 63, 87, and 83 features exhibited test-retest reliability for the head, thorax, and pelvis imaging protocols respectively. When assessing stability between discreet imaging sessions on the same LINAC, these numbers were reduced to 5, 63, and 70 features, respectively. The thorax and pelvis protocols maintained a rich candidate feature space in inter-LINAC analysis with 61 and 65 features, respectively, exceeding the ICC criteria. Crucially, no features were deemed reproducible when compared between protocols. We have developed a 3D phantom for consistent evaluation of TF stability and reproducibility. For LINACs from a single vendor, our study found a substantial number of features available for robust radiomics modeling from CBCT imaging. However, some features showed variations across LINACs. Studies involving CBCT-based radiomics must preselect features prior to their use in clinical-based models.

The repeatability of measurements of male pelvic floor anatomy and function made from transperineal ultrasound images of healthy men and those before and after prostatectomy.

To investigate the inter- and intratester repeatability of measurement of the location and displacement of five pelvic landmarks related to pelvic floor muscles with transperineal ultrasound (TPUS) imaging recorded from healthy men and men before and after prostatectomy. TPUS images were selected from four different participant groups: healthy men, men awaiting prostatectomy, men 2 weeks after prostatectomy, and men 12 months after prostatectomy. On two separate occasions, two assessors with different levels of experience performed analysis of location and displacement of five pelvic landmarks in images made at rest and during voluntary contraction. A two-way mixed effects, single measurement, absolute agreement intraclass correlation coefficient (ICC) was used to investigate the repeatability. Intertester reliability of all locations at rest for all groups was excellent (ICCs > 0.8) except for the craniocaudal coordinate of the ventral urethrovesical junction for men 2 weeks postprostatectomy and the anorectal junction for men with a cancerous prostate. Intertester reliability of the measurement of landmark displacement was acceptable (>0.5) for the dorsoventral axis of motion but not for the craniocaudal axis of motion for all landmarks across all groups. The more experienced assessor was consistently more repeatable. More deeply placed landmarks were more often excluded from analysis and had poorer reliability. Analysis of TPUS images across clinical groups is repeatable for both location and displacement of pelvic landmarks related to pelvic floor muscles when measures are made twice. Analysis experience, landmark depth and optimization of ultrasound settings appear to be important factors in reliability.

Interrater Reliability among Novice Raters in the Assessment of Pelvic Floor Muscle Tone Using the Reissing Tone Scale.

Purpose: The authors sought to determine the interrater reliability among novice raters of intra-vaginal manual assessment of pubococcygeus muscle tone in women using the Reissing tone scale (RTS). Method: Three graduating physiotherapy students (novice raters) and one experienced pelvic floor physiotherapist assessed 31 female participants (aged 20-66 y). Assessors gave RTS scores for pubococcygeus tone at three intra-vaginal locations (6:00, 9:00, and 3:00). Interrater reliability was determined for the novice raters using a two-way random single-measures absolute agreement intra-class correlation coefficient (ICC). Spearman rank correlation (SRC) analysis determined the correlation between the novice and expert scores. Results: The ICC values for the novice raters were 0.523, 0.274, and 0.336 at 6:00, 9:00, and 3:00, and the SRC values between the novice and expert raters were 0.580, 0.320, and 0.340. Conclusions: The novice raters demonstrated low to moderate interrater reliability for intra-vaginal manual assessment of pubococcygeus tone. This result indicates that manual assessment of pelvic floor muscle tone is not reliable enough to use as a stand-alone test to guide treatment, at least for physiotherapists with limited clinical experience.

Cardiovascular magnetic resonance deformation imaging: method comparison and considerations regarding reproducibility

Abstract Funding Acknowledgements Type of funding sources: Public grant(s) – National budget only. Main funding source(s): German Centre for Cardiovascular Research Purpose Myocardial Feature-Tracking (FT) deformation imaging is superior for risk-stratification compared to volumetric approaches. Since there is no clear recommendation regarding FT post-processing, we compared different FT-strain analyses with reference standard techniques, including tagging and strain encoded (SENC) magnetic resonance imaging. Methods FT software from 4 different vendors (TomTec/Medis/Circle(CVI)/Neosoft), tagging (Segment), and fastSENC (MyoStrain) were used to determine left ventricular global circumferential and longitudinal strains (GCS/GLS) in 12 healthy volunteers and 12 heart failure patients. Variability and agreements were assessed using intraclass correlation coefficients for absolute agreement (ICCa) and consistency (ICCc) as well as pearson correlation coefficients. Results For FT-GCS, consistency was excellent comparing different FT-vendors (ICCc = 0.84-0.97, r = 0.86-0.95) and compared to fSENC (ICCc = 0.78-0.89, r = 0.73-0.81). FT-GCS consistency was excellent compared to tagging (ICCc = 0.79-0.85, r = 0.74-0.77) except for TomTec (ICCc = 0.68, r = 0.72). Absolute FT-GCS agreements between FT-vendors were highest for CVI and Medis (ICCa = 0.96) and lowest for TomTec and Neosoft (ICCa = 0.32). Similarly, absolute FT-GCS agreements were excellent for CVI and Medis compared to both tagging and fSENC (ICCa = 0.84-0.88), good to excellent for Neosoft (ICCa = 0.77 and 0.64) and lowest for TomTec (ICCa = 0.41 and 0.47). For FT-GLS, consistency was excellent (ICCc≥0.86, r≥0.76). Absolute agreements between FT-vendors were excellent (ICCa = 0.91-0.93) or good to excellent for TomTec (ICCa = 0.69-0.85). Absolute agreements (ICCa) were good (CVI 0.70, Medis 0.60) and fair (TomTec 0.41, Neosoft 0.59) compared to tagging but excellent compared to fSENC (ICCa = 0.77-0.90). Conclusion Although absolute agreements differ depending on deformation assessment approaches, consistency and correlation are consistently high irrespective of the method chosen, thus indicating reliable strain assessment. Further standardisation and introduction of uniform references is warranted for routine clinical implementation.

Head-to-head comparison of cardiovascular MR feature tracking cine versus acquisition-based deformation strain imaging using myocardial tagging and strain encoding.

Myocardial feature-tracking (FT) deformation imaging is superior for risk stratification compared with volumetric approaches. Because there is no clear recommendation regarding FT postprocessing, we compared different FT-strain analyses with reference standard techniques, including tagging and strain-encoded (SENC) MRI. Feature-tracking software from four different vendors (TomTec, Medis, Circle [CVI], and Neosoft), tagging (Segment), and fastSENC (MyoStrain) were used to determine left ventricular global circumferential strains (GCS) and longitudinal strains (GLS) in 12 healthy volunteers and 12 patients with heart failure. Variability and agreements were assessed using intraclass correlation coefficients for absolute agreement (ICCa) and consistency (ICCc) as well as Pearson correlation coefficients. For FT-GCS, consistency was excellent comparing different FT vendors (ICCc = 0.84-0.97, r = 0.86-0.95) and in comparison to fast SENC (ICCc = 0.78-0.89, r = 0.73-0.81). FT-GCS consistency was excellent compared with tagging (ICCc = 0.79-0.85, r = 0.74-0.77) except for TomTec (ICCc = 0.68, r = 0.72). Absolute FT-GCS agreements among FT vendors were highest for CVI and Medis (ICCa = 0.96) and lowest for TomTec and Neosoft (ICCa = 0.32). Similarly, absolute FT-GCS agreements were excellent for CVI and Medis compared with both tagging and fast SENC (ICCa = 0.84-0.88), good to excellent for Neosoft (ICCa = 0.77 and 0.64), and lowest for TomTec (ICCa = 0.41 and 0.47). For FT-GLS, consistency was excellent (ICCc ≥ 0.86, r ≥ 0.76). Absolute agreements among FT vendors were excellent (ICCa = 0.91-0.93) or good to excellent for TomTec (ICCa = 0.69-0.85). Absolute agreements (ICCa) were good (CVI 0.70, Medis 0.60) and fair (TomTec 0.41, Neosoft 0.59) compared with tagging, but excellent compared with fast SENC (ICCa = 0.77-0.90). Although absolute agreements differ depending on deformation assessment approaches, consistency and correlation are consistently high regardless of the method chosen, thus indicating reliable strain assessment. Further standardisation and introduction of uniform references is warranted for routine clinical implementation.

A wavelet-based algorithm for automated analysis of external tocography: How does it compare to human interpretation?

BackgroundStudies which use external tocography to explore the relationship between increased intrapartum uterine activity and foetal outcomes are feasible because the technology is safe and ubiquitous. However, periods of poor signal quality are common. We developed an algorithm which aims to calculate tocograph summary variables based on well-recorded contractions only, ignoring artefact and excluding sections deemed uninterpretable. The aim of this study was to test that algorithm's reliability. MethodsWhole recordings from labours at ≥35 weeks of gestation were randomly selected without regard to quality. Contractions and rest intervals were measured by two humans independently, and by the algorithm using two sets of models; one based on a series of pre-defined thresholds, and another trained to imitate one of the human interpreters. The absolute agreement intraclass correlation coefficient (ICC) was calculated using a two-way random effects model. ResultsThe training dataset included data from 106 tocographs. Of the tested algorithms, AdaBoost showed the highest initial cross-validated accuracy and proceeded to optimization. Forty tocographs were included in the validation set. The ICCs for the per tocograph mean contraction rates were; human B to human A: 0.940 (0.890–0.968), human A to initial models: 0.944 (0.898–0.970), human A to trained models 0.962 (0.927–0.980), human B to initial models: 0.930 (0.872–0.962), human B to trained models: 0.948 (0.903–0.972). ConclusionsThe algorithm described approximates interpretation of external tocography performed by trained humans. The performance of the AdaBoost trained models was marginally superior compared to the initial models.

Cross-cultural adaptation of the 4-Habits Coding Scheme into French to assess physician communication skills.

The Four Habits Coding Scheme (4-HCS) is a standardized instrument designed to assess physicians' communication skills from an external rater's perspective, based on video-recorded consultations. To perform the cross-cultural adaptation of the 4-HCS into French and to assess its psychometric properties. The 4-HCS was cross-culturally adapted by conducting forward and backward translations with independent translators, following international guidelines. Four raters rated 200 video-recorded medical student consultations with standardized patients, using the French version of the 4-HCS. We examined the internal consistency, factor structure, construct validity, and reliability of the 4-HCS. The mean overall 4-HCS score was 76.44 (standard deviation, 12.34), with no floor or ceiling effects across subscales. The median rating duration of rating was 8 min (range, 4-19). Cronbach's alpha was 0.94 for the overall 4-HCS, ranging from 0.72 to 0.88 across subscales. In confirmatory factor analysis, goodness-of-fit statistics did not corroborate the hypothesized 4-habit structure. Exploratory factor analysis resulted in two dimensions, with the merging of three conceptually related habits into a single dimension and substantial cross-loading for 15 out of 23 items. Median average absolute-agreement intra-class correlation coefficient estimates were 0.74 (range, 0.68-0.84) and 0.85 (range, 0.76-0.91) for inter- and intra-rater reliability of habit subscales, respectively. The French version of the 4-HCS demonstrates satisfactory internal consistency but requires the use of two independent raters to achieve acceptable reliability. The underlying factor structure of the original US version and cross-cultural adaptations of the 4-HCS deserve further investigation.

Improving measurement of harms from others' drinking: A key informant study on type and severity of harm.

Aims:Survey items for measuring harms experienced from others' drinking (AHTO) have been developed primarily to measure type of harm and not severity. However, some type of harms may produce more negative effects than others. We aimed to compare the perceived severity of a comprehensive list of AHTO items to assess consistency in subjective ratings of severity, facilitate a more nuanced analysis and identify strategies to improve measurement of AHTO in epidemiological surveys.Methods:Thirty-six leaders of national alcohol surveys (conducted between 1997 and 2016) from 23 countries rated the typical severity of negative effects on the victim of each of 48 types of AHTO using a scale from zero (no negative effect) to 10 (very severe negative effect). The survey leaders were also asked to provide open-ended feedback about each harm and the severity-rating task generally.Results:Of 48 harm items, five were classified as extreme severity (mean rating ≥ 8), 17 as high (≥ 6 < 8), 25 as moderate (≥ 4 < 6), and one as low (≤ 4). We used two-way random effects models to estimate absolute agreement intraclass correlation coefficients (AA-ICC) and consistency of agreement intraclass correlation coefficients (CA-ICC). Results showed that there was fair to excellent absolute agreement and consistency of agreement among experts’ ratings of the severity of harms from others’ drinking (single measures CA-ICC = 0.414, single measures AA-ICC = 0.325; average CA-ICC = 0.940, average AA-ICC = 0.914). Harms to children, and harms causing physical, financial, practical, or severe emotional impacts were rated most severe.Conclusions:When designing new AHTO surveys and conducting analyses of existing data, researchers should pay close attention to harms with high perceived severity to identify effective ways to prevent severe AHTO and reduce the negative health and social impacts of AHTO. By inquiring into experts' views on survey items, this analysis involves a first scoping of the sort of questions that should be taken into consideration. In-depth analyses of specific sub-sets of harms and qualitative interviews with victims of severe AHTO are likely to help along this work in the future.

From international guidelines to real-world practice consensus on investigations and management of status epilepticus in adults: A modified Delphi approach

ObjectiveTo establish a consensus which is practical and ready-to-use on investigations (ISE) and for management of status epilepticus (MSE) in adults using a modified Delphi approach. Patients and methodsA 4-round modified Delphi approach was used. First and second rounds were conducted using Google® survey with structured statements and 6-point Likert scale response. Threshold agreement was set to ≥80%. Third round was a face-to-face meeting aimed to facilitate the development of approach algorithms for ISE and MSE. Fourth round was a final review asking participants to rate the algorithms post completion. ResultsThe panel consisted of 8 board-certified epileptologists along with 6 neurologists from main regional hospitals across Thailand. Thirty-seven statements for ISE and 68 statements for MSE were used for the Round I survey, 17/37 (45.9%) and 49/68 (72.1%) reached threshold agreement (≥80%). The average absolute-agreement intraclass correlation coefficients for ISE and MSE were 0.82 (95% CI 0.71, 0.89) and 0.81 (95% CI 0.73, 0.87), respectively; indicating good extent of consensus among participants. Upon Round II, further 10/18 (55.6%) for ISE and 10/19 (52.6%) for MSE reached agreement. In Round III, face-to-face point-by-point discussion was performed to generate approach algorithms. All (100%) provided positive responses with the algorithms post completion in Round IV. ConclusionA practical and ready-to-use consensus using modified Delphi approach on ISE and MSE was developed in a Thai regional hospital context. In real practice, this approach is more suitable and feasible for a localized setting when compared with totally adopting international guidelines.

Cochlear Implant Receiver Location and Migration: Experimental Validation Pilot Study of a Clinically Applicable Screening Method.

Objectives: Postoperative follow-up after cochlear implantation lacks a reliable screening method to detect cochlear implant receiver device migration. This study aims to validate a clinically applicable method to assess the position and migration of the cochlear implant receiver device.Study design: Validation study.Setting: Tertiary university medical center.Participants and method: To assess the cochlear implant receiver device location, round markers representing the external magnet were placed on both sides of the head of volunteers. Four independent clinicians took measurements of the distances between reference points on the head and the center of the marker. The reference points were: the lateral canthus (LC), tragus tip (TT), the mastoid angle (MA), and the mandibular angle (AM).Main outcome measures: The inter-clinician reliability was determined by calculating the intraclass correlation coefficient (ICC) and confidence interval (CI) with a two-way mixed model and both consistency and absolute agreement types for each distance.Results: Eight volunteers were included resulting in 16 individual cases. The consistency type ICC's for each reference point were: LC 0.90 (CI = 0.80, 0.96), TT 0.83 (CI = 0.69, 0.93), MA 0.75 (CI = 0.56, 0.89), and AM 0.29 (CI = 0.05, 0.59). The absolute agreement ICC's were: LC 0.87 (CI = 0.73, 0.95), TT 0.83 (CI = 0.68, 0.93), MA 0.68 (CI = 0.42, 0.86), and AM 0.18 (CI = 0.01, 0.46). The inter-clinician reliability was good to excellent for the lateral canthus and tragus tip reference points.Conclusions: The cochlear receiver device location can be assessed reliably by measuring the distance between the LC, TT, and the external magnet. This method can be used to registrate implant receiver location after implantation and detect implant migration postoperatively.