Interphysician Agreement Research Articles

Pediatric patient-specific three-dimensional virtual models for surgical decision making in resection of hepatic and retroperitoneal tumors.

Typically, preoperative imaging is viewed in two dimensions (2D) only, but three-dimensional (3D) virtual models may improve viewers' anatomical perspective by permitting them to interact with the imaging through manipulating it in space. Research into the utility of these models in most surgical specialties is growing rapidly. This study investigates the utility of 3D virtual models of complex pediatric abdominal tumors for clinical decision making, particularly the decision to proceed with surgical resection or not. 3D virtual models of tumors and adjacent anatomy were created from CT images of pediatric patients scanned for Wilms tumor, neuroblastoma or hepatoblastoma. Pediatric surgeons individually assessed the resectability of the tumors. First, they assessed resectability using the standard protocol of viewing imaging on conventional screens and then reassessed resectability after being presented with the 3D virtual models. Inter-physician agreement on resectability for each patient was analyzed using Krippendorff's alpha. Inter-physician agreement was used as a surrogate for correct interpretation. Participants were also surveyed afterward on the utility and practicality of the 3D virtual models for clinical decision making. Inter-physician agreement when using CT imaging alone was "fair" (Krippendorff's alpha α = 0.399), while inter-physician agreement when using 3D virtual models increased to "moderate" (Krippendorff's alpha α = 0.532). When surveyed about model utility, all 5 participants considered them helpful. Two participants felt the models would be practical for clinical use in most cases, while 3 felt they would be practical for select cases only. This study demonstrates the subjective utility of 3D virtual models of pediatric abdominal tumors for clinical decision making. The models are an adjunct that can be particularly useful in complicated tumors that efface or displace critical structures that may impact resectability. Statistical analysis demonstrates the improved inter-rater agreement with the 3D stereoscopic display over the 2D display. The use of 3D displays of medical images will increase over time, and evaluation of their potential usefulness in various clinical settings is necessary.

526. Antimicrobial Selection Based on Precision Metagenomics Compared with Standard Urine Culture/Susceptibility: A Reliability and Inter-rater Agreement Analysis for Application in Patients with Urinary Tract Infections

Abstract Background Management of urinary tract infections (UTIs) is highly variable and ∼50% of affected women may receive inappropriate antimicrobials. Precision Metagenomics-based detection of pathogens and antimicrobial resistance (AMR) markers can inform antimicrobial selection in support of stewardship practices. We investigated inter-physician agreement of culture and metagenomic results in a retrospective analysis. Methods We used de-identified urine samples with results of urine culture & antimicrobial susceptibility testing (AST, n=25, 76% culture-positive) and the Explify® Urinary Pathogen ID/AMR Panel (UPIP, IDbyDNA Inc). UPIP is a Precision Metagenomics method to detect >170 uropathogens and >2,000 AMR markers. Four physicians reviewed culture/AST and UPIP results independently to assess if and how they would treat based on each set of results in a middle-aged, female patient with uncomplicated UTI (no comorbidities or medication allergies). Consensus was defined by simple majority; treatment decisions and antimicrobial choice were adjudicated by an infectious disease trained pharmacist. Inter-rater agreement (Fleiss’ kappa) and reliability for accurate case management (reference: adjudicator) were estimated for each method. Results Analytical agreement for uropathogen identification between the two methods was 72% with 95% positive agreement for common uropathogens. Consensus on whether or not to treat was reached for 96% (24/25) of cases for both culture/AST and UPIP; decisions were concordant between methods for 88% of cases (22/25). Inter-rater agreement was high (culture: k=0.73, UPIP: k=0.68; p< 0.05). Physicians were more likely to decide to treat based on culture results (17/25, 68%) than UPIP (15/25, 60%). UPIP detected additional organism(s) and/or AMR marker(s) compared with culture/AST alone that were informative for stewardship-guided treatment decisions in 28% (7/25) of samples. Figure 1: Physician Consensus Treatment Decisions Based on Results of Urine Sample Analysis by Precision Metagenomics or Urine Culture/AST Four infectious disease physicians independently reviewed paired results from analysis of a set of 25 clinical remnant urine samples by an investigational Precision Metagenomics method (UPIP) and by standard urine culture/AST and determined whether or not treatment would be warranted. Figure 2:Summary of Changes in Antimicrobial Selection based on Interpretation of Precision Metagenomics vs Culture/AST Results An infectious disease pharmacist reviewed and adjudicated hypothetical antimicrobial selections. All antimicrobial selections based on the results of the Precision Metagenomics method (UPIP) were found to be appropriate; in 7/15 cases, hypothetical treatment based on UPIP results would have resulted in a change in management that was evaluated to be consistent with stewardship practices. Conclusion Physician agreement on hypothetical treatment recommendations was comparable between the investigational method (UPIP) and the reference method (urine culture/AST). In no case was there inappropriate consensus to treat based on UPIP results alone. The findings from this pilot analysis support the feasibility of metagenomics-guided management of UTIs. Disclosures Benjamin Briggs, MD, PhD, CloudCath: Advisor/Consultant|CosmosID: Employee Benjamin Briggs, MD, PhD, CloudCath: Advisor/Consultant|CosmosID: Employee Robert Schlaberg, MD, MPH, IDBYDNA INC: Board Member|IDBYDNA INC: Explify-related IP|IDBYDNA INC: Employee|IDBYDNA INC: Stocks/Bonds.

Comparison of 11 automated PET segmentation methods in lymphoma

Segmentation of lymphoma lesions in FDG PET/CT images is critical in both assessing individual lesions and quantifying patient disease burden. Simple thresholding methods remain common despite the large heterogeneity in lymphoma lesion location, size, and contrast. Here, we assess 11 automated PET segmentation methods for their use in two scenarios: individual lesion segmentation and patient-level disease quantification in lymphoma. Lesions on 18F-FDG PET/CT scans of 90 lymphoma patients were contoured by a nuclear medicine physician. Thresholding, active contours, clustering, adaptive region-growing, and convolutional neural network (CNN) methods were implemented on all physician-identified lesions. Lesion-level segmentation was evaluated using multiple segmentation performance metrics (Dice, Hausdorff Distance). Patient-level quantification of total disease burden (SUVtotal) and metabolic tumor volume (MTV) was assessed using Spearman’s correlation coefficients between the segmentation output and physician contours. Lesion segmentation and patient quantification performance was compared to inter-physician agreement in a subset of 20 patients segmented by a second nuclear medicine physician. In total, 1223 lesions with median tumor-to-background ratio of 4.0 and volume of 1.8 cm3, were evaluated. When assessed for lesion segmentation, a 3D CNN, DeepMedic, achieved the highest performance across all evaluation metrics. DeepMedic, clustering methods, and an iterative threshold method had lesion-level segmentation performance comparable to the degree of inter-physician agreement. For patient-level SUVtotal and MTV quantification, all methods except 40% and 50% SUVmax and adaptive region-growing achieved a performance that was similar the agreement of the two physicians. Multiple methods, including a 3D CNN, clustering, and an iterative threshold method, achieved both good lesion-level segmentation and patient-level quantification performance in a population of 90 lymphoma patients. These methods are thus recommended over thresholding methods such as 40% and 50% SUVmax, which were consistently found to be significantly outside the limits defined by inter-physician agreement.

An artificial intelligence decision support system for the management of type 1 diabetes.

Type 1 diabetes (T1D) is characterized by pancreatic beta cell dysfunction and insulin depletion. Over 40% of people with T1D manage their glucose through multiple injections of long-acting basal and short-acting bolus insulin, so called multiple daily injections (MDI).1,2 Errors in dosing can lead to life-threatening hypoglycaemic events (< 70 mg dL^−1) and hyperglycaemia (> 180 mg dL^−1), increasing the risk of retinopathy, neuropathy, and nephropathy. Machine learning (artificial intelligence) approaches are being harnessed to incorporate decision support into many medical specialties. Here we report an algorithm that provides weekly insulin dosage recommendations to adults with T1D using MDI therapy. We employ a unique virtual platform3 to generate over 50,000 glucose observations to train a K-nearest-neighbours4 decision support system (KNN-DSS) to identify causes of hyperglycaemia or hypoglycaemia and determine necessary insulin adjustments from a set of 12 potential recommendations. The KNN-DSS algorithm achieves an overall agreement with board-certified endocrinologists of 67.9% when validated on real-world human data, and delivers safe recommendations per endocrinologist review. A comparison of physician-recommended adjustments to insulin pump therapy indicates full agreement of 41.2% among endocrinologists, which is consistent with previous measures of inter-physician agreement (41–45%)5. In silico3,6 benchmarking using a platform accepted by the U.S. Food and Drug Administration for evaluation of artificial pancreas technologies, indicates substantial improvement in glycaemic outcomes after 12-weeks of KNN-DSS use. Our data indicate that the KNN-DSS allows for early identification of dangerous insulin regimens and may be used to improve glycaemic outcomes and prevent life-threatening complications in people with T1D.

Intra- and Inter-Physician Agreement in Therapeutic Decision for Sleep Apnea Syndrome

BackgroundLarge variation in diagnostic procedures and treatment recommendations may hinder the management of obstructive sleep apnea (OSA) and also compromise correct interpretation of the results of multicenter clinical trials, especially in subjects with non-severe OSA. The aim of this study was to analyze the therapeutic decision-making between different sleep physicians in patients with AHI<40events/h. MethodsSix experienced senior sleep specialists from different sleep centers of Spain were asked to make a therapeutic decision (CPAP treatment) based on anonymized recordings of patients with suspected OSA that has previously performed a sleep study. The clinical data was shown in an online database and included anthropometric features, clinical questionnaires, comorbidities, physical examination and sleep study results. Intra- and inter-observer decision-making were analyzed by the Fleiss tm) Kappa statistics (Kappa). ResultsA total of 720 medical decisions were taken to analyze the agreement between sleep professionals. Overall intra-observer evaluation reliability was almost perfect (Kappa=0.83, 95% CI, 0.75•0.90, p<0.001). However, overall inter-observer concordance decreased to moderate agreement (Kappa=0.46, 95% CI, 0.42•0.51, p<0.001). Nevertheless, it was especially low when considering AHI<15events/h. ConclusionsThis study demonstrates a good intra-observer concordance in the therapeutic decision-making of different sleep physicians treating patients with low/moderate OSA. However, when analyzing inter-observer agreement the results were considerably worse. These findings underline the importance of developing improved consensus management protocols.

Intra- and Inter-Physician Agreement in Therapeutic Decision for Sleep Apnea Syndrome

BackgroundLarge variation in diagnostic procedures and treatment recommendations may hinder the management of obstructive sleep apnea (OSA) and also compromise correct interpretation of the results of multicenter clinical trials, especially in subjects with non-severe OSA. The aim of this study was to analyze the therapeutic decision-making between different sleep physicians in patients with AHI<40events/h. MethodsSix experienced senior sleep specialists from different sleep centers of Spain were asked to make a therapeutic decision (CPAP treatment) based on anonymized recordings of patients with suspected OSA that has previously performed a sleep study. The clinical data was shown in an online database and included anthropometric features, clinical questionnaires, comorbidities, physical examination and sleep study results. Intra- and inter-observer decision-making were analyzed by the Fleiss’ Kappa statistics (Kappa). ResultsA total of 720 medical decisions were taken to analyze the agreement between sleep professionals. Overall intra-observer evaluation reliability was almost perfect (Kappa=0.83, 95% CI, 0.75–0.90, p<0.001). However, overall inter-observer concordance decreased to moderate agreement (Kappa=0.46, 95% CI, 0.42–0.51, p<0.001). Nevertheless, it was especially low when considering AHI<15events/h. ConclusionsThis study demonstrates a good intra-observer concordance in the therapeutic decision-making of different sleep physicians treating patients with low/moderate OSA. However, when analyzing inter-observer agreement the results were considerably worse. These findings underline the importance of developing improved consensus management protocols.

Variability in target delineation of cervical carcinoma: A Korean radiation oncology group study (KROG 15-06).

PurposeTo determine inter-observer variability in target volume definition of cervical cancer in radical and adjuvant radiotherapy (RT) settings.MethodsEight physicians contoured CTVs of 2 patients underwent definitive and postoperative RT. Each volume was analyzed using the individual/median volume ratio and generalized conformity index (CIgen). And center of mass (COM) of each contour was calculated. Expert agreement was quantified using an expectation maximization algorithm for Simultaneous Truth and Performance Level Estimation (STAPLE).ResultsFor definitive RT, the individual/median volume ratio ranged from 0.51 to 1.41, and CIgen was 0.531. Mean 3-dimensional distances of average to each COM were 7.8 mm. For postoperative RT setting, corresponding values were 0.65–1.38, 0.563, and 5.3 mm. Kappa value of expert agreement was 0.65 and 0.67, respectively. STAPLE estimates of the sensitivity, specificity, and kappa measures of inter-physician agreement were 0.73, 0.98, and 0.65 for the definitive and 0.75, 0.98, and 0.67 for the adjuvant radiotherapy setting. The largest difference was observed in the superior-inferior direction, particularly in the upper vagina and the common iliac area.ConclusionAs there was still some variability in target delineation, more detailed guidelines for target volume delineation and continuing education would help to reduce this uncertainty.

Development of a new photonumeric scale for acute radiation dermatitis in patients with breast cancer.

86 Background: The Common Terminology Criteria for Adverse Events (CTCAE) is frequently used to grade the severity of acute radiation dermatitis (ARD), but has not been validated despite decades of clinical use. We sought to develop a photonumeric scale to consistently describe ARD in breast cancer patients undergoing radiation (RT). Methods: Patients enrolled on a prospective study that included photographs and quantitative measurements of erythema and hyperpigmentation using colorimetry. 209 photographs from 35 patients with white skin and 369 photographs from 50 patients with skin of color were used to develop two photonumeric scales. Predominant erythema (in white skin) OR hyperpigmentation (in skin of color) were rated on a 4 point scale, with grading of desquamation on a separate 3 point scale. Four raters used both CTCAE and photonumeric scales to independently score all photographs. Intra- and inter-rater agreements were assessed using weighted kappa scores. Results: Using the CTCAE, 95% of photos were rated as grade 1 or 2. There was a trend toward higher grade in patients with skin of color, with grade 2 toxicity in 43% vs. 24%. Intra-rater agreement for CTCAE ratings was 65—87% (kappa 0.34—0.67), with a wide range of inter-rater agreement (56—81% agreement fraction, kappa 0.04—0.58). Using the photonumeric scale, intra-rater agreement was high for erythema/hyperpigmentation in patients with white skin (74—82%, kappa 0.49—0.70) and skin of color (69—86%, kappa 0.55—0.79), along with desquamation (78—87%, kappa 0.52—0.66). There was moderate inter-rater agreement for erythema/hyperpigmentation (51—82%, kappa 0.15—0.71) and desquamation (63—88%, kappa 0.36—0.58). Colorimetric measurements correlated strongly with photonumeric grade. Conclusions: We report a new photonumeric scale for ARD in breast cancer patients with satisfactory reliability across the spectrum of skin pigmentation. Intra-physician ratings were consistent, with moderate inter-physician agreement. The CTCAE functions as a binary scale, with 95% of ARD rated as grade 1 or 2 toxicity. Future work includes correlation with patient-reported outcomes and physician ratings at the point-of-care. Funded by a Munn Idea Grant (G011480).

Automated identification of the lung contours in positron emission tomography

Positron Emission Tomography (PET) is a nuclear medicine imaging technique that permits to analyze, in three dimensions, the physiological processes in vivo. One of the areas where PET has demonstrated its advantages is in the staging of lung cancer, where it offers better sensitivity and specificity than other techniques such as CT.On the other hand, accurate segmentation, an important procedure for Computer Aided Diagnostics (CAD) and automated image analysis, is a challenging task given the low spatial resolution and the high noise that are intrinsic characteristics of PET images.This work presents an algorithm for the segmentation of lungs in PET images, to be used in CAD and group analysis in a large patient database. The lung boundaries are automatically extracted from a PET volume through the application of a marker-driven watershed segmentation procedure which is robust to the noise. In order to test the effectiveness of the proposed method, we compared the segmentation results in several slices using our approach with the results obtained from manual delineation. The manual delineation was performed by nuclear medicine physicians that used a software routine that we developed specifically for this task. To quantify the similarity between the contours obtained from the two methods, we used figures of merit based on region and also on contour definitions. Results show that the performance of the algorithm was similar to the performance of human physicians. Additionally, we found that the algorithm-physician agreement is similar (statistically significant) to the inter-physician agreement.

Inter-physician agreement on the readiness of sick-listed employees to return to work

Purpose: To determine the agreement between occupational physician (OP) ratings of an employee’s readiness to return to work (RRTW). Method: Anonymized written vignettes of 132 employees, sick-listed for at least 3 weeks, were reviewed by 5 OPs. The OPs intuitively rated RRTW as the ability (knowledge and skills) and willingness (motivation and confidence) of sick-listed employees to resume work. Inter-OP percentages of agreement were calculated and Cohen’s kappas (κ) were determined to correct for agreement by chance. Results: The percentage of agreement between OPs was 57% (range 39–89%) on the ability and 63% (range 48–87%) on the willingness of sick-listed employees to resume work. The mean κ was 0.14 (range from –0.21 to 0.79) for ability and 0.25 (range from –0.11 to 0.74) for willingness. The OP-rating of RRTW of employees sick-listed with mental disorders did not differ from the OP-rating of RRTW of employees with musculoskeletal disorders. Conclusion: The inter-OP agreement on intuitively rated RRTW showed a wide variability, which accentuates the need for instruments to establish an employee’s RRTW and for training in giving well founded return to work recommendations.Implications for RehabilitationThere is little agreement between physicians’ intuitive ratings of the readiness of sick-listed employees to return to work.This finding accentuates the need for an instrument to establish an employee’s readiness to return to work more consistently.A reliable assessment of the readiness to return to work is important for motivating sick-listed employees to resume work and for advising managers on how to support and instruct the sick-listed employee.

Influence of peer review medical audit on pathophysiological interpretation of nerve conduction studies in polyneuropathies

Objective To evaluate the possible influence of peer review medical audit on experienced physicians' pathophysiological interpretation of nerve conduction studies in polyneuropathy patients. Methods Since 1992, 7 European neurophysiologists have collected samples of their patient examinations for regular review where the physicians interpret each other's cases electronically and subsequently discuss them at regular workshop meetings (i.e. a form of medical audit). Two sets of 100 polyneuropathy examinations interpreted with an interval of 4–6 years were selected. The sets contained 1456 and 1719 nerve conduction studies, each given a pathophysiological test conclusion by each individual physician. Inter-physician agreement on interpretation of demyelination and axonal loss of the nerve, as well as neuropathic and unspecific findings, was estimated using kappa statistics. Results Increased agreement from set 1 to set 2 was found on interpretation of demyelination of the nerve (set 1: κ=0.22; set 2: κ=0.45), and of neuropathic (set 1: κ=0.46; set 2: κ=0.64) and unspecific findings (set 1: κ=0.35; set 2: κ=0.54). No changes were found on interpretation of axonal loss (set 1: κ=0.26; set 2: κ=0.31) and normal findings (set 1 and set 2: κ=0.90). Conclusions Participation in regular peer review medical audit resulted in increased agreement on interpretation of nerve conduction studies for 6 of the 7 participants. The study further highlights the need for better definition of criteria for identification of demyelinating, and in particular, axonal peripheral neuropathies. Significance International collaboration involving peer review medical audit may contribute to development of practice guidelines and, in turn, to increased quality of electrodiagnostic medicine.

The Identification of Mandible Fractures by Helical Computed Tomography and Panorex Tomography

The introduction of computed tomography (CT) in 1972 revolutionized the radiographic evaluation of patients who have experienced trauma. However, panoramic tomography (PT) continued to be superior in sensitivity to CT in the identification of mandible fractures and has been considered the gold standard for the past 3 decades. In 1989, a faster, higher-resolution spiral or helical CT (HCT) became widely available, and its efficacy in multiplanar evaluation and diagnosis of fractures of the upper two thirds of the face has been well established. The sensitivity of this new-generation HCT in comparison to PT in the detection of mandible fractures has not been determined. The purpose of this study was to compare the sensitivity, physician interpretation error, and interphysician agreement of HCT and PT in the identification of mandible fractures. The number and anatomical location of mandible fractures identified by HCT and PT was not significantly different. However, the number and location of 96% of fractures identified by HCT was agreed on by neuroradiologists compared with only 91% of fractures identified by PT. Furthermore, the interphysician agreement when no fracture was identified was 96% by HCT versus only 81% by PT. In conclusion, HCT has enhanced imaging quality, equivalent sensitivity in identification of fractures, decreased interpretation error, and greater interphysician agreement in the identification of mandible fractures. HCT has surpassed PT as the current gold standard for the radiographic evaluation and diagnosis of mandible fractures.

Accuracy of a web-based system for monitoring chronic wounds.

This study evaluated the accuracy of a store-and-forward telemedicine system for assessing the status of chronic wounds, including those surgically repaired. Digital photos and other patient and wound data were collected by a nurse using a laptop and transmitted via the Internet to a database, which organized and posted the data onto a web page for access by the telemedicine physician. Two Veterans' Affairs (VA) medical centers and two specialties (plastic surgery, physical medicine and rehabilitation) participated in the study. Study patients included inpatients and outpatients with pressure ulcers of stage II, III, or IV, plus outpatients with diabetic foot ulcers or venous stasis ulcers. All patients were assessed both in-person (the "gold standard") and with the telemedicine system using yes/no responses and a 5-point scale, respectively, on four diagnostic questions concerning wound healing and infection, based on AHCPR guidelines. A total of 70 patients were enrolled, with data collected on 430 visits: up to 6 visits per wound. Percentage agreement for all visits ranged from 67.1 for "not healing" to 88.8 for "cellulitis present." Sensitivity ranged from 0.32 for cellulitis to 0.63 for necrosis; and specificity ranged from 0.80 for necrosis to 0.91 for cellulitis. Although agreement of the telemedicine system was not high, it was not significantly less than interphysician agreement on in-person assessments. A relatively inexpensive store-and-forward telemedicine system for monitoring the status of chronic wounds has the potential to improve access to specialty care for patients who are not currently receiving routine monitoring by specialized nurses or physicians.

Pulmonary Artery Catheter: Does the Problem Lie in the Users?

The aims of this study were to look for the variability in the treatment of circulatory shock and to assess the extent to which this variability was reduced by pulmonary artery catheterization (PAC). At three international conferences in 1997-1998 (European Society of Critical Care Medicine, French Language Society for Critical Care [Société de Réanimation de Langue Française], and Society of Critical Care Medicine), a real-life clinical case was discussed in meetings among physicians and a panel of experts, with assistance from an expert computer program. A total of 417 physicians took part in the discussions. Following the clinical presentation, only 38% of physicians suggested the same treatment as the experts, and 35% suggested potentially harmful treatments. Complete hemodynamic data from PAC significantly decreased the range of suggested treatments, improved agreement among physicians themselves as well as the agreement between physicians and experts, and decreased the number of potentially harmful propositions. However, whereas almost 80% of participants finally agreed on the treatment after one to three invasive hemodynamic sets of measurements, at least 10% persisted in suggesting potentially harmful treatments. PAC improved interphysician agreement, but our data suggest that yet greater agreement could be achieved by improving the theoretical training of practitioners.

Triage of patients with chest pain in the emergency department: a comparative study of physicians’ decisions

PurposeLittle is known about physicians’ triage decisions for patients with chest pain in the emergency department. We sought to understand better the variability and accuracy of physicians’ triage decisions. Subjects and methodsWe used 20 simulated cases to compare triage decisions by 147 physicians (46 emergency medicine, 87 internal medicine, and 14 cardiology physicians) with triage decisions recommended by a previously validated prediction rule. We calculated triage sensitivity and specificity using the prediction rule to estimate the likelihood that each of the simulated patients would suffer a major complication. Triage sensitivity was defined as the proportion of all patients expected to have major complications who were triaged to the coronary care or inpatient telemetry unit. Triage specificity was defined as the proportion of all patients without complications who were triaged to sites other than the coronary care or inpatient telemetry unit. ResultsPhysicians’ triage decisions were less sensitive (85% vs. 96%, P <0.001) and less specific (38% vs. 41%, P = 0.02) than decisions recommended by the prediction rule. Physicians overestimated patients’ risk of complications and triaged more patients to inpatient monitored beds. Despite their preference for inpatient monitored beds, physicians’ decisions would have resulted in four times as many major complications in patients who were not triaged to inpatient monitored beds, compared with decisions recommended by the prediction rule (2.4% vs. 0.6%, P <0.001). Although physicians’ decisions were best explained by their provisional diagnoses, interphysician agreement about triage decisions (kappa [κ] = 0.34) and diagnosis (κ = 0.31) was only fair. ConclusionsIn simulated cases, physicians’ triage decisions varied widely and their predictions of patient outcomes differed markedly from that of the validated prediction rule, suggesting that use of the prediction rule in the emergency department could improve physicians’ decisions and patients’ outcomes.

P HYSICIAN I NTERPRETATION AND Q UANTITATIVE M EASURES OF E LECTROCARDIOGRAPHIC V ENTRICULAR F IBRILLATION W AVEFORM

Objectives. The characteristics of the ventricular fibrillation (VF) waveform may influence treatment decisions and the likelihood of therapeutic success. However, assessment of VF as being fine or coarse and the distinction between fine VF and asystole are largely subjective. The authors sought to determine the level of agreement among physicians for interpretation of varying VF waveforms, and to compare these subjective interpretations with quantitative measures. Methods. Six-second segments of waveform from LIFEPAK 300 units were collected. Fifty segments, including 45 VF and five ventricular tachycardia (VT) distracters, were graphed to simulate rhythm strips. These waveforms were quantitatively described using scaling exponent, root-mean-squared amplitude, and centroid frequency. Thirty-two emergency medicine residents were asked to interpret the arrhythmias as VT, “coarse” VF, “fine” VF, or asystole. Their responses were compared with the qantitative measures. Interphysician agreement was assessed with the kappa statistic. Results. One thousand four hundred forty interpretations were analyzed. There was fair agreement between physicians about the classification of arrhythmias (κ = 0.39). Mean values associated with coarse VF, fine VF, and asystole differed in all three quantitative measure categories. The decision whether to defibrillate was highly correlated with the distinction between VF and asystole (Pearson chi-square = 1,170.40, df = 1, p[two-sided] < 0.001). Conclusions. With only fair agreement on the threshold of fine VF and asystole, defibrillation decisions are largely subjective and caregiver-specific. These data suggest that quantitative measures of the VF waveform could augment the current standard of subjective classification of VF by emergency care providers.

Standardizing the evaluation of treatment outcomes after skin rejuvenation: the qualitative scoring system.

Current treatments to correct and reverse diseased or aged skin yield widely divergent results. Judging the outcome of such treatments is done in an arbitrary and subjective fashion that is often limited to a patient's feedback or the physician's opinion. This makes it difficult for inter-physician or physician-patient agreement as to the degree of improvement achieved. In an age where skin rejuvenation is being widely practiced, a tremendous void needs to be filled by a system that appropriately evaluates and scores treatment outcomes. Such a system will help physicians communicate better in lectures, help them to better assess the results of various treatment modalities, and facilitate patient-doctor communication. The objective of this paper is to present a standardized scoring system against which skin rejuvenation results can be judged. This system is based on a model of healthy skin that can be defined by practical criteria against which patients can be judged pre- and post-skin rejuvenation procedures. A gold standard for healthy skin (baby skin) is established from a clinical, functional, and histologic perspective. Each patient's skin is compared with the healthy skin model and graded before and after treatment by implementing our scoring system which encompasses objective and subjective criteria. Objective criteria include the following skin characteristics: smoothness, firmness, even coloration, normal texture, and absence of any clinically evident disease. Subjective criteria include proper hydration and normal tolerance, and are not considered in the final scoring. Grading of each element in the scoring system [minimal (1), average (2), maximal (3)], and subsequently the final score [excellent (12 to 15), average (7 to 11), poor (<7)] are done with reference to the healthy skin model defined. The scoring system is novel and easy to use, and can be implemented to help improve communication between physicians and patients as well as during the dissemination of knowledge during medical conferences. In conclusion, treatment end-results can be consistently and more accurately assessed when the scoring system (based on objective criteria and a model of healthy skin) is used. Adopting this protocol will also help in directing our treatment to achieve the best possible results.

Clinical assessment of malpractice case scenarios in an anesthesiology department

Study Objective: To determine whether anesthesiologists agree with each other when assessing actual malpractice clinical scenarios, whether their assessments comport with the actual malpractice verdicts, and whether they can accurately guess jury verdicts. Design: Survey study requesting anesthesiologists to review 12 malpractice case scenarios, administered twice. Setting: Academic medical center department of anesthesiology. Measurements and Main Results: Mean interphysician agreement, mean Likert values assessing relative negligence, mean agreement with jury verdicts, mean success at predicting actual jury verdicts for 12 actual jury verdict case scenarios. Respondent anesthesiologists appeared homogeneous by training and years of experience. They showed high (>80%) agreement among themselves in their assessments of the malpractice case scenarios over the two administrations ( p = 0.13). In addition, mean Likert values as to relative negligence assessments by respondent anesthesiologists were not significantly different between administrations by case ( p = 0.09 to 1.00). However, of the eight cases with complete or virtually complete agreement between respondent anesthesiologists, three (37.5%) disagreed with the verdict rendered by the actual juries. In addition, anesthesiologists showed significant disagreement (>30%) among themselves in four of the case scenarios, indicating there may not be agreement regarding the standard of care in these clinical circumstances. Finally, anesthesiologists predicted jury verdicts poorly, with success rates of 50% or less in seven of the 12 case scenarios. Conclusions: For this sample of homogeneous anesthesiologists who demonstrated high clinical agreement, it appears that the malpractice system may not be able to function on its own terms in adjudicating malpractice claims. Although there was agreement among respondent anesthesiologists, these assessments were in direct opposition to actual verdicts, a significant percentage of cases resulted in disagreements as to the appropriate standard of care, and anesthesiologists could not successfully predict jury verdicts. The malpractice system appears to be operating far from its theoretical ideal if these results could be applied more generally. Thus, in practice, the legal system, which is to provide an optimal level of injury deterrence, may be a poor method to limit patient injury, improve patient safety, and provide compensation to negligently injured patients in the health delivery system.

Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment.

The etiology of ischemic stroke affects prognosis, outcome, and management. Trials of therapies for patients with acute stroke should include measurements of responses as influenced by subtype of ischemic stroke. A system for categorization of subtypes of ischemic stroke mainly based on etiology has been developed for the Trial of Org 10172 in Acute Stroke Treatment (TOAST). A classification of subtypes was prepared using clinical features and the results of ancillary diagnostic studies. "Possible" and "probable" diagnoses can be made based on the physician's certainty of diagnosis. The usefulness and interrater agreement of the classification were tested by two neurologists who had not participated in the writing of the criteria. The neurologists independently used the TOAST classification system in their bedside evaluation of 20 patients, first based only on clinical features and then after reviewing the results of diagnostic tests. The TOAST classification denotes five subtypes of ischemic stroke: 1) large-artery atherosclerosis, 2) cardioembolism, 3) small-vessel occlusion, 4) stroke of other determined etiology, and 5) stroke of undetermined etiology. Using this rating system, interphysician agreement was very high. The two physicians disagreed in only one patient. They were both able to reach a specific etiologic diagnosis in 11 patients, whereas the cause of stroke was not determined in nine. The TOAST stroke subtype classification system is easy to use and has good interobserver agreement. This system should allow investigators to report responses to treatment among important subgroups of patients with ischemic stroke. Clinical trials testing treatments for acute ischemic stroke should include similar methods to diagnose subtypes of stroke.