Note Template Research Articles

Large Language Models Outperform Traditional Natural Language Processing Methods in Extracting Patient-Reported Outcomes in Inflammatory Bowel Disease

Background and AimsPatient-reported outcomes (PROs) are vital in assessing disease activity and treatment outcomes in inflammatory bowel disease (IBD). However, manual extraction of these PROs from the free-text of clinical notes is burdensome. We aimed to improve data curation from free-text information in the electronic health record, making it more available for research and quality improvement. This study aimed to compare traditional natural language processing (tNLP) and large language models (LLMs) in extracting three IBD PROs (abdominal pain, diarrhea, fecal blood) from clinical notes across two institutions. MethodsClinic notes were annotated for each PRO using preset protocols. Models were developed and internally tested at the University of California San Francisco (UCSF), and then externally validated at Stanford University. We compared tNLP and LLM-based models on accuracy, sensitivity, specificity, positive and negative predictive value. Additionally, we conducted fairness and error assessments. ResultsInter-rater reliability between annotators was >90%. On the UCSF test set (n=50), the top-performing tNLP models showcased accuracies of 92% (abdominal pain), 82% (diarrhea) and 80% (fecal blood), comparable to GPT-4, which was 96%, 88%, and 90% accurate, respectively. On external validation at Stanford (n=250), tNLP models failed to generalize (61-62% accuracy) while GPT-4 maintained accuracies >90%. PaLM-2 and GPT-4 showed similar performance. No biases were detected based on demographics or diagnosis. ConclusionLLMs are accurate and generalizable methods for extracting PROs. They maintain excellent accuracy across institutions, despite heterogeneity in note templates and authors. Widespread adoption of such tools has the potential to enhance IBD research and patient care.

Decreasing adverse events from concurrent Vinca-alkaloid and azole antifungals in a pediatric oncology population: Patient safety improvement process.

297 Background: Azole-antifungals like posaconazole and voriconazole have a documented significant risk of adverse drug events (ADE) when concomitantly administered with vinca-alkaloid chemotherapy (vincristine, vinblastine, vinorelbine) due to inhibition of vinca clearance. Potential ADE’s include paralytic ileus, severe, potentially permanent neuropathies, cranial nerve dysfunction, seizures, etc. Aim: Assess a standardized process to hold azole-antifungal around vinca-alkaloid drug administration to decrease the risk of adverse events associated with this drug-drug interaction in pediatric oncology patients. Intervention: Azole-antifungals (fluconazole*, voriconazole, posaconazole, itraconazole) will be held the day before, day of, and day after the vinca-alkaloid administration (with flexibility given provider discretion*) in the outpatient and inpatient setting at a single site. Methods: Development of a Standard Operating Procedure (SOP), informational technology (IT) processes such as Best Practice Advisory (BPA), nursing orders, Vinca Time-Out order and standard nursing note template for telephone encounter to remind patient/parents. Retrospective data was assessed in three 6-12 month phases, Pre-SOP (Phase 0), Post- SOP and Pre-IT support (Phase 1), and Full implementation (Phase 2). Study Outcomes: 1.Hold the azole-antifungal in 100% of encounters where vinca-alkaloid is due. 2. Decrease number of adverse events by 10%. 3. Maintain adequate fungal prophylaxis (or treatment) with a 0% incidence of breakthrough fungal infections. Results: Average number of concomitant azole/vinca administrations for each Phase was 39. A 97% improvement was seen in the number of vinca administrations dose reduced or held from 28 (Phase 0) to 1 (Phase 2). A 66% improvement in SOP compliance was observed (19 % in Phase 0, and 85% in Phase 2). Significant adverse effects were decreased by 33-50% between Phase 0, and Phase 1 and 2, respectively. Three patients in Phase 2 experienced fungal infection breakthrough; all had documented compliance issues prior to the study period. Conclusions: Implementation of the SOP and IT processes helped achieve a process to hold azole antifungals and led to significant decrease in the need to dose reduce or hold vinca-alkaloids thereby allowing less chemotherapy interruption/dose adjustments. Further modification of the SOP may be developed to exclude those patients on anti-fungal therapy for an active fungal infection.

Large language models outperform traditional natural language processing methods in extracting patient-reported outcomes in IBD.

Patient-reported outcomes (PROs) are vital in assessing disease activity and treatment outcomes in inflammatory bowel disease (IBD). However, manual extraction of these PROs from the free-text of clinical notes is burdensome. We aimed to improve data curation from free-text information in the electronic health record, making it more available for research and quality improvement. This study aimed to compare traditional natural language processing (tNLP) and large language models (LLMs) in extracting three IBD PROs (abdominal pain, diarrhea, fecal blood) from clinical notes across two institutions. Clinic notes were annotated for each PRO using preset protocols. Models were developed and internally tested at the University of California San Francisco (UCSF), and then externally validated at Stanford University. We compared tNLP and LLM-based models on accuracy, sensitivity, specificity, positive and negative predictive value. Additionally, we conducted fairness and error assessments. Inter-rater reliability between annotators was >90%. On the UCSF test set (n=50), the top-performing tNLP models showcased accuracies of 92% (abdominal pain), 82% (diarrhea) and 80% (fecal blood), comparable to GPT-4, which was 96%, 88%, and 90% accurate, respectively. On external validation at Stanford (n=250), tNLP models failed to generalize (61-62% accuracy) while GPT-4 maintained accuracies >90%. PaLM-2 and GPT-4 showed similar performance. No biases were detected based on demographics or diagnosis. LLMs are accurate and generalizable methods for extracting PROs. They maintain excellent accuracy across institutions, despite heterogeneity in note templates and authors. Widespread adoption of such tools has the potential to enhance IBD research and patient care.

For Whom the Note Scrolls: A Brief History of the Medical Record's Role in Education and the Risks It Faces in the Age of OpenNotes.

Dating back to ancient civilizations when records were carefully transcribed onto papyrus, clinical documentation has long served as a cornerstone of medical-and especially neurologic-education. From the case histories of Hippocrates to the diurnal patient logs used by trainees in the 18th and 19th centuries, clinical notes have an extended history as invaluable instruments of pedagogy, scholarly practice, and interprofessional communication. The novel paradigm introduced by Lawrence Weed in the 1950s, advocating for the problem-oriented medical record system, revolutionized the clinical note template and emphasized the need for physicians' carefully considered analyses of a patient's presentation to be clearly reflected in well-organized documentation. In the realm of medical records today, however, a profound shift is underway, largely propelled by the emergence of electronic medical records, the OpenNotes mandate of the federal 21st Century Cures Act, and, most recently, artificial intelligence (AI). Appropriately, patients now have full access to their medical records, but this raises critical questions. Should clinical notes now prioritize patient comprehension over their traditional role as educational instruments, aide-mémoire, and repositories of detailed assessments and insights? What role, if any, should AI have in the creation of physician notes and patient-facing clinical documents? These tensions underscore the delicate balance between transparency and the preservation of notes' clinical integrity and analytical depth. As we navigate the path forward, finding an equilibrium between openness and the continued utility of medical records as tools for education and professional communication will be imperative.

Standardized clinical data capture to describe cerebral palsy.

To describe a standardized methodology for capturing clinically valuable information on young people with cerebral palsy (CP) from caregivers and clinicians during routine clinical care. We developed a caregiver-facing intake form and clinician-facing standardized note template and integrated both into routine clinical care at a tertiary care CP center ( https://bit.ly/CP-Intake-Methodology ). We extracted this caregiver and clinician-entered data on people with an ICD10 diagnosis of CP seen between 3/22/23 and 12/28/23. We used this data to describe how CP manifests in this group and which medical features affected the odds of walking, oral feeding, and speech by age 5. Of 686 visits, 663 (97%) had caregiver- and clinician-entered data and 633 had a clinician-confirmed CP diagnosis (mean age 9.1, 53.4% Male, 78.5% White). It was common to have quadriplegia (288/613, 47.0%), both spasticity and dystonia (257/632, 40.7%), walk independently (368/633, 58.1%), eat all food and drink safely by mouth (288/578, 55.9%), and produce understandable speech (249/584, 42.6%). Cortical grey matter injury and duration of initial critical care unit stay affected the odds of walking, oral feeding, and speech (binary logistic regression, p<0.001). We comprehensively captured caregiver and clinician-entered data on 97% of people seen in a tertiary care CP Center and used this data to determine medical features affecting the odds of three functional outcomes. By sharing our methodology, we aim to facilitate replication of this dataset at other sites and grow our understanding of how CP manifests in the US. Using caregiver and clinician-entered data on people seen in a tertiary-care CP center, we determined medical features affecting the odds of three functional outcomes. Detailed CP characterization can be limited if using population-based registries and retrospective chart review alone, including limited data on recently validated functional classification systems for CP. We comprehensively captured caregiver and clinician-entered data on 97% of people seen in our CP Center to describe how CP manifests and show that cortical injury and initial ICU stay duration affect the odds of walking, oral feeding, and speech. Susie Kim helped design the study, aggregated data, carried out data analyses, and critically reviewed and revised the manuscript.Kelsey Steffen helped conceptualize and design the study and critically reviewed and revised the manuscript.Lauren Gottschalk, Jennifer Miros, Katie Leger, Amy Viehoever, and Karen Taca helped design the study and critically reviewed and revised the manuscript.Bhooma Aravamuthan conceptualized and designed the study, supervised data collection and analysis, drafted the initial manuscript, and critically reviewed and revised the manuscript.

Bridging the Gap: Can Large Language Models Match Human Expertise in Writing Neurosurgical Operative Notes?

Proper documentation is essential for patient care. The popularity of artificial intelligence (AI) offers the potential for improvements in neurosurgical note-writing. The study aimed to assess how AI can optimize documentation in neurosurgical procedures. Thirty-six notes were included. All identifiable data were removed. Essential information, such as perioperative data and diagnosis, was sourced from these notes. ChatGPT 4.0 was trained to draft notes from surgical vignettes using each surgeon's note template. One hundred forty-four surveys, with a surgeon or AI note, were shared with three surgeons to evaluate accuracy, content, and organization using a five-point scale. Accuracy was the factual correctness. Content was the comprehensiveness. Organization was the arrangement of the note. Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) scores quantified each note's readability. The mean AI accuracy (4.44) was not different from the mean surgeon accuracy (4.33, p = 0.512). The mean AI content (3.73) was lower than the mean surgeon content (4.42, p < 0.001). The mean AI organization (4.54) was greater than the mean surgeon organization (4.24, p = 0.064). The mean AI note's FKGL (13.13) was greater than the mean surgeon FKGL (9.99, p <0.001). The mean AI FRE (21.42) was lower than the mean surgeon FRE (41.70, p <0.001). AI notes were on par with surgeon notes in accuracy and organization, but lacked in content. Additionally, AI notes utilized language at an advanced reading level. These findings underscore the potential for ChatGPT to enhance the efficiency of neurosurgery documentation.

503 An Audit of the Management of Ankle Fractures Undergoing Open Reduction Internal Fixation (ORIF) Against the British Orthopaedic Association (BOA) Standards for Trauma

Abstract Aim To assess compliance of the management of ankle fractures with ORIF at Aberdeen Royal Infirmary and Woodend Hospital against the management of ankle fractures guidelines in the BOA standards for trauma. Method A retrospective analysis of patients who underwent ORIF of ankle fractures from 12/06/2022 to 06/06/2023 was conducted. Pilon fractures and open fractures were excluded. Operations notes, admissions, discharge and clinic letters, and imaging were used. Results 201 patients met the inclusion criteria. 155 patients had complex fractures (posterior malleolus involvement, Maisonneuve, or syndesmotic injury); 46 had non-complex fractures. Only 47.74% of the complex fractures underwent CT imaging. Post-operation, only 14.43% and 12.45% of patients were full weight-bearing and partially weight-bearing, respectively. 97.01% of all patients had a follow-up clinic within 6 weeks post-operation. However, following the first clinic follow-up, only 24.88% and 25.87% were full weight-bearing and partially weight-bearing, respectively. The remaining patients were classified as non-weight-bearing. Conclusions Most of the patients were managed according to the guidelines. However, greater use of CT imaging for complex fractures can be done for defining fracture configurations. Additionally, more patients need to be allowed weight-bearing immediately post-operation and after their first follow-up clinic, as promoted by the BOA. Results were presented at the 21/11/23 mortality and morbidity meeting, and this issue was acknowledged by the orthopaedic surgeons. The post-operation note template will be revised, and a poster including the BOA guidelines on weight-bearing and imaging will be introduced in the department. A re-audit will be done in 2024 to assess any changes.

Implementing a clinical decision support tool to increase early peanut introduction guidance

BackgroundGeneral pediatric providers are the frontline for early peanut introduction discussions, but many feel ill-equipped to handle such discussions as guidelines have quickly changed. ObjectiveWe hypothesized that a clinical decision support (CDS) tool could improve peanut introduction discussions. MethodsCDS tools were designed by stakeholders, improved through usability testing, and integrated into the current note templates. Based on queries of electronic health record (EHR), we did a pre-post performance evaluation of peanut introduction conversations, barriers for introduction, and percentage of 12-month WCC visits that had successfully introduced peanut. Providers completed surveys before and after intervention to assess awareness of early peanut introduction and comfort using CDS. ResultsProviders’ awareness of early peanut introduction guidelines increased from 17.8% to 66.7% after the CDS tool was implemented. 79.1% were comfortable using the tool. The CDS tool improved peanut introduction conversations at the 4-month well-child (WCC) care visit from 2.4% to 81.2%, at the 6-month WCC visit from 3.0% to 84.2%, and at the 12-month WCC visit from 2.7% to 82.9%. 56.6% of families had a plan to introduce peanut at the 4-month WCC visit. Of those who did not have a plan, the most common barrier was family's unawareness of the benefits of early peanut introduction. At the 12-month visit, 62.8% of families had introduced peanut without concerns. ConclusionA point-of-care CDS tool encouraged more discussions by general pediatric providers on early peanut introduction to all patients. CDS tools should be considered in quality improvement projects as an implementation method for the most up-to-date guidelines.

Implementation of kidney palliative care-lessons learned from the US Department of Veterans Affairs.

Advanced kidney disease is a progressive life-limiting illness associated with high symptom burden, disability, and highly intensive care near the end of life. There is growing interest in integrating palliative care principles into the care of patients with advanced kidney disease to improve care and outcomes for these patients. The United States (US) Department of Veterans Affairs (VA) has been a leader in advancing palliative care initiatives across its health system and whose experience and approach may be instructive to other health systems seeking to develop kidney palliative care (KPC) services. Herein, we review current KPC programs in the VA and highlight the different models of care that programs have been adopted and how key components of goals of care conversations and advance care planning, symptom management, multidisciplinary care, patient selection, and quality improvement have been implemented across programs. VA KPC programs have adopted "parallel", "merged", and "embedded" models of KPC that reflect the different configurations of partnerships between nephrology and palliative care providers to deliver KPC. A primary service of VA KPC programs is providing goals of care conversations and advance care planning to referred patients and systematically documenting the outcomes of these discussions in standardized note templates in the electronic medical record. Symptom management is delivered by KPC providers through regular shared or sequential visits with patients' nephrology providers and is guided by patient responses to validated symptom surveys. Programs are staffed by allied health professionals, such as chaplains, pharmacists, social workers, and dieticians, to provide whole-person care and regularly huddle with nephrology staff to reach a shared understanding of each patient's care needs and plan. KPC programs implement champions who select patients in greatest need of KPC using a combination of clinical events that trigger referral for KPC and validated mortality risk prediction scores that are automatically generated in each patient's medical record. KPC programs also routinely collect clinical, patient-reported, process, and care quality measures to assess its services. The experiences of the VA highlight novel approaches that strive to close the care gaps in meeting the KPC needs of patients with advanced kidney disease.

PrEP facilitators and barriers in substance use bridge clinics for women who engage in sex work and who use drugs

BackgroundWomen who engage in sex work and use drugs (WSWUD) experience disproportionate HIV risks. Substance use treatment bridge clinics offer an opportunity to increase HIV pre-exposure prophylaxis (PrEP) delivery to WSWUD, but research on best practices is lacking. Therefore, we explored facilitators and barriers to PrEP across the PrEP care continuum in these settings.MethodsBridge clinic and affiliated harm reduction health service providers and WSWUD from Boston were recruited using passive and active outreach between December 2021 and August 2022. Participants were invited to take part in semi-structured phone or in-person interviews to explore HIV prevention and PrEP care experiences overall and within bridge clinic settings. Deductive codes were developed based on HIV risk environment frameworks and the Information-Motivation-Behavioral Skills model and inductive codes were added based on transcript review. Grounded content analysis was used to generate themes organized around the PrEP care continuum.ResultsThe sample included 14 providers and 25 WSWUD. Most WSWUD were aware of PrEP and more than half had initiated PrEP at some point. However, most who initiated PrEP did not report success with daily oral adherence. Providers and WSWUD described facilitators and barriers to PrEP across the steps of the care continuum: Awareness, uptake, adherence, and retention. Facilitators for WSWUD included non-stigmatizing communication with providers, rapid wraparound substance use treatment and HIV services, having a PrEP routine, and service structures to support PrEP adherence. Barriers included low HIV risk perceptions and competing drug use and survival priorities. Provider facilitators included clinical note templates prompting HIV risk assessments and training. Barriers included discomfort discussing sex work risks, competing clinical priorities, and a lack of PrEP adherence infrastructure.ConclusionWSWUD and bridge clinic providers favored integrated HIV prevention and substance use services in harm reduction and bridge clinic settings. Harm reduction and bridge clinic programs played a key role in HIV prevention and PrEP education for WSWUD. Effective behavioral and structural interventions are still needed to improve PrEP adherence for WSWUD.

Time and Note Characteristic Effects of an Electronic Health Record Template for Internal Medicine Resident Notes.

Background Inpatient internal medicine (IM) residents spend most of their time on indirect patient care activities such as clinical documentation. Objective We developed optimized electronic health record (EHR) templates for IM resident admission and progress notes, with the objective to reduce note-writing time, shorten note length, and decrease the percentage of progress note text that was copy-forwarded from prior notes. Methods In 2022, a multidisciplinary team created, over an 8-month period, optimized EHR templates for IM resident admission and progress notes. A retrospective analysis was performed to assess differences in resident time spent writing notes, note length in characters, and percentage of progress note text that was copy-forwarded. All 94 residents in the IM residency program had the opportunity to use the novel templates. Results Following implementation of the novel templates, residents spent on average 3.6 minutes less per progress note compared to pre-intervention (P=.008; 95% CI of the difference: 1.1-6.0 minutes). Notes in the post-intervention period were shorter for admission notes (mean reduction of 1041 characters; P<.001; 95% CI of the difference: 448-1634 characters) and progress notes (mean reduction of 764 characters; P<.001; 95% CI of the difference: 103-1426 characters). Progress notes also saw an average 22% decrease of copy-forwarded text (P<.001, 95% CI of the difference: 18.7%-25.4%). Conclusions The optimized note templates led to a reduction in resident progress note-writing time, shortened note length, and a lower percentage of copy-forwarded text.

Assessing user perspectives on clinical pharmacogenomics consultation documentation: a user-centered evaluation.

The University of Florida Health Precision Medicine Program plays a crucial role in delivering pharmacogenomics (PGx) result notes to providers who request PGx testing. Despite this, there is currently a lack of a formal assessment of provider needs and established best practice design principles to guide the ongoing development of PGx result notes. This study aims to enhance the content and format of the PGx consult note at UF Health by incorporating valuable feedback from healthcare providers. Through in-depth user sessions involving 11 participants, we evaluated the usability of our consult note template. While overall satisfaction with the content was noted, specific sections, including those addressing phenoconversion and the medication list, were identified for revision to enhance clarity based on insightful provider feedback.

Addressing System and Clinician Barriers to Emergency Department-initiated Buprenorphine: An Evaluation of Post-intervention Physician Outcomes.

Emergency departments (ED) are in the unique position to initiate buprenorphine, an evidence-based treatment for opioid use disorder (OUD). However, barriers at the system and clinician level limit its use. We describe a series of interventions that address these barriers to ED-initiated buprenorphine in one urban ED. We compare post-intervention physician outcomes between the study site and two affiliated sites without the interventions. This was a cross-sectional study conducted at three affiliated urban EDs where the intervention site implemented OUD-related electronic note templates, clinical protocols, a peer navigation program, education, and reminders. Post-intervention, we administered an anonymous, online survey to physicians at all three sites. Survey domains included demographics, buprenorphine experience and knowledge, comfort with addressing OUD, and attitudes toward OUD treatment. Physician outcomes were compared between the intervention site and the control sites with bivariate tests. We used logistic regression controlling for significant demographic differences to compare physicians' buprenorphine experience. Of 113 (51%) eligible physicians, 58 completed the survey: 27 from the intervention site, and 31 from the control sites. Physicians at the intervention site were more likely to spend <75% of their work week in clinical practice and to be in medical practice for <7years. Buprenorphine knowledge (including status of buprenorphine prescribing waiver), comfort with addressing OUD, and attitudes toward OUD treatment did not differ significantly between the sites. Physicians were 4.5 times more likely to have administered buprenorphine at the intervention site (odds ratio [OR] 4.5, 95% confidence interval 1.4-14.4, P = 0.01), which remained significant after adjusting for clinical time and years in practice, (OR 3.5 and 4.6, respectively). Physicians exposed to interventions addressing system- and clinician-level implementation barriers were at least three times as likely to have administered buprenorphine in the ED. Physicians' buprenorphine knowledge, comfort with addressing and attitudes toward OUD treatment did not differ significantly between sites. Our findings suggest that ED-initiated buprenorphine can be facilitated by addressing implementation barriers, while physician knowledge, comfort, and attitudes may be harder to improve.

Development and perception of surgery-specific goals of care discussions in the preoperative setting: A learning pilot.

Goals of care discussions are infrequently documented in the preoperative period. Furthermore, documentation does not consistently address what matters most to patients, although patient values (PV) are central to person-centered care. A multidisciplinary working group was formed. An electronic note comprised of (1) topics of discussion, (2) PV, and (3) advance care planning (ACP), was created and embedded into existing note templates for Gynecologic Surgical Oncology. Surgeons and advanced practice providers (APPs) were educated to conduct and document these conversations in preoperative clinic for patients undergoing cancer surgery for a pilot period. Data were collected regarding usage of the template. Focus groups with surgeons, APPs, and patients were conducted. Qualitative analysis was performed on transcripts. During the pilot, 7 surgeon/APP teams utilized the template on a total of 55 notes. Average number of notes completed per surgeon was 7.8 (SD 8.5). Forty-six notes (84%) included topics of discussion, 15 (27%) included PV, 4 (7%) included ACP. Qualitative analysis of focus group transcripts revealed that clinicians and patients perceived the initiative to be useful and important, although implementation barriers were identified. Creating a surgery-specific GOC template is feasible. Iterative revisions are needed to increase utility in clinic workflows.

Standardization of Emergency Department Clinical Note Templates: A Retrospective Analysis across an Integrated Health System.

Clinical documentation is essential for conveying medical decision-making, communication between providers and patients, and capturing quality, billing, and regulatory measures during emergency department (ED) visits. Growing evidence suggests the benefits of note template standardization; however, variations in documentation practices are common. The primary objective of this study is to measure the utilization and coding performance of a standardized ED note template implemented across a nine-hospital health system. This was a retrospective study before and after the implementation of a standardized ED note template. A multi-disciplinary group consensus was built around standardized note elements, provider note workflows within the electronic health record (EHR), and how to incorporate newly required medical decision-making elements. The primary outcomes measured included the proportion of ED visits using standardized note templates, and the distribution of billing codes in the 6 months before and after implementation. In the preimplementation period, a total of six legacy ED note templates were being used across nine EDs, with the most used template accounting for approximately 36% of ED visits. Marked variations in documentation elements were noted across six legacy templates. After the implementation, 82% of ED visits system-wide used a single standardized note template. Following implementation, we observed a 1% increase in the proportion of ED visits coded as highest acuity and an unchanged proportion coded as second highest acuity. We observed a greater than twofold increase in the use of a standardized ED note template across a nine-hospital health system in anticipation of the new 2023 coding guidelines. The development and utilization of a standardized note template format relied heavily on multi-disciplinary stakeholder engagement to inform design that worked for varied documentation practices within the EHR. After the implementation of a standardized note template, we observed better-than-anticipated coding performance.

Improving Family Medicine Residents' Provision of Gender-Affirming Care.

Family physicians are uniquely poised to provide gender-affirming care (GAC) to transgender and nonbinary patients, but current undergraduate and graduate medical education in this field is lacking. Little is known about the impact of various GAC curricula on the clinical care provided by resident physicians. We aimed to assess the efficacy of a multimodal educational framework on the quality of GAC provided by residents at a large academic family medicine program. This pilot study used chart review to assess the impact of a multifaceted educational intervention around GAC in an academic family medicine practice. Components included faculty-specific didactics, resident feedback and didactics, standardized note templates, and compiled resources. We completed pre- and postintervention analysis of resident-led GAC encounters using a novel rubric based on standards of care and compared these results using descriptive statistics. Following a multimodal educational intervention, residents demonstrated improvement in multiple domains of gender-affirming care, including documenting informed consent, counseling on pregnancy and contraception, and laboratory monitoring for patients initiating gender-affirming hormone therapy. This widespread improvement suggested that a multimodal approach to resident and faculty education may help enhance the quality of GAC provided by family medicine residents. Chart review offers a feasible and effective method for identifying gaps in resident knowledge and documentation in GAC. Further research should specifically explore faculty development in this area and expanded patient-centered quality metrics and outcomes that encompass GAC.

Development and Evaluation of I-PASS-to-PICU: A Standard Electronic Template to Improve Referral Communication for Interfacility Transfers to the Pediatric ICU

Miscommunication during interfacility handoffs to a higher level of care can harm critically ill children. Adapting evidence-based handoff interventions to interfacility referral communication may prevent adverse events. The objective of this project was to develop and evaluate a standard electronic referral template (I-PASS-to-PICU) to improve communication for interfacility pediatric ICU (PICU) transfers. I-PASS-to-PICU was iteratively developed in a single PICU. A core PICU stakeholder group collaboratively designed an electronic health record (EHR)-supported clinical note template by adapting elements from I-PASS, an evidence-based handoff program, to support information exchange between referring clinicians and receiving PICU physicians. I-PASS-to-PICU is a receiver-driven tool used by PICU physicians to guide verbal communication and electronic documentation during PICU transfer calls. The template underwent three cycles of iterative evaluation and redesign informed by individual and group interviews of multidisciplinary PICU staff, usability testing using simulated and actual referral calls, and debriefing with PICU physicians. Individual and group interviews with 21 PICU staff members revealed that relevant, accurate, and concise information was needed for adequate admission preparedness. Time constraints and secondhand information transmission were identified as barriers. Usability testing with six receiving PICU physicians using simulated and actual calls revealed good usability on the validated System Usability Scale (SUS), with a mean score of 77.5 (standard deviation 10.9). Fellows indicated that most fields were relevant and that the template was feasible to use. I-PASS-to-PICU was technically feasible, usable, and relevant. The authors plan to further evaluate its effectiveness in improving information exchange during real-time PICU practice.

Making the EHR Work for You-Modifications of an Electronic Health Record System to Improve Tracking and Management of Patients Receiving Outpatient Parenteral Antibiotic Therapy.

Managing the complex needs of outpatient parenteral antibiotic therapy (OPAT) patients is challenging and time-consuming. We describe development of multimodal interventions to facilitate patient management within an Epic® (Epic Systems Corporation)-based electronic health record (EHR) platform. During 2016-2018, a multidisciplinary team created several modifications in our local EHR to improve gaps in OPAT care, including shared note templates, shared patient lists, automatically triggered notifications, and comprehensive order sets. A SmartForm was created, allowing collection of discrete, self-contained extractable data about each OPAT episode. We reviewed OPAT episodes from January 2019 through December 2022. The multimodal EHR interventions culminated in the creation of a patient report, the "OPAT Monitoring View" collating OPAT-relevant data from multiple sections of the chart onto 1 screen display. This view is accessible both within the patient chart and from multiple list-based, in-basket, and snapshot-anchored preview functions in the EHR. Implementation of the EHR bundle facilitated management of 3402 OPAT episodes from 2019 to 2022 (850 episodes/year), about 50% higher than anticipated based on 540 OPAT courses in 2016. The OPAT EHR bundle allowed efficient (<3 hours) multidisciplinary rounds for management of 130-145 patients each week, streamlining of care transitions, and increasing staff satisfaction. Bundled multimodal modifications to the local EHR increased patient care efficiency and staff satisfaction and facilitated data collection to support a large OPAT program. These modifications apply commonly available EHR functionalities to OPAT care and could be adapted to other settings with different EHR platforms.

Flip the Script: Changing Documentation Standards and Establishing Best Practices for Pharmacists in a Primary Care Setting.

Documentation of clinical encounters continues to be a challenge to implement in practice and there is a lack of literature on documentation best practices in pharmacy. In order to inform documentation practices at an academic pharmacy clinic, a quality assurance (QA) initiative was implemented at the UBC Pharmacists Clinic (the Clinic). The goal of this QA initiative was to determine what facilitators and barriers to documentation existed for Clinic pharmacists and improve the efficiency of consultation note writing. Phase 1 conducted an online survey to assess each pharmacist's documentation practice at baseline. Phase 2 implemented new interventions that could advance these skills. There were five main interventions introduced: 1) revised consultation note templates, 2) a documentation "checklist", 3) a documentation "decision tree", 4) a clinical documentation guide and 5) a documentation peer-feedback workshop. During Phase 3, pharmacists re-answered the same survey questions 10 months later. This allowed for a direct comparison of documentation practices and skills before and after the interventions. After the interventions, pharmacists reduced the time to complete their notes by nearly 14 min. The revised note structure resulted in an increased uptake of template use from 37% to 100%. Furthermore, prior to the interventions, the majority of pharmacists ranked writing consultation notes as the most burdensome aspect of their daily workflow. Afterwards, the perceived level of burden reduced significantly. These findings can be used to inform how students are taught documentation and improve the quality of documentation by pharmacists in team-based or primary care settings.

Assessment of manual operation note documentation practice: a cross-sectional study.

Operation note documentation captures the key findings and subtle elements of a surgical strategy and is crucial for patient safety. Poor operation note documentation can negatively influence postoperative patient care. This study aimed to assess manual operation note documentation practice. An institutional-based, cross-sectional study was conducted from 30 March to 30 April 2022, on 240 operation notes of patient data. Data were entered and analyzed by SPSS version 20. According to the RCSE, the Royal College of Surgeons of England, the practice of operation note documentation was rated excellent for each variable when it met 100%, good if it met more than 50%, and poor if it met less than 50% of the operation notes of patient data. All operation notes (n=240) were handwritten. The practice of manual operation note documentation was deemed excellent in two (7.69%), good in 18 (69.2%), and poor in six (23.1%). Residents wrote 84.2% of the operation notes and surgeons and assistants were identified in greater than 94% of the notes, while anesthesia team members were identified in 90.8%. Estimated blood loss was documented in 4.2% of the notes, and the closure technique was described in 64.2%. The operation note templates did not include antibiotic prophylaxis, runner nurse name, or gauze and instrument counts. The urgency of the surgery and time of documentation had a negative relationship, and the seniority of the operation note writer had a positive relationship with manual operative note documentation practice. Compared to the standard, all operation note documentation was incomplete and below the standard. We recommend that this comprehensive and specialized hospital administrator implement a new format for operation notes that incorporates RCSE requirements.