Health Services Research Research Articles

Using natural language processing in emergency medicine health service research: A systematic review and meta-analysis.

Natural language processing (NLP) represents one of the adjunct technologies within artificial intelligence and machine learning, creating structure out of unstructured data. This study aims to assess the performance of employing NLP to identify and categorize unstructured data within the emergency medicine (EM) setting. We systematically searched publications related to EM research and NLP across databases including MEDLINE, Embase, Scopus, CENTRAL, and ProQuest Dissertations & Theses Global. Independent reviewers screened, reviewed, and evaluated article quality and bias. NLP usage was categorized into syndromic surveillance, radiologic interpretation, and identification of specific diseases/events/syndromes, with respective sensitivity analysis reported. Performance metrics for NLP usage were calculated and the overall area under the summary of receiver operating characteristic curve (SROC) was determined. A total of 27 studies underwent meta-analysis. Findings indicated an overall mean sensitivity (recall) of 82%-87%, specificity of 95%, with the area under the SROC at 0.96 (95% CI 0.94-0.98). Optimal performance using NLP was observed in radiologic interpretation, demonstrating an overall mean sensitivity of 93% and specificity of 96%. Our analysis revealed a generally favorable performance accuracy in using NLP within EM research, particularly in the realm of radiologic interpretation. Consequently, we advocate for the adoption of NLP-based research to augment EM health care management.

Family Involvement in the Care of Hospitalized Older Adults: Protocol for a Qualitative Evidence Synthesis.

Older adults are frequently hospitalized. Family involvement during these hospitalizations is incompletely characterized in the literature. This study aimed to better understand how families are involved in the care of hospitalized older adults and develop a conceptual model describing the phenomenon of family involvement in the care of hospitalized older adults. We describe the protocol of a qualitative evidence synthesis (QES), a systematic review of qualitative studies. We chose to focus on qualitative studies given the complexity and multifaceted nature of family involvement in care, a type of topic best understood through qualitative inquiry. The protocol describes our process of developing a research question and eligibility criteria for inclusion in our QES based on the SPIDER (Sample, Phenomenon of Interest, Design, Evaluation, and Research type) tool. It describes the development of our search strategy, which was used to search MEDLINE (via Ovid), Embase (via Elsevier), PsycINFO (via Ovid), and CINAHL Complete (via EBSCO). Title and abstract screening and full-text screening will occur sequentially. Purposive sampling may be used depending on the volume of studies identified as eligible for inclusion during our screening process. Descriptive data regarding included individual studies will be extracted and summarized in tables. The results from included studies will be synthesized using qualitative methods and used to develop a conceptual model. The conceptual model will be presented to community members via engagement panels for further refinement. As of September 2023, we have assembled a multidisciplinary team including physicians, nurses, health services researchers, a librarian, a social worker, and a health economist. We have finalized our search strategy and executed the search, yielding 8862 total citations. We are currently screening titles and abstracts and anticipate that full-text screening, data extraction, quality appraisal, and synthesis will be completed by summer of 2024. Conceptual model development will then take place with community engagement panels. We anticipate submitting our manuscript for publication in the fall of 2024. This paper describes the protocol for a QES of family involvement in the care of hospitalized older adults. We will use identified themes to create a conceptual model to inform further intervention development and policy change. PROSPERO 465617; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023465617. PRR1-10.2196/53255.

Development and validation of the Trust in Multidimensional Healthcare Systems Scale (TIMHSS)

ContextThe COVID-19 pandemic has reignited a commitment from the health policy and health services research communities to rebuilding trust in healthcare and created a renewed appetite for measures of trust for system monitoring and evaluation. The aim of the present paper was to develop a multidimensional measure of trust in healthcare that: (1) Is responsive to the conceptual and methodological limitations of existing measures; (2) Can be used to identify systemic explanations for lower levels of trust in equity-deserving populations; (3) Can be used to design and evaluate interventions aiming to (re)build trust.MethodsWe conducted a 2021 review of existing measures of trust in healthcare, 72 qualitative interviews (Aug-Dec 2021; oversampling for equity-deserving populations), an expert review consensus process (Oct 2021), and factor analyses and validation testing based on two waves of survey data (Nov 2021, n = 694; Jan-Feb 2022, n = 740 respectively).FindingsWe present the Trust in Multidimensional Healthcare Systems Scale (TIMHSS); a 38-item correlated three-factor measure of trust in doctors, policies, and the system. Measurement of invariance tests suggest that the TIMHSS can also be reliably administered to diverse populations.ConclusionsThis global measure of trust in healthcare can be used to measure trust over time at a population level, or used within specific subpopulations, to inform interventions to (re)build trust. It can also be used within a clinical setting to provide a stronger evidence base for associations between trust and therapeutic outcomes.

Does the Innovation Fund Improve Healthcare Provision? A Critical Assessment of the Status of Implementing Successful Innovation Fund Projects into Healthcare Practice

Since 2015, the Federal Joint Committee (G-BA)'s Innovation Fund has been supporting projects in health services research and new health service models ("Neue Versorgungsformen", NVF). By the end of 2022, 211 projects in the NVF category had been funded. A key objective is the transfer of successful projects into standard care. This article analyzes previous projects regarding their incorporation into routine care based on transfer recommendations of the Innovation Fund Committee ("Innovationsausschuss" IA). Descriptive analysis of all projects completed by August 1, 2023 with transfer recommendations in the "NVF" funding stream. Presentation by topic, project duration, time until IA transfer decision, categorization, and number of institutions and organizations (recipients) addressed per project, their feedback published on the G-BA website, response rates per recipient group, and a content classification and interpretation of exemplary feedback. Recommendations based on the results and their discussion in an expert workshop. Out of 57 NVF projects, 17 had a transfer recommendation. A total of 57 feedback responses were received from a total of 431 recipients addressed by the IA across these projects. Response rates varied significantly. One-third of inquiries to the G-BA and its member organizations received a response (31%), while only every fifth inquiry to federal states (18%) and professional societies (18%) got a response. Less than one in ten inquiries to the Federal Ministry of Health (8%), administrative bodies (6%), and the German Medical Association (0%) received a response. Project-specific feedback within a recipient group was often contradictory or limited to regional scope. The transfer process reveals significant structural and procedural obstacles regarding the incorporation of projects evaluated as successful into routine health care. To ensure that funding from the innovation fund is most effectively used, there needs to be a realistic chance of successful transfer of positive project outcomes into routine care. The DNVF recommends stronger involvement of rule-competent institutions, mandatory publication of responses, structured moderation of the transfer process, expanding types of selective contracts, financing of implementation phases and of studies drawing on results across successful NVF projects.

Patient experiences of information-sharing and patient-centred care across the broad landscape of primary care practice and provision: a nationally representative survey of Australian adults

BackgroundAustralian government strategies and frameworks have been developed in recent years to encourage the integration and coordination of primary care delivery; including patient-centred approaches to clinical and preventative care, and health promotion. This study aims to explore patient experiences of information-sharing and patient-centred care across various primary care clinical settings, with a particular focus on clinical encounters with GPs, naturopaths, osteopaths and acupuncturists.MethodsData about healthcare utilisation and experiences from a 63-item cross-sectional survey obtained from a nationally representative sample of Australian adults aged ≥ 18 years were analysed. Chi-square and Kruskal-Wallis H tests were used to explore differences in the experiences of knowledge and information sharing during GP consultations among those who also consulted with a naturopath, osteopath or acupuncturist, compared those who had not. Logistic regression was used to investigate correlations between participants perceptions about GP consultation outcomes, and the GP’s information-sharing behaviour or perceived experience of patient-centredness.ResultsAcross 2354 participants, verbal explanation (76.3%) and/or individualised handouts (16.8%) were the most common type of information shared in GP consultations. Individuals who consulted with a GP and a naturopath, an osteopath, or an acupuncturist reported a lower rate of receiving a verbal explanation from their GP but higher rate of receiving other types of information sources including handouts. Over one quarter of study participants who visited a GP did not discuss any of their health information with their GP. Information sharing was lower for individuals who also visited a naturopath, osteopath or acupuncturist. Participants scored their consultations with a GP as patient-centred, but these scores were lower among participants who also consulted with at least one other primary care practitioner type included in the study.ConclusionsPublic health and health services researchers, policymakers and leaders of primary care professions have a role and responsibility to ensure practitioners are confident and competent in sharing health information with their patients that considers their health literacy needs, and the importance of patient-centred care. Research focussed on a more in-depth understanding of the differences and relationships observed across the primary care landscape in this study is recommended.

The role of governance in shaping health system reform: a case study of the design and implementation of new health regions in Ireland, 2018–2023

BackgroundEffective governance arrangements are central to the successful functioning of health systems. While the significance of governance as a concept is acknowledged within health systems research, its interplay with health system reform initiatives remains underexplored in the literature. This study focuses on the development of new regional health structures in Ireland in the period 2018–2023, one part of a broader health system reform programme aimed at greater universalism, in order to scrutinise how aspects of governance impact on the reform process, from policy design through to implementation.MethodsThis qualitative, multi-method study draws on document analysis of official documents relevant to the reform process, as well as twelve semi-structured interviews with key informants from across the health sector. Interviews were analysed according to thematic analysis methodology. Conceiving governance as comprising five domains (Transparency, Accountability, Participation, Integrity, Capacity) the research uses the TAPIC framework for health governance as a conceptual starting point and as initial, deductive analytic categories for data analysis.ResultsThe analysis reveals important lessons for policymakers across the five TAPIC domains of governance. These include deficiencies in accountability arrangements, poor transparency within the system and vis-à-vis external stakeholders and the public, and periods during which a lack of clarity in terms of roles and responsibilities for various process and key decisions related to the reform were identified. Inadequate resourcing of implementation capacity, competing policy visions and changing decision-making arrangements, among others, were found to have originated in and continuously reproduced a lack of trust between key institutional actors. The findings highlight how these challenges can be addressed through strengthening governance arrangements and processes. Importantly, the research reveals the interwoven nature of the five TAPIC dimensions of governance and the need to engage with the complexity and relationality of health system reform processes.ConclusionsLarge scale health system reform is a complex process and its governance presents distinct challenges and opportunities for stakeholders. To understand and be able to address these, and to move beyond formulaic prescriptions, critical analysis of the historical context surrounding the policy reform and the institutional relationships at its core are needed.

Systematic Review of Surgical Care in the Incarcerated Population: Identifying Knowledge Gaps for Future Research

Objective: This study, examining literature up to December 2023, aims to comprehensively assess surgical care for incarcerated individuals, identifying crucial knowledge gaps for informing future health services research and interventions. Background: The US prison system detains around 2 million individuals, mainly young, indigent males from ethnic and racial minorities. The constitutional right to healthcare does not protect this population from unique health challenges and disparities. The scarcity of literature on surgical care necessitates a systematic review to stimulate research, improve care quality, and address health issues within this marginalized community. Methods: A systematic review, pre-registered with the International Prospective Register of Systematic Reviews (CRD42023454782), involved searches in PubMed, Embase, and Web of Science. Original research on surgical care for incarcerated individuals was included, excluding case reports/series (<10 patients), abstracts, and studies involving prisoners of war, plastic surgeries for recidivism reduction, transplants using organs from incarcerated individuals, and nonconsensual surgical sterilization. Results: Out of 8209 studies screened, 118 met inclusion criteria, with 17 studies from 16 distinct cohorts reporting on surgical care. Predominantly focusing on orthopedic surgeries, supplemented by studies in emergency general, burns, ophthalmology, and kidney transplantation, the review identified delayed hospital presentations, a high incidence of complex cases, and low postoperative follow-up rates. Notable complications, such as nonfusion and postarthroplasty infections, were more prevalent in incarcerated individuals compared with nonincarcerated individuals. Trauma-related mortality rates were similar, despite lower intraabdominal injuries following penetrating abdominal injuries in incarcerated patients. Conclusion: While some evidence suggests inferior surgical care in incarcerated patients, the limited quality of available studies underscores the urgency of addressing knowledge gaps through future research. This is crucial for patients, clinicians, and policymakers aiming to enhance care quality for a population at risk of surgical complications during incarceration and postrelease.

Self-Reported Social Determinants of Health and Area-Level Social Vulnerability.

Many health care systems are investing resources in identifying social determinants of health (SDoH) needs and facilitating interventions among the populations they serve. Because self-reported SDoH information is lacking, area-level measures are often used to estimate needs and direct resources. To describe the large-scale deployment of SDoH assessments by a health system and determine the extent to which self-reported SDoH needs identified therein are associated with census tract-level social vulnerability measured using the Social Vulnerability Index (SVI). This cross-sectional study assessed SDoH needs between January 1, 2020, and April 30, 2023, in both payer and clinical care settings. Modalities included telephonic outreach, face-to-face clinical interactions, self-entry into a tablet or kiosk, and web-based survey tools. Participants included individuals who responded to the assessment and had sufficient information for census tract identification. Respondents included both Highmark Health Plan members and nonmembers. Health plan members responded to the assessment through health plan programs or platforms, and both members and nonmembers responded to assessments during inpatient or outpatient encounters with the affiliated health system. Overall and domain-specific SDoH needs self-reported through assessments, and severity and complexity of needs identified. Residential social vulnerability measures included overall SVI and the 4 conceptual themes comprising overall SVI. In total, 841 874 assessments were recorded for 401 697 individuals (55.1% women; median [IQR] age, 55 [41-70] years). Social determinants of health needs were identified in 120 769 assessments (14.3%). Across all SDoH domains, increasing SVI was associated with a higher positivity rate (eg, 11.2% of those residing in the lowest-risk SVI quintile reported a need compared with 22.7% among those residing in the highest-risk quintile). Associations varied by SDoH domain and SVI theme. After adjusting for demographic and screening characteristics, odds of positive screening among those residing in the highest-risk SVI quintile were 1.74 (95% CI, 1.62-1.86) to 3.73 (95% CI, 3.48-4.00) times the odds among those residing in lowest risk quintile. In this cross-sectional study, the overall level of SDoH needs generally corresponded to area-level vulnerability. Some SDoH domains appeared far more sensitive to community characteristics than others. Notably, even among individuals from the highest-risk areas, the positive screening rate was roughly 1 in 4. These findings underscore the importance of individual-level SDoH data for service provision planning and health services research.

Health Services Research: Value of Care: Cost and Outcomes I (PD08)

Health Services Research: Value of Care: Cost and Outcomes I (PD08)

Health Services Research: Quality Improvement & Patient Safety I (MP02)

Health Services Research: Quality Improvement & Patient Safety I (MP02)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making II (MP24)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making II (MP24)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making I (MP12)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making I (MP12)

Health Services Research: Value of Care: Cost and Outcomes II (MP57)

Health Services Research: Value of Care: Cost and Outcomes II (MP57)

Health Services Research: Quality Improvement & Patient Safety II (MP33)

Health Services Research: Quality Improvement & Patient Safety II (MP33)

Health Services Research: Quality Improvement & Patient Safety III (PD62)

Health Services Research: Quality Improvement & Patient Safety III (PD62)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making III (PD40)

Health Services Research: Practice Patterns, Quality of Life and Shared Decision Making III (PD40)

Factors that influence presentation to an emergency department during systemic anti-cancer therapy: An exploratory qualitative study

PurposeTo explore factors that influence presentation to an emergency department during ambulatory systemic anti-cancer therapy. DesignAn exploratory qualitative study using semi-structured interviews. MethodsA purposive sample of adult patients with any cancer who had commenced systemic anti-cancer therapy in the ambulatory setting up to six months prior participated in semi-structured interviews between November 2016 – December 2017. Interviews were transcribed verbatim, and data analysed thematically using a template analysis approach. ResultsTwenty patients and four caregivers took part. Five themes were generated from the interview data: 1) the unknown and unpredictable; 2) a change of lifestyle; 3) social determinants and access; 4) trust in care providers; and 5) the unavailability of care. ConclusionAs the number of systemic anti-cancer agents and patients eligible for them continues to grow, identifying, implementing and evaluating initiatives to mitigate emergency department presentations present an important area for health services research. Addressing timely access to trusted care and enhancing patient capacity for self-management present important areas for nurse-led system innovation. Findings from this study offer important insights into where and how nurses can mitigate emergency department presentations for individuals receiving systemic anti-cancer therapy by enabling accessible, coordinated and person-centred cancer care.

Early career researchers in health policy and systems research: insights from freelancers in a non-profit organization in the Philippines

BackgroundThe freelance economy has seen rapid growth worldwide in recent years and the Philippines is not an exception. Freelance workers are becoming increasingly common in healthcare and research. Early career researchers carry out most of scientific research and can play a critical role in advancing public health by bringing new perspectives and diversity to the field. Existing literature has mostly focused on the experiences of early career researchers in an institutional academic setting. This study aimed to understand the experiences of freelance early career researchers in the health policy and systems space in the Philippines.MethodsThis qualitative study collected data from 18 to 22 March 2022 through virtual interview and focus group discussions. Themes and codes were created based on the topic guide developed. New themes and codes were generated as they emerged. Two researchers coded the data using both a priori and emergent codes. Any coding conflicts were resolved through discussions until intercoder agreement was reached. Interpretation and conclusions from the data were developed by 2 researchers with consideration for its context and relationship between themes.ResultsFifteen current and former freelance researchers participated in the study. Most are female, under 35 years old, and with an undergraduate degree as the highest educational attainment. The findings highlight insights and challenges faced by early career researchers in aspects of: (1) work arrangement, (2) tasks, (3) expectations from senior researchers, (4) development in the health policy and systems field, (5) relationship with peers, and (6) motivations for continuing to work as a freelance health policy and systems researcher.ConclusionThis study reveals the challenges freelance early career researchers face, highlighting the need for enhanced support and recognition amidst rapidly evolving workforce demands and complex health dilemmas. Recommendations include structured mentorship, professional development, innovative funding models, and the establishment of a supportive network. Advocacy for policies ensuring freelancer inclusion in the economy and policy-making is crucial. Future research should investigate their experiences further, including their roles, transitions, and the impacts of funding trends, to foster their development and integration into public health research and policy.

Examining the Use and Application of the WHO Integrated People-Centred Health Services Framework in Research Globally - a Systematic Scoping Review.

The World Health Organisation (WHO) accepted the Integrated People-centred Health Services (IPCHS) framework in 2016 as an essential component for achieving universal health coverage in fragmented health systems. We aimed to examine the empirical applications of the WHO IPCHS framework to guide its use in strengthening health-service research. Academic databases and the IPCHS website were searched for relevant articles published between 2016 and July 2023. Two reviewers independently screened and extracted data on the study design, setting, IPCHS framework components, and facilitators and barriers to implementing the IPCHS strategies. Descriptive and content analyses were conducted. Six studies were identified using the IPCHS framework. Studies have examined a combination of the five IPCHS strategies. All studies reported building strong primary care-based systems and coordinating care for individuals. Continued relationships and trust, co-production of health programmes, diversity of health care team, and technology were major facilitators, while low health literacy, lack of primary setting capacity and healthcare workforce were principal barriers to IPCHS implementation. This scoping review offers an overview of IPCHS strategies employed in healthcare research. Generally, the IPCHS framework remains underutilised in primary research. These results offer guidance for future research to support effective healthcare delivery.

P071 Exploring experiences and preferences of people with rheumatoid arthritis for digital interventions to promote physical activity (PA)

Abstract Background/Aims Physical activity (PA) is effective for managing symptoms of rheumatoid arthritis (RA) but people with RA are less active than their healthy counterparts. A digital intervention (DI) to promote PA, is a potential solution. There is a paucity of literature available exploring the requirements of people with RA for a digital intervention. It is important to explore experiences and preferences before developing such an intervention. Aims: 1. Identify digital technology currently used by people with RA to support PA. 2. Understand the preferences and acceptability of people with RA for potential DI delivery. Methods A survey was developed to address these aims. A patient research partner (CS) and ‘think aloud’ pilots contributed to development. The survey was circulated once to members of the National Rheumatoid Arthritis Society in November 2022. This study was approved by the National Health Service Research Ethics Committee (reference 22/NE/0158). Results 1178 people consented to take part (86% female, 64% aged 55-74). The majority used digital technology every day (97%). 84% anticipated using a potential DI to support PA, most preferably every day (48%) or 2-3 times a week (14%). 16% never anticipated using DI to support PA. 34% reported currently using technology to support PA; mostly an app without healthcare professional (HCP) interaction (42%) or internet videos (40%). A further 27% had tried technology to support PA but discontinued, and 39% had never tried. An app was the most preferable delivery platform (56%), followed by a website (43%) or internet videos (28%). 51% would prefer to be offered or signposted to digital technology to support PA by an exercise professional with specific rheumatology training or a healthcare professional (22%). Potential DI delivery methods were rated on a Likert scale of 1-5 for general acceptability, a score of five indicating highest acceptability: automated response mean[SD] 3.6[0.9], ad-hoc HCP interaction 3.5[0.8] pre-arranged HCP interaction 3.4[1] and no interaction 3.1[1]. Conclusion People with RA are using digital technology regularly and many anticipated using a DI to support PA. Despite this, only a third are currently using digital technology to support PA. An app or website platform was the preferred delivery method suggesting that an internet delivered intervention is acceptable. Acceptability ratings of DI delivery methods were similar. Further sub-group analysis and exploration of free text responses is planned to inform tailoring of DI delivery. Disclosure C. Gerlis: None. A. Berry: None. S. Halls: None. M. Loizou: None. C. Swales: None. F. Cramp: None.