Accelerate Literature Icon
Want to do a literature review? Try our new Literature Review workflow

Impact of NHS 111 Online on the NHS 111 telephone service and urgent care system: a mixed-methods study

  • Abstract
  • Highlights & Summary
  • Literature Map
  • Similar Papers
Abstract
Translate article icon Translate Article Star icon

BackgroundThe NHS emergency and urgent care system is under pressure as demand for services increases each year. NHS 111 is a telephone triage service designed to provide advice and signposting to appropriate services for people with urgent health-care problems. A new service, NHS 111 Online, has been introduced across England as a digital alternative that can be accessed using a website or a smartphone application. The effects and usefulness of this service are unknown.ObjectivesTo explore the impact of NHS 111 Online on the related telephone service and urgent care system activity and the experiences of people who use those services.Design and methodsA mixed-methods design of five related work packages comprising an evidence review; a quantitative before-and-after time series analysis of changes in call activity (18/38 sites); a descriptive comparison of telephone and online services with qualitative survey (telephone,n = 795; online,n = 3728) and interview (32 participants) studies of service users; a qualitative interview study (16 participants) of staff; and a cost–consequences analysis.ResultsThe online service had little impact on the number of triaged calls to the NHS 111 telephone service. For every 1000 online contacts, triaged telephone calls increased by 1.3% (1.013, 95% confidence interval 0.996 to 1.029;p = 0.127). Recommendations to attend emergency and urgent care services increased between 6.7% and 4.2%. NHS 111 Online users were less satisfied than users of the telephone service (50% vs. 71%;p < 0.001), and less likely to recommend to others (57% vs. 69%;p < 0.001) and to report full compliance with the advice given (67.5% vs. 88%;p < 0.001). Online users were less likely to report contacting emergency services and more likely to report not making any contact with a health service (31% vs. 16%;p < 0.001) within 7 days of contact. Thirty-five per cent of online users reported that they did not want to use the telephone service, whereas others preferred its convenience and speed. NHS 111 telephone staff reported no discernible increase or decrease in their workload during the first year of operation of NHS 111 Online. If online and telephone services operate in parallel, then the annual costs will be higher unless ≥ 38% of telephone contacts move to online contacts.ConclusionsThere is some evidence that the new service has the potential to create new demand. The service has expanded significantly, so it is important to find ways of promoting the right balance in numbers of people who use the online service instead of the telephone service if it is to be effective. There is a clear need and preference by some people for an online service. Better information about when to use this service and improvements to questioning may encourage more uptake.LimitationsThe lack of control arm means that impact could have been an effect of other factors. This work took place during the early implementation phase, so findings may change as the service expands.Future workFurther development of the online triage process to make it more ‘user friendly’ and to enable users to trust the advice given online could improve use and increase satisfaction. Better understanding of the characteristics of the telephone and online populations could help identify who is most likely to benefit and could improve information about when to use the service.Trial registrationCurrent Controlled Trials ISRCTN51801112.FundingThis project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full inHealth Services and Delivery Research; Vol. 9, No. 21. See the NIHR Journals Library website for further project information.

Similar Papers
  • Research Article
  • Cite Count Icon 108
  • 10.1136/bmjopen-2013-003451
Impact of the urgent care telephone service NHS 111 pilot sites: a controlled before and after study
  • Nov 1, 2013
  • BMJ Open
  • J Turner + 3 more

ObjectivesTo measure the impact of the urgent care telephone service NHS 111 on the emergency and urgent care system.DesignControlled before and after study using routine data.SettingFour pilot sites and three...

  • Research Article
  • Cite Count Icon 360
  • 10.1111/acem.13220
Why Do People Choose Emergency and Urgent Care Services? A Rapid Review Utilizing a Systematic Literature Search and Narrative Synthesis.
  • Jun 19, 2017
  • Academic emergency medicine : official journal of the Society for Academic Emergency Medicine
  • Joanne E Coster + 3 more

ObjectivesRising demand for emergency and urgent care services is well documented, as are the consequences, for example, emergency department (ED) crowding, increased costs, pressure on services, and waiting times. Multiple factors have been suggested to explain why demand is increasing, including an aging population, rising number of people with multiple chronic conditions, and behavioral changes relating to how people choose to access health services. The aim of this systematic mapping review was to bring together published research from urgent and emergency care settings to identify drivers that underpin patient decisions to access urgent and emergency care.MethodsSystematic searches were conducted across Medline (via Ovid SP), EMBASE (via Ovid), The Cochrane Library (via Wiley Online Library), Web of Science (via the Web of Knowledge), and the Cumulative Index to Nursing and Allied Health Literature (CINAHL; via EBSCOhost). Peer‐reviewed studies written in English that reported reasons for accessing or choosing emergency or urgent care services and were published between 1995 and 2016 were included. Data were extracted and reasons for choosing emergency and urgent care were identified and mapped. Thematic analysis was used to identify themes and findings were reported qualitatively using framework‐based narrative synthesis.ResultsThirty‐eight studies were identified that met the inclusion criteria. Most studies were set in the United Kingdom (39.4%) or the United States (34.2%) and reported results relating to ED (68.4%). Thirty‐nine percent of studies utilized qualitative or mixed research designs. Our thematic analysis identified six broad themes that summarized reasons why patients chose to access ED or urgent care. These were access to and confidence in primary care; perceived urgency, anxiety, and the value of reassurance from emergency‐based services; views of family, friends, or healthcare professionals; convenience (location, not having to make appointment, and opening hours); individual patient factors (e.g., cost); and perceived need for emergency medical services or hospital care, treatment, or investigations.ConclusionsWe identified six distinct reasons explaining why patients choose to access emergency and urgent care services: limited access to or confidence in primary care; patient perceived urgency; convenience; views of family, friends, or other health professionals; and a belief that their condition required the resources and facilities offered by a particular healthcare provider. There is a need to examine demand from a whole system perspective to gain better understanding of demand for different parts of the emergency and urgent care system and the characteristics of patients within each sector.

  • Research Article
  • Cite Count Icon 15
  • 10.3310/hsdr08150
Drivers of ‘clinically unnecessary’ use of emergency and urgent care: the DEUCE mixed-methods study
  • Mar 1, 2020
  • Health Services and Delivery Research
  • Alicia O’Cathain + 16 more

Background There is widespread concern about the pressure on emergency and urgent services in the UK, particularly emergency ambulances, emergency departments and same-day general practitioner appointments. A mismatch between supply and demand has led to interest in what can be termed ‘clinically unnecessary’ use of services. This is defined by the research team in this study as ‘patients attending services with problems that are classified as suitable for treatment by a lower urgency service or self-care’. This is a challenging issue to consider because patients may face difficulties when deciding the best action to take, and different staff may make different judgements about what constitutes a legitimate reason for service use. Objectives To identify the drivers of ‘clinically unnecessary’ use of emergency ambulances, emergency departments and same-day general practitioner appointments from patient and population perspectives. Design This was a sequential mixed-methods study with three components: a realist review; qualitative interviews (n = 48) and focus groups (n = 3) with patients considered ‘clinically unnecessary’ users of these services, focusing on parents of young children, young adults and people in areas of social deprivation; and a population survey (n = 2906) to explore attitudes towards seeking care for unexpected, non-life-threatening health problems and to identify the characteristics of someone with a tendency for ‘clinically unnecessary’ help-seeking. Results From the results of the three study components, we found that multiple, interacting drivers influenced individuals’ decision-making. Drivers could be grouped into symptom related, patient related and health service related. Symptom-related drivers were anxiety or need for reassurance, which were caused by uncertainty about the meaning or seriousness of symptoms; concern about the impact of symptoms on daily activities/functioning; and a need for immediate relief of intolerable symptoms, particularly pain. Patient-related drivers were reduced coping capacity as a result of illness, stress or limited resources; fear of consequences when responsible for another person’s health, particularly a child; and the influence of social networks. Health service-related drivers were perceptions or previous experiences of services, particularly the attractions of emergency departments; a lack of timely access to an appropriate general practitioner appointment; and compliance with health service staff’s advice. Limitations Difficulty recruiting patients who had used the ambulance service to the interviews and focus groups meant that we were not able to add as much as we had anticipated to the limited evidence base regarding this service. Conclusions Patients use emergency ambulances, emergency departments and same-day general practitioner appointments when they may not need the level of clinical care provided by these services for a multitude of inter-related reasons that sometimes differ by population subgroup. Some of these reasons relate to health services, in terms of difficulty accessing general practice leading to use of emergency departments, and to population-learnt behaviour concerning the positive attributes of emergency departments, rather than to patient characteristics. Social circumstances, such as complex and stressful lives, influence help-seeking for all three services. Demand may be ‘clinically unnecessary’ but completely understandable when service accessibility and patients’ social circumstances are considered. Future work There is a need to evaluate interventions, including changing service configuration, strengthening general practice and addressing the stressors that have an impact on people’s coping capacity. Different subgroups may require different interventions. Study registration This study is registered as PROSPERO CRD42017056273. Funding This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 15. See the NIHR Journals Library website for further project information.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 8
  • 10.3310/hsdr09150
Synthesis for health services and policy: case studies in the scoping of reviews
  • Aug 1, 2021
  • Health Services and Delivery Research
  • Rob Anderson + 13 more

Background For systematic reviews to be rigorous, deliverable and useful, they need a well-defined review question. Scoping for a review also requires the specification of clear inclusion criteria and planned synthesis methods. Guidance is lacking on how to develop these, especially in the context of undertaking rapid and responsive systematic reviews to inform health services and health policy. Objective This report describes and discusses the experiences of review scoping of three commissioned research centres that conducted evidence syntheses to inform health and social care organisation, delivery and policy in the UK, between 2017 and 2020. Data sources Sources included researcher recollection, project meeting minutes, e-mail correspondence with stakeholders and scoping searches, from allocation of a review topic through to review protocol agreement. Methods We produced eight descriptive case studies of selected reviews from the three teams. From case studies, we identified key issues that shape the processes of scoping and question formulation for evidence synthesis. The issues were then discussed and lessons drawn. Findings Across the eight diverse case studies, we identified 14 recurrent issues that were important in shaping the scoping processes and formulating a review’s questions. There were ‘consultative issues’ that related to securing input from review commissioners, policy customers, experts, patients and other stakeholders. These included managing and deciding priorities, reconciling different priorities/perspectives, achieving buy-in and engagement, educating the end-user about synthesis processes and products, and managing stakeholder expectations. There were ‘interface issues’ that related to the interaction between the review team and potential review users. These included identifying the niche/gap and optimising value, assuring and balancing rigour/reliability/relevance, and assuring the transferability/applicability of study evidence to specific policy/service user contexts. There were also ‘technical issues’ that were associated with the methods and conduct of the review. These were choosing the method(s) of synthesis, balancing fixed and fluid review questions/components/definitions, taking stock of what research already exists, mapping versus scoping versus reviewing, scoping/relevance as a continuous process and not just an initial stage, and calibrating general compared with specific and broad compared with deep coverage of topics. Limitations As a retrospective joint reflection by review teams on their experiences of scoping processes, this report is not based on prospectively collected research data. In addition, our evaluations were not externally validated by, for example, policy and service evidence users or patients and the public. Conclusions We have summarised our reflections on scoping from this programme of reviews as 14 common issues and 28 practical ‘lessons learned’. Effective scoping of rapid, responsive reviews extends beyond information exchange and technical procedures for specifying a ‘gap’ in the evidence. These considerations work alongside social processes, in particular the building of relationships and shared understanding between reviewers, research commissioners and potential review users that may be reflective of consultancy, negotiation and co-production models of research and information use. Funding This report has been based on work commissioned by the National Institute for Health Research (NIHR) Health Services and Delivery Research (HSDR) programme as three university-based evidence synthesis centres to inform the organisation, delivery and commissioning of health and social care; at the University of Exeter (NIHR 16/47/22), the University of Sheffield (NIHR 16/47/17) and the University of York (NIHR 16/47/11). This report was commissioned by the NIHR HSDR programme as a review project (NIHR132708) within the NIHR HSDR programme. This project was funded by the NIHR HSDR programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 15. See the NIHR Journals Library website for further project information.

  • Research Article
  • Cite Count Icon 4
  • 10.3310/hsdr07330
Interventions to manage use of the emergency and urgent care system by people from vulnerable groups: a mapping review
  • Sep 1, 2019
  • Health Services and Delivery Research
  • Andrew Booth + 5 more

Background The NHS currently faces increasing demands on accident and emergency departments. Concern has been expressed regarding whether the needs of vulnerable groups are being handled appropriately or whether alternative methods of service delivery may provide more appropriate emergency and urgent care services for particular groups. Objective Our objective was to identify what interventions exist to manage use of the emergency and urgent care system by people from a prespecified list of vulnerable groups. We aimed to describe the characteristics of these interventions and examine service delivery outcomes (for patients and the health service) resulting from these interventions. Review methods We conducted an initial mapping review to assess the quantity and nature of the published research evidence relating to seven vulnerable groups (socioeconomically deprived people and families, migrants, ethnic minority groups, the long-term unemployed/inactive, people with unstable housing situations, people living in rural/isolated areas and people with substance abuse disorders). Databases, including MEDLINE and the Cumulative Index to Nursing and Allied Health Literature, and other sources were searched between 2008 and 2018. Quantitative and qualitative systematic reviews and primary studies of any design were eligible for inclusion. In addition, we searched for UK interventions and initiatives by examining press reports, commissioning plans and casebooks of ‘good practice’. We carried out a detailed intervention analysis, using an adapted version of the TIDieR (Template for Intervention Description and Replication) framework for describing interventions, and an analysis of current NHS practice initiatives. Results We identified nine different types of interventions: care navigators [three studies – moderate GRADE (Grading of Recommendations, Assessment, Development and Evaluations)], care planning (three studies – high), case finding (five studies – moderate), case management (four studies – high), front of accident and emergency general practice/front-door streaming model (one study – low), migrant support programme (one study – low), outreach services and teams (two studies – moderate), rapid access doctor/paramedic/urgent visiting services (one study – low) and urgent care clinics (one systematic review – moderate). Few interventions had been targeted at vulnerable populations; instead, they represented general population interventions or were targeted at frequent attenders (who may or may not be from vulnerable groups). Interventions supported by robust evidence (care navigators, care planning, case finding, case management, outreach services and teams, and urgent care clinics) demonstrated an effect on the general population, rather than specific population effects. Many programmes mixed intervention components (e.g. case finding, case management and care navigators), making it difficult to isolate the effect of any single component. Promising UK initiatives (front of accident and emergency general practice/front-door streaming model, migrant support programmes and rapid access doctor/paramedic/urgent visiting services) lacked rigorous evaluation. Evaluation should therefore focus on the clinical effectiveness and cost-effectiveness of these initiatives. Conclusions The review identified a limited number of intervention types that may be useful in addressing the needs of specific vulnerable populations, with little evidence specifically relating to these groups. The evidence highlights that vulnerable populations encompass different subgroups with potentially differing needs, and also that interventions seem particularly context sensitive. This indicates a need for a greater understanding of potential drivers for varying groups in specific localities. Limitations Resources did not allow exhaustive identification of all UK initiatives; the examples cited are indicative. Future work Research is required to examine how specific vulnerable populations differentially benefit from specific types of alternative service provision. Further exploration, using primary mixed-methods data and potentially realist evaluation, is required to explore what works for whom under what circumstances. Rigorous evaluation of UK initiatives is required, including a specific need for economic evaluations and for studies that incorporate effects on the wider emergency and urgent care system. Funding The National Institute for Health Research Health Services and Delivery Research programme.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 3
  • 10.3310/ytrr9821
A multimethod study of NHS 111 online.
  • Jun 1, 2023
  • Health and social care delivery research
  • Joanne Turnbull + 9 more

NHS 111 online offers 24-hour access to health assessment and triage. This study examined pathways to care, differential access and use, and workforce impacts of NHS 111 online. This study compared NHS 111 with Healthdirect (Haymarket, Australia) virtual triage. Interviews with 80 staff and stakeholders in English primary, urgent and emergency care, and 41 staff and stakeholders associated with Healthdirect. A survey of 2754 respondents, of whom 1137 (41.3%) had used NHS 111 online and 1617 (58.7%) had not. NHS 111 online is one of several digital health-care technologies and was not differentiated from the NHS 111 telephone service or well understood. There is a similar lack of awareness of Healthdirect virtual triage. NHS 111 and Healthdirect virtual triage are perceived as creating additional work for health-care staff and inappropriate demand for some health services, especially emergency care. One-third of survey respondents reported that they had not used any NHS 111 service (telephone or online). Older people and those with less educational qualifications are less likely to use NHS 111 online. Respondents who had used NHS 111 online reported more use of other urgent care services and make more cumulative use of services than those who had not used NHS 111 online. Users of NHS 111 online had higher levels of self-reported eHealth literacy. There were differences in reported preferences for using NHS 111 online for different symptom presentations. Greater clarity about what the NHS 111 online service offers would allow better signposting and reduce confusion. Generic NHS 111 services are perceived as creating additional work in the primary, urgent and emergency care system. There are differences in eHealth literacy between users and those who have not used NHS 111 online, and this suggests that 'digital first' policies may increase health inequalities. This research bridged the pandemic from 2020 to 2021; therefore, findings may change as services adjust going forward. Surveys used a digital platform so there is probably bias towards some level of e-Literacy, but this also means that our data may underestimate the digital divide. Further investigation of access to digital services could address concerns about digital exclusion. Research comparing the affordances and cost-benefits of different triage and assessment systems for users and health-care providers is needed. Research about trust in virtual assessments may show how duplication can be reduced. Mixed-methods studies looking at outcomes, impacts on work and costs, and ways to measure eHealth literacy, can inform the development NHS 111 online and opportunities for further international shared learning could be pursued. This study is registered at the research registry (UIN 5392). This project was funded by the National Institute for Health and Care Research (NIHR) Health and Social Care Delivery Research Programme and will be published in full in Health and Social Care Delivery Research; Vol. 11, No. 5. See the NIHR Journals Library website for further project information.

  • Abstract
  • 10.1136/emermed-2022-999.27
PP27 NHS 111 staff and user views of online NHS 111: a useful adjunct to the NHS 111 telephone service
  • Aug 23, 2022
  • Emergency Medicine Journal
  • Fiona C Sampson + 4 more

IntroductionIn 2018 the online NHS111 service was introduced in response to increasing and unsustainable demand for NHS111 telephone service. We explored user and staff perspectives of the online service to...

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 3
  • 10.3310/hsdr08330
Publication and related bias in quantitative health services and delivery research: a multimethod study
  • Aug 1, 2020
  • Health Services and Delivery Research
  • Abimbola A Ayorinde + 6 more

Background Bias in the publication and reporting of research findings (referred to as publication and related bias here) poses a major threat in evidence synthesis and evidence-based decision-making. Although this bias has been well documented in clinical research, little is known about its occurrence and magnitude in health services and delivery research. Objectives To obtain empirical evidence on publication and related bias in quantitative health services and delivery research; to examine current practice in detecting/mitigating this bias in health services and delivery research systematic reviews; and to explore stakeholders’ perception and experiences concerning such bias. Methods The project included five distinct but interrelated work packages. Work package 1 was a systematic review of empirical and methodological studies. Work package 2 involved a survey (meta-epidemiological study) of randomly selected systematic reviews of health services and delivery research topics (n = 200) to evaluate current practice in the assessment of publication and outcome reporting bias during evidence synthesis. Work package 3 included four case studies to explore the applicability of statistical methods for detecting such bias in health services and delivery research. In work package 4 we followed up four cohorts of health services and delivery research studies (total n = 300) to ascertain their publication status, and examined whether publication status was associated with statistical significance or perceived ‘positivity’ of study findings. Work package 5 involved key informant interviews with diverse health services and delivery research stakeholders (n = 24), and a focus group discussion with patient and service user representatives (n = 8). Results We identified only four studies that set out to investigate publication and related bias in health services and delivery research in work package 1. Three of these studies focused on health informatics research and one concerned health economics. All four studies reported evidence of the existence of this bias, but had methodological weaknesses. We also identified three health services and delivery research systematic reviews in which findings were compared between published and grey/unpublished literature. These reviews found that the quality and volume of evidence and effect estimates sometimes differed significantly between published and unpublished literature. Work package 2 showed low prevalence of considering/assessing publication (43%) and outcome reporting (17%) bias in health services and delivery research systematic reviews. The prevalence was lower among reviews of associations than among reviews of interventions. The case studies in work package 3 highlighted limitations in current methods for detecting these biases due to heterogeneity and potential confounders. Follow-up of health services and delivery research cohorts in work package 4 showed positive association between publication status and having statistically significant or positive findings. Diverse views concerning publication and related bias and insights into how features of health services and delivery research might influence its occurrence were uncovered through the interviews with health services and delivery research stakeholders and focus group discussion conducted in work package 5. Conclusions This study provided prima facie evidence on publication and related bias in quantitative health services and delivery research. This bias does appear to exist, but its prevalence and impact may vary depending on study characteristics, such as study design, and motivation for conducting the evaluation. Emphasis on methodological novelty and focus beyond summative assessments may mitigate/lessen the risk of such bias in health services and delivery research. Methodological and epistemological diversity in health services and delivery research and changing landscape in research publication need to be considered when interpreting the evidence. Collection of further empirical evidence and exploration of optimal health services and delivery research practice are required. Study registration This study is registered as PROSPERO CRD42016052333 and CRD42016052366. Funding This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 33. See the NIHR Journals Library website for further project information.

  • Research Article
  • Cite Count Icon 18
  • 10.1177/1355819615596543
Variation in avoidable emergency admissions: multiple case studies of emergency and urgent care systems.
  • Aug 5, 2015
  • Journal of Health Services Research & Policy
  • Alicia O’Cathain + 5 more

To identify factors affecting variation in avoidable emergency admissions that are not usually identified in statistical regression. As part of an ethnographic residual analysis, we compared six emergency and urgent care systems in England, interviewing 82 commissioners and providers of key emergency and urgent care services. There was variation between the six cases in how interviewees described three parts of their emergency and urgent care systems. First, interviewees' descriptions revealed variation in the availability of services before patients decided to attend emergency departments. Poor availability of general practice out of hours services in some of the cases reportedly made attendance at emergency departments the easier option for patients. Second, there was variation in how interviewees described patients being dealt with during their emergency department visit in terms of availability of senior review by specialists and in coding practices when patients were at risk of breaching the NHS's 4-hour waiting time target. Third, there was variability in services described as facilitating discharge home from emergency departments. In some cases, emergency department staff described dealing with multiple agencies in multiple localities outside the hospital, making admission the easier option. In other cases, proactive multidisciplinary rapid assessment teams were described as available to avoid admissions. Perceptions of resources available out of hours and the extent of integration between different health services, and between health and social services, also differed by case. This comparative case study approach identified further factors that may affect avoidable emergency admissions. Initiatives to improve GP out of hours services, make coding more accurately reflect patient experience, increase senior review in emergency departments, offer proactive multidisciplinary admission avoidance teams, improve the availability of out of hours care in the wider emergency and urgent care system, and increase service integration may reduce avoidable admissions. Evaluation of such initiatives would be necessary before wide-scale adoption.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 20
  • 10.3310/hsdr09110
Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review
  • May 1, 2021
  • Health Services and Delivery Research
  • Tristan Price + 9 more

BackgroundAn underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.ObjectivesTo (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.DesignA realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.Data sourcesSearches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.Review methodsRealist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.ResultsA total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.LimitationsLimitations were the low quality of included literature and limited number of UK-based studies.Future workFuture work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.Study registrationThis study is registered as PROSPERO CRD42018088779.FundingThis project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full inHealth Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 6
  • 10.3390/healthcare11182537
Identifying Social Determinants and Measuring Socioeconomic Inequalities in the Use of Four Different Mental Health Services by Australian Adolescents Aged 13–17 Years: Results from a Nationwide Study
  • Sep 14, 2023
  • Healthcare
  • Md Irteja Islam + 3 more

Aim: In this study, we aimed to identify the determinants of four different forms of mental health service usage (general health services, school counselling, telephone, and online services), and the number of mental health services accessed (single and multiple) by Australian adolescents aged 13–17 years. We also measured socioeconomic inequality in mental health services’ usage following the concentration index approach within the same sample. Subject and Methods: The data came from the nationwide cross-sectional survey, Young Minds Matter (YMM): the second Australian Child and Adolescent Survey of Mental Health and Wellbeing. Random effect models were used to identify the factors associated with four different mental health services and the number of services accessed. Further, the Erreygers’ corrected concentration indices for binary variables were used to quantify the socioeconomic inequality in each mental health service. The four services were the general health service (GP, specialist, psychiatrist, psychologist, hospital including emergency), school services, telephone counselling and online services. Results: Overall, 31.9% of the total analytical sample (n = 2268) aged 13–17 years old visited at least one service, with 21.9% accessing a single service and 10% accessing multiple services. The highest percentage of adolescents used online services (20.1%), followed by general mental health services (18.3%), while school services (2.4%) were the least used service. Age, gender, family type and family cohesion statistically significantly increased the use of general health and multiple mental health service usage (p < 0.05). Area of residence was also found to be a significant factor for online service use. The concentration indices (CIs) were −0.073 (p < 0.001) and −0.032 (p < 0.001) for health and telephone services, respectively, which implies pro-rich socio-economic inequality. Conclusion: Adolescents from low-income families frequently used general mental health services and telephone services compared to those who belonged to high-income families. The study concluded that if we want to increase adolescents’ usage of mental health services, we need to tailor our approaches to their socioeconomic backgrounds. In addition, from a policy standpoint, a multi-sectoral strategy is needed to address the factors related to mental health services to reduce inequity in service utilisation.

  • PDF Download Icon
  • Research Article
  • Cite Count Icon 2
  • 10.3390/ijerph18179336
Barriers and Facilitators to the Uptake of Online and Telephone Services Targeting Health Risk Behaviours among Vocational Education Students: A Qualitative Study
  • Sep 3, 2021
  • International Journal of Environmental Research and Public Health
  • Prince Atorkey + 5 more

Uptake of online and telephone services targeting health behaviours is low among vocational education students and barriers and facilitators are unknown. This study aimed to explore barriers and facilitators to uptake of online and telephone services for smoking, nutrition, alcohol, and physical activity (SNAP) risk behaviours via semi-structured individual telephone interviews with fifteen vocational education students. Two authors independently completed thematic analysis, classified themes according to the COM-B (Capability, Opportunity, Motivation, Behaviour) framework, and discussed disagreements until consensus was reached. Facilitators to uptake of online (e.g., desire to learn something new, cost-free, accessible) and telephone services (e.g., prefer to talk to provider, complements online support) primarily related to capability and opportunity. For telephone services, difficulty understanding accent/language was a capability-related barrier. Opportunity-related barriers for online and telephone services were preference for face-to-face interaction and lack of time, while preference for apps/online programs was a barrier for telephone services. For online and telephone services, not wanting to change SNAP behaviours was a motivation-related barrier and being able to change SNAP risk behaviours themselves was a motivation-related barrier for online services. Barriers and facilitators to online and telephone services are relevant for designing interventions vocational education students are more likely to use.

  • Research Article
  • Cite Count Icon 73
  • 10.3310/hsdr03430
What evidence is there on the effectiveness of different models of delivering urgent care? A rapid review
  • Nov 1, 2015
  • Health Services and Delivery Research
  • Janette Turner + 7 more

BackgroundIn 2013 NHS England set out its strategy for the development of an emergency and urgent care system that is more responsive to patients’ needs, improves outcomes and delivers clinically excellent and safe care. Knowledge about the current evidence base on models for provision of safe and effective urgent care, and the gaps in evidence that need to be addressed, can support this process.ObjectiveThe purpose of the evidence synthesis is to assess the nature and quality of the existing evidence base on delivery of emergency and urgent care services and identify gaps that require further primary research or evidence synthesis.Data sourcesMEDLINE, EMBASE, The Cochrane Library, the Cumulative Index to Nursing and Allied Health Literature (CINAHL) and the Web of Science.MethodsWe have conducted a rapid, framework-based, evidence synthesis approach. Five separate reviews linked to themes in the NHS England review were conducted. One general and five theme-specific database searches were conducted for the years 1995–2014. Relevant systematic reviews and additional primary research papers were included and narrative assessment of evidence quality was conducted for each review.ResultsThe review was completed in 6 months. In total, 45 systematic reviews and 102 primary research studies have been included across all five reviews. The key findings for each review are as follows: (1) demand – there is little empirical evidence to explain increases in demand for urgent care; (2) telephone triage – overall, these services provide appropriate and safe decision-making with high patient satisfaction, but the required clinical skill mix and effectiveness in a system is unclear; (3) extended paramedic roles have been implemented in various health settings and appear to be successful at reducing the number of transports to hospital, making safe decisions about the need for transport and delivering acceptable, cost-effective care out of hospital; (4) emergency department (ED) – the evidence on co-location of general practitioner services with EDs indicates that there is potential to improve care. The attempt to summarise the evidence about wider ED operations proved to be too complex and further focused reviews are needed; and (5) there is no empirical evidence to support the design and development of urgent care networks.LimitationsAlthough there is a large body of evidence on relevant interventions, much of it is weak, with only very small numbers of randomised controlled trials identified. Evidence is dominated by single-site studies, many of which were uncontrolled.ConclusionsThe evidence gaps of most relevance to the delivery of services are (1) a requirement for more detailed understanding and mapping of the characteristics of demand to inform service planning; (2) assessment of the current state of urgent care network development and evaluation of the effectiveness of different models; and (3) expanding the current evidence base on existing interventions that are viewed as central to delivery of the NHS England plan by assessing the implications of increasing interventions at scale and measuring costs and system impact. It would be prudent to develop a national picture of existing pilot projects or interventions in development to support decisions about research commissioning.FundingThe National Institute for Health Research Health Services and Delivery Research Programme.

  • Research Article
  • Cite Count Icon 5
  • 10.3310/hsdr08240
Evaluating alcohol intoxication management services: the EDARA mixed-methods study
  • Jun 1, 2020
  • Health Services and Delivery Research
  • Simon C Moore + 11 more

Background Front-line health-care services are under increased demand when acute alcohol intoxication is most common, which is in night-time environments. Cities have implemented alcohol intoxication management services to divert the intoxicated away from emergency care. Objectives To evaluate the effectiveness, cost-effectiveness and acceptability to patients and staff of alcohol intoxication management services and undertake an ethnographic study capturing front-line staff’s views on the impact of acute alcohol intoxication on their professional lives. Methods This was a controlled mixed-methods longitudinal observational study with an ethnographic evaluation in parallel. Six cities with alcohol intoxication management services were compared with six matched control cities to determine effects on key performance indicators (e.g. number of patients in the emergency department and ambulance response times). Surveys captured the impact of alcohol intoxication management services on the quality of care for patients in six alcohol intoxication management services, six emergency departments with local alcohol intoxication management services and six emergency departments without local alcohol intoxication management services. The ethnographic study considered front-line staff perceptions in two cities with alcohol intoxication management services and one city without alcohol intoxication management services. Results Alcohol intoxication management services typically operated in cities in which the incidence of acute alcohol intoxication was greatest. The per-session average number of attendances across all alcohol intoxication management services was low (mean 7.3, average minimum 2.8, average maximum 11.8) compared with the average number of emergency department attendances per alcohol intoxication management services session (mean 78.8), and the number of patients diverted away from emergency departments, per session, required for services to be considered cost-neutral was 8.7, falling to 3.5 when ambulance costs were included. Alcohol intoxication management services varied, from volunteer-led first aid to more clinically focused nurse practitioner services, with only the latter providing evidence for diversion from emergency departments. Qualitative and ethnographic data indicated that alcohol intoxication management services are acceptable to practitioners and patients and that they address unmet need. There was evidence that alcohol intoxication management services improve ambulance response times and reduce emergency department attendance. Effects are uncertain owing to the variation in service delivery. Limitations The evaluation focused on health service outcomes, yet evidence arose suggesting that alcohol intoxication management services provide broader societal benefits. There was no nationally agreed standard operating procedure for alcohol intoxication management services, undermining the evaluation. Routine health data outcomes exhibited considerable variance, undermining opportunities to provide an accurate appraisal of the heterogenous collection of alcohol intoxication management services. Conclusions Alcohol intoxication management services are varied, multipartner endeavours and would benefit from agreed national standards. Alcohol intoxication management services are popular with and benefit front-line staff and serve as a hub facilitating partnership working. They are popular with alcohol intoxication management services patients and capture previously unmet need in night-time environments. However, acute alcohol intoxication in emergency departments remains an issue and opportunities for diversion have not been entirely realised. The nurse-led model was the most expensive service evaluated but was also the most likely to divert patients away from emergency departments, suggesting that greater clinical involvement and alignment with emergency departments is necessary. Alcohol intoxication management services should be regarded as fledgling services that require further work to realise benefit. Future work Research could be undertaken to determine if a standardised model of alcohol intoxication management services, based on the nurse practitioner model, can be developed and implemented in different settings. Future evaluations should go beyond the health service and consider outcomes more generally, especially for the police. Future work on the management of acute alcohol intoxication in night-time environments could recognise the partnership between health-care, police and ambulance services and third-sector organisations in managing acute alcohol intoxication. Trial registration Current Controlled Trials ISRCTN63096364. Funding This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 24. See the NIHR Journals Library website for further project information.

  • Research Article
  • Cite Count Icon 19
  • 10.3310/hsdr09020
Theory and practical guidance for effective de-implementation of practices across health and care services: a realist synthesis
  • Feb 1, 2021
  • Health Services and Delivery Research
  • Christopher R Burton + 12 more

BackgroundHealth-care systems across the globe are facing increased pressures to balance the efficient use of resources and at the same time provide high-quality care. There is greater requirement for services to be evidence based, but practices that are of limited clinical effectiveness or cost-effectiveness still occur.ObjectivesOur objectives included completing a concept analysis of de-implementation, surfacing decision-making processes associated with de-implementing through stakeholder engagement, and generating an evidence-based realist programme theory of ‘what works’ in de-implementation.DesignA realist synthesis was conducted using an iterative stakeholder-driven four-stage approach. Phase 1 involved scoping the literature and conducting stakeholder interviews to develop the concept analysis and an initial programme theory. In Phase 2, systematic searches of the evidence were conducted to test and develop this theory, expressed in the form of contingent relationships. These are expressed as context–mechanism–outcomes to show how particular contexts or conditions trigger mechanisms to generate outcomes. Phase 3 consisted of validation and refinement of programme theories through stakeholder interviews. The final phase (i.e. Phase 4) formulated actionable recommendations for service leaders.ParticipantsIn total, 31 stakeholders (i.e. user/patient representatives, clinical managers, commissioners) took part in focus groups and telephone interviews.Data sourcesUsing keywords identified during the scoping work and concept analysis, searches of bibliographic databases were conducted in May 2018. The databases searched were the Cochrane Library, Campbell Collaboration, MEDLINE (via EBSCOhost), the Cumulative Index to Nursing and Allied Health Literature (via EBSCOhost), the National Institute for Health Research Journals Library and the following databases via the ProQuest platform: Applied Social Sciences Index and Abstracts, Social Services Abstracts, International Bibliography of the Social Sciences, Social Sciences Database and Sociological Abstracts. Alerts were set up for the MEDLINE database from May 2018 to December 2018. Online sources were searched for grey literature and snowballing techniques were used to identify clusters of evidence.ResultsThe concept analysis showed that de-implementation is associated with five main components in context and over time: (1) what is being de-implemented, (2) the issues driving de-implementation, (3) the action characterising de-implementation, (4) the extent that de-implementation is planned or opportunistic and (5) the consequences of de-implementation. Forty-two papers were synthesised to identify six context–mechanism–outcome configurations, which focused on issues ranging from individual behaviours to organisational procedures. Current systems can perpetuate habitual decision-making practices that include low-value treatments. Electronic health records can be designed to hide or remove low-value treatments from choice options, foregrounding best evidence. Professionals can be made aware of their decision-making strategies through increasing their attention to low-value practice behaviours. Uncertainty about diagnosis or patients’ expectations for certain treatments provide opportunities for ‘watchful waiting’ as an active strategy to reduce inappropriate investigations and prescribing. The emotional component of clinician–patient relationships can limit opportunities for de-implementation, requiring professional support through multimodal educational interventions. Sufficient alignment between policy, public and professional perspectives is required for de-implementation success.LimitationsSome specific clinical issues (e.g. de-prescribing) dominate the de-implementation evidence base, which may limit the transferability of the synthesis findings. Any realist inquiry generates findings that are essentially cumulative and should be developed through further investigation that extends the range of sources into, for example, clinical research and further empirical studies.ConclusionsThis review contributes to our understanding of how de-implementation of low-value procedures and services can be improved within health-care services, through interventions that make professional decision-making more accountable and the prominence of a whole-system approach to de-implementation. Given the whole-system context of de-implementation, a range of different dissemination strategies will be required to engage with different stakeholders, in different ways, to change practice and policy in a timely manner.Study registrationThis study is registered as PROSPERO CRD42017081030.FundingThis project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full inHealth Services and Delivery Research; Vol. 9, No. 2. See the NIHR Journals Library website for further project information.

Save Icon
Up Arrow
Open/Close
Notes

Save Important notes in documents

Highlight text to save as a note, or write notes directly

You can also access these Documents in Paperpal, our AI writing tool

Powered by our AI Writing Assistant