Health Technology Assessment Research Articles

Clinical effectiveness of DREAMS START (Dementia Related Manual for Sleep; Strategies for Relatives) versus usual care for people with dementia and their carers: a single-masked, phase 3, parallel-arm, superiority randomised controlled trial

Sleep disturbances are common and distressing for people with dementia and their families. Non-pharmacological interventions should be first-line management, avoiding harmful pharmacological side-effects, but there is none with known effectiveness. We aimed to establish whether DREAMS START, a multicomponent intervention, reduced sleep disturbance in people with dementia living at home compared with usual care. We conducted a phase 3, two-arm, multicentre, parallel-arm, superiority randomised controlled trial with masked outcome assessment, recruiting dyads of people with dementia and sleep disturbance and family carers from community settings. Randomisation to the DREAMS START intervention (plus usual treatment) or usual treatment was conducted at dyadic level, blocked, and stratified by site, with a web-based system assigning allocation. DREAMS START is a six-session, manualised intervention delivered face to face or remotely by non-clinically trained graduates over an approximately 3-month period. The primary outcome was sleep disturbance measured by the Sleep Disorders Inventory (SDI) at 8months. Analyses were on the intention-to-treat population. This trial is registered with ISRCTN13072268. Between Feb 24, 2021, and March 5, 2023, 377dyads were randomly assigned (1:1), 189to usual treatment and 188to intervention. The mean age of participants with dementia was 79·4years (SD 9·0), and 206 (55%) were women. The mean SDI score at 8months was lower in the intervention group compared with the usual treatment group (15·16 [SD 12·77], n=159, vs 20·34 [16·67], n=163]; adjusted difference in means -4·70 [95% CI -7·65to -1·74], p=0·002). 17 (9%) people with dementia in the intervention group and 17 (9%) in the control group died during the trial; the deaths were unrelated to the intervention. To our knowledge, DREAMS START is the first multicomponent intervention to improve the sleep of people living at home with dementia more than usual clinical care. It had sustained effectiveness beyond intervention delivery. The intervention's delivery by non-clinically trained graduates increases the potential for implementation within health services, adding to usual clinical care. National Institute for Health and Care Research Health Technology Assessment.

Supporting evidence-based judicial decisions on health care in Brazil: an experience report

Objective: The main objective of this study is to report on the implementation and results of the “Supporting Health-Related Judicial Decisions in Brazil” project conducted at the Health Technology Assessment Center, Hospital Sírio-Libanês through the “Programa de Apoio ao Desenvolvimento Institucional do Sistema Único de Saúde”, in Brazil. Methods: This study is an experience report of a project conducted at the Health Technology Assessment Center, Hospital Sírio-Libanês. Results: The activities of the project occurred in 2023 and included two online training courses on primary studies and systematic reviews, 11 one-day workshops with technical-scientific content for members of the Technical Support Centers for the Judiciary (NATJus), 40 online technical-scientific consultations for magistrates on a digital platform, 11 technical-scientific reports addressing the most legally claimed technologies in Brazil; two methodological tools, a national forum (hybrid event), 10 chat-based mentorships for NATJus members; and the maintenance of an open-access blog, by publishing news on relevant topics on law and health. Discussion and conclusion: This project has contributed to the improvement of the judicial decision-making process by providing a range of activities aimed at aiding the prioritization of health technologies that are clearly effective and safe over those that are ineffective, harmful, or have uncertain effects. Submission: 04/09/24| Review: 06/29/24| Approval: 08/18/24

Improving antibiotic prescribing – Recommendations for funding and pricing policies to enhance use of point-of-care tests

IntroductionDiagnostics can contribute to the improved quality of antibiotic prescribing. However, there is potential to enhance the use of point-of-care tests (POCTs) in general practice. This paper presents fit-for-purpose policy recommendations related to funding and pricing for POCTs applied for community-acquired acute respiratory tract infections (CA-ARTIs). MethodsThe development of the recommendations was informed by an analysis of the current status of funding and pricing policy frameworks for CA-ARTI POCTs in European countries, and an identification of barriers and facilitators for their uptake. Draft recommendations were developed and subsequently revised based on written and verbal feedback from meetings with experts. ResultsThe proposal includes four recommendations for policy interventions related to funding and three recommendations regarding pricing policies. Two of the funding policy-related recommendations concern physicians’ remuneration, and two relate to product-specific reimbursement (public coverage) of the CA-ARTI POCTs. The pricing-related recommendations include a proposal to explore the introduction of price regulation, to pilot subscription-fee procurement models and to enhance more strategic approaches in public procurement of CA-ARTI POCTs. ConclusionsOptimised pricing and funding policies could make a difference in enhancing uptake of CA-ARTI POCTs. It is crucial for the successful implementation of policies to consider country settings. Additionally, supportive policy action is recommended, including the systematic use of health technology assessment, stakeholder communication, and monitoring and evaluation.

Clinical and Market Analysis of NanoBEO: A Public-Worth, Innovative Therapy for Behavioral and Psychological Symptoms of Dementia (BPSD)-Emerging Evidence and Its Implications for a Health Technology Assessment (HTA) and Decision-Making in National Health Systems.

According to scientific literature, some 99% of patients affected by Alzheimer's disease (AD) suffer from behavioral and psychological symptoms of dementia (BPSD), also known as neuropsychiatric symptoms (NPSs). In particular, agitation is one of the most difficult disorders to treat. States of agitation represent a very serious problem as they make these subjects dangerous for themselves and others and worsen as the disease advances. To date, there are no specific solutions for treating agitation. The only authorized drug is risperidone (as well as brexpiprazole, approved by the FDA on 11 May 2023), which can be used for no longer than 6-12 weeks because it increases the risk of death-owing to cardiocerebrovascular accidents-by 1.6-1.7 times. In order to address the latter noteworthy unmet medical need, NanoBEO was produced. The aim of the present work is to generate the health technology assessment (HTA) of this nanotechnological device. The latter consists of a controlled release system, based on solid lipid nanoparticles loaded with bergamot essential oil (BEO). The results of the present research assessed the current evidence in the field of non-pharmacological treatments for this condition, including relevant primary preclinical and clinical data studies supporting the use of this device and the production of the operative plan for its launch on the market. The findings offer recommendations for decision-making on its implementation in dementia. NanoBEO represents a public-worth innovation in this neglected area, marking a significant advancement in the history of dementia, moving from academic research to product development.

Automated Mass Extraction of Over 680,000 PICOs from Clinical Study Abstracts Using Generative AI: A Proof-of-Concept Study.

Generative artificial intelligence (GenAI) shows promise in automating key tasks involved in conducting systematic literature reviews (SLRs), including screening, bias assessment and data extraction. This potential automation is increasingly relevant as pharmaceutical developers face challenging requirements for timely and precise SLRs using the population, intervention, comparator and outcome (PICO) framework, such as those under the impending European Union (EU) Health Technology Assessment Regulation 2021/2282 (HTAR). This proof-of-concept study aimed to evaluate the feasibility, accuracy and efficiency of using GenAI for mass extraction of PICOs from PubMed abstracts. Abstracts were retrieved from PubMed using a search string targeting randomised controlled trials. A PubMed clinical study 'specific/narrow' filter was also applied. Retrieved abstracts were processed using the OpenAI Batch application programming interface (API), which allowed parallel processing and interaction with Generative Pre-trained Transformer 4 Omni (GPT-4o) via custom Python scripts. PICO elements were extracted using a zero-shot prompting strategy. Results were stored in CSV files and subsequently imported into a PostgreSQL database. The PubMed search returned 682,667 abstracts. PICOs from all abstracts were extracted in < 3 h, with an average processing time of 200 s per 1000 abstracts. A total of 395,992,770 tokens were processed, with an average of 580 tokens per abstract. The total cost was $3390. On the basis of a random sample of 350 abstracts, human verification confirmed that GPT-4o accurately and comprehensively extracted 342 (98%) of all PICOs, with only outcome elements rarely missed. Using GenAI to extract PICOs from clinical study abstracts could fundamentally transform the way SLRs are conducted. By enabling pharmaceutical developers to anticipate PICO requirements, this approach allows for proactive preparation for the EU HTAR process, or other health technology assessments (HTAs), streamlining efficiency and reducing the burden of meeting these requirements.

Cost-effectiveness of bioimpedance-guided fluid management in patients undergoing haemodialysis: the BISTRO RCT.

The BioImpedance Spectroscopy to maintain Renal Output randomised controlled trial investigated the effect of bioimpedance spectroscopy added to a standardised fluid management protocol on the risk of anuria and preservation of residual kidney function (primary trial outcomes) in incident haemodialysis patients. Despite the economic burden of kidney disease, the cost-effectiveness of using bioimpedance measurements to guide fluid management in haemodialysis is not known. To assess the cost-effectiveness of bioimpedance-guided fluid management against current fluid management without bioimpedance. Within-trial economic evaluation (cost-utility analysis) carried out alongside the open-label, multicentre BioImpedance Spectroscopy to maintain Renal Output randomised controlled trial. Thirty-four United Kingdom outpatient haemodialysis centres, both main and satellite units, and their associated inpatient hospitals. Four hundred and thirty-nine adult haemodialysis patients with > 500 ml urine/day or residual glomerular filtration rate > 3 ml/minute/1.73 m2. The study intervention was the incorporation of bioimpedance technology-derived information about body composition into the clinical assessment of fluid status in patients with residual kidney function undergoing haemodialysis. Bioimpedance measurements were used in conjunction with usual clinical judgement to set a target weight that would avoid excessive fluid depletion at the end of a dialysis session. The primary outcome measure of the BioImpedance Spectroscopy to maintain Renal Output economic evaluation was incremental cost per additional quality-adjusted life-year gained over 24 months following randomisation. In the main (base-case) analysis, this was calculated from the perspective of the National Health Service and Personal Social Services. Sensitivity analyses explored the impact of different scenarios, sources of resource use data and value sets. The bioimpedance-guided fluid management group was associated with £382 lower average cost per patient (95% CI -£3319 to £2556) and 0.043 more quality-adjusted life-years (95% CI -0.019 to 0.105) compared with the current fluid management group, with neither values being statistically significant. The probability of bioimpedance-guided fluid management being cost-effective was 76% and 83% at commonly cited willingness-to-pay threshold of £20,000 and £30,000 per quality-adjusted life-year gained, respectively. The results remained robust to a series of sensitivity analyses. The missing data level was high for some resource use categories collected through case report forms, due to COVID-19 disruptions and a significant dropout rate in the informing BioImpedance Spectroscopy to maintain Renal Output trial. Compared with current fluid management, bioimpedance-guided fluid management produced a marginal reduction in costs and a small improvement in quality-adjusted life-years. Results from both the base-case and sensitivity analyses suggested that use of bioimpedance is likely to be cost-effective. Future work exploring the association between primary outcomes and longer-term survival would be useful. Should an important link be established, and relevant evidence becomes available, it would be informative to determine whether and how this might affect longer-term costs and benefits associated with bioimpedance-guided fluid management. This article presents independent research funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme as award number HTA 14/216/01 (NIHR136142).

Health Technology Assessment of Vaccines in Italy: History and Review of Applications

Background/Objectives. Many vaccines have been developed in recent decades, and many more will be available in the future. When new safe and effective vaccines are available, decision-makers must extensively assess them before including them in the national immunization plan and issuing recommendations. The Health Technology Assessment (HTA) could be an objective, transparent, and comprehensive approach to guiding the decision-making process for the use of vaccines. Objectives and Methods. The aim of this study was to review the indications for HTA use contained in Italian institutional documents on vaccination, namely the National Immunization Plans (NIPs) and available full Italian HTA reports on vaccines, assessing their availability at the time of national recommendations’ introductions. Results. HTA has been recognised as an eligible approach to deciding upon the introduction of vaccines through the NIPs of 2012–2014 and 2017–2019, and the last NIP, of 2023–2025, highlights the lack of funding dedicated to the production of independent HTA reports that can be used for issuing recommendations. In 2007–2023, twenty full HTA reports on vaccines were published in Italy: eight reports on influenza vaccines, five on Human Papilloma Virus (HPV), three each on meningococcal and pneumococcal vaccines, and one on rotavirus vaccine. HTA was applied with different purposes, namely the evaluation of new vaccines or their re-assessment, but it was not always timely with respect to both the marketing authorisation and the issuing of national recommendations for use. Conclusions. As HTA can be considered the best tool to disentangle the overall value of vaccines, it would be desirable for it to be used more and more to provide the evidence for efficient resource use. This calls for action to improve the transfer of HTA results to decision-makers, to try to fill the gap between research and decision and foster evidence-based recommendations.

Framework for Multistakeholder Patient Registries in the Field of Rare Diseases: Focus on Neurogenetic Diseases.

Progress in genetic diagnosis and orphan drug legislation has opened doors to new therapies in rare neurogenetic diseases (RNDs). Innovative therapies such as gene therapy can improve patients' quality of life but come with academic, regulatory, and financial challenges. Registries can play a pivotal role in generating evidence to tackle these, but their development requires multidisciplinary knowledge and expertise. This study aims to develop a practical framework for creating and implementing patient registries addressing common challenges and maximizing their impact on care, research, drug development, and regulatory decision making with a focus on RNDs. A comprehensive 3-step literature and qualitative research approach was used to develop the framework. A qualitative systematic literature review was conducted, extracting guidance and practices leading to the draft framework. Subsequently, we interviewed representatives of 5 established international RND registries to add learnings from hands-on experiences to the framework. Expert input on the draft framework was sought in digital multistakeholder focus groups to refine the framework. The literature search; interviews with 5 registries; and focus groups with patient representatives (n = 4), clinicians (n = 6), regulators, health technology assessment (HTA) bodies and payers (n = 7), industry representatives (n = 7), and data/information technology (IT) specialists (n = 5) informed development of the framework. It covers the interests of different stakeholders, purposes for data utilization, data aspects, IT infrastructure, governance, and financing of rare disease registries. Key principles include that data should be rapidly accessible, independent, and trustworthy. Governance should involve multiple stakeholders. In addition, data should be highly descriptive, machine-readable, and accessible through a shared infrastructure and not spread over multiple isolated repositories. Sustainable and independent financing of registries is deemed important but remains challenging because of a lack of widely supported funding models. The proposed framework will guide stakeholders in establishing or improving rare disease registries that fulfill requirements of academics and patients as well as regulators, HTA bodies, and commercial parties. There is a need for more clarity regarding quality requirements for registries in regulatory and HTA context. In addition, independent financing models for registries should be developed, as well as well-defined policies on technical uniformity in health data.

Transportability of model-based estimands in evidence synthesis.

In evidence synthesis, effect modifiers are typically described as variables that induce treatment effect heterogeneity at the individual level, through treatment-covariate interactions in an outcome model parametrized at such level. As such, effect modification is defined with respect to a conditional measure, but marginal effect estimates are required for population-level decisions in health technology assessment. For noncollapsible measures, purely prognostic variables that are not determinants of treatment response at the individual level may modify marginal effects, even where there is individual-level treatment effect homogeneity. With heterogeneity, marginal effects for measures that are not directly collapsible cannot be expressed in terms of marginal covariate moments, and generally depend on the joint distribution of conditional effect measure modifiers and purely prognostic variables. There are implications for recommended practices in evidence synthesis. Unadjusted anchored indirect comparisons can be biased in the absence of individual-level treatment effect heterogeneity, or when marginal covariate moments are balanced across studies. Covariate adjustment may be necessary to account for cross-study imbalances in joint covariate distributions involving purely prognostic variables. In the absence of individual patient data for the target, covariate adjustment approaches are inherently limited in their ability to remove bias for measures that are not directly collapsible. Directly collapsible measures would facilitate the transportability of marginal effects between studies by: (1) reducing dependence on model-based covariate adjustment where there is individual-level treatment effect homogeneity or marginal covariate moments are balanced; and (2) facilitating the selection of baseline covariates for adjustment where there is individual-level treatment effect heterogeneity.

Yoga as Potential Therapy for Burnout: Health Technology Assessment Report on Efficacy, Safety, Economic, Social, Ethical, Legal and Organizational Aspects.

PURPOSEOF REVIEW: This health technology assessment aimed to systematically assess the efficacy and safety of yoga as therapy for burnout. Economic, ethical, legal, social and organizational aspects were considered as well. RECENT FINDINGS: Yoga as a therapy has been shown to have positive effects on a range of symptoms, including stress, anxiety and depression. Regarding work-related stress and burnout, the effects of yoga have mainly been examined in a preventative context. Meta-analyses revealed no effects on burnout severity comparing yoga with passive controls in general. Compared with passive controls, yoga had a positive effect on subjective stress. Compared to active control, yoga had an effect on the burnout subscale depersonalization on individual study level. Yoga may have positive effects on burnout, but the results are mixed. Common definitions and standardized diagnostic tools are necessary to improve research and further assess yoga as therapy for burnout. TRIAL REGISTRATION: The HTA is registered with PROSPERO, CRD42022299405, on 6th February 2022.

Pharmaceutical innovativeness index: methodological approach for assessing the value of medicines – a case study of oncology drugs

ABSTRACT Background We propose a framework to assess the value of pharmaceutical innovations, with explicit clinical and methodological parameters, based on the therapeutic value and health needs. Research design and methods The study was based on the adaptation of health technology assessment methods documented in the literature, which was applied to a sample of oncological drugs. Difficulties and issues during the application of those tools were identified and addressed to develop a new framework with new and revised domains and clear classification criterion for each domain. Scores were assigned to each level and domain according to their relevance to generate the final score of innovativeness. Results The Pharmaceutical Innovation Index (PII) includes four domains, two related to clinical and social dimensions – Therapeutic Need and Added Therapeutic Value – and other two about methodological features – Study Design and Quality (risk of bias). The scores combined after assigned to each domain results Index of the Innovativeness of the medicines represents the degree of pharmaceutical innovation. Conclusion This work proposes a transparent methodology with well-defined criteria and script; the algorithm developed with authors’ weightings and criteria may be switched to best adjust to other applications, perspective or clinical indications, while keeping the transparency and objectiveness.

SATURN: assessing the feasibility of utilising existing registries for real-world evidence data collection to meet patients, regulatory, health technology assessment and payer requirements

BackgroundSATURN (Systematic Accumulation of Treatment practices and Utilisation, Real world evidence, and Natural history data) for the rare condition osteogenesis imperfecta (OI) has the objective to create a common core dataset by utilising existing, well-established data sources to meet the needs of the various stakeholders (physicians, registry/dataset owners, patients and patient associations, OI community leaders, European [EU] policymakers, regulators, health technology assessments [HTA]s, and healthcare systems including payers). This paper describes the steps taken to assess the feasibility of one existing OI registry (i.e., the Registry of OI [ROI]) as a candidate for SATURN. The same methodology will be applied to other existing OI registries in the future and this same concept could be utilised for other rare disease registries.MethodsThe approach to assessing the feasibility of the ROI registry consisted of three steps: (1) an assessment of the registry characteristics using the Registry Evaluation and Quality Standards Tool (REQueST); (2) a gap analysis comparing SATURN required Core Variables to those being captured in the registry’s Case Report Form (CRF); and (3) a compliance check on the data exchange process following the Title 21 of Code of Federal Regulations (CFR) Part 11/EudraLex Annex 11 Compliance Checklist. The first registry that SATURN has assessed is the ROI database at the Istituto Ortopedico Rizzoli (IOR) in Italy.ResultsThe results from the ROI REQueST have demonstrated satisfactory complete responses in terms of methodology, essential standards, interpretability, and interoperability—readiness for data linkage, data sources, and ethics to meet the needs of data customers. However, the ROI data is from a tertiary referral centre which may limit the ability to understand the full patient journey. The gap analysis has revealed that an exact or logical match between SATURN requested variables and the ROI current variables exists for the following items: patient characteristics, treatment of OI (medical and surgical) and treatment of pain (with the exception of frequency of treatment and reasons for discontinuation), fracture history and bone density. However, data on safety was missing. The compliance check has implied that the ROI implemented appropriate controls for the web-based platform (i.e., Genotype–phenotype Data Integration Platform [GeDI]) that is involved in processing the electronic patient data, and GeDI is a validated/compliant application that follows relevant 21 CFR Part 11/EudraLex Annex 11 regulations.ConclusionsThis robust feasibility process highlights potential limitations and opportunities to develop and to refine the collaboration with the ROI as the SATURN programme moves forward. It also ensures that the existing datasets in the rare condition OI are being maximised to respond to the needs of patients, data customers and decision-makers. This feasibility process has allowed SATURN to build a compliant methodology that aligns with the requirements from the European Medicines Agency (EMA) and HTAs. More data variables will continue to be developed and refined along the way with more registries participating in SATURN. As a result, SATURN will become a meaningful and truly collaborative core dataset, which will also contribute to advancing understanding of OI diagnosis, treatment, and care.

Is health-related quality of life sufficiently addressed in trials for breast cancer treatments? An assessment based on reimbursement opinions from the French health technology assessment body, 2009–2023

BackgroundBreast cancer treatments can impact the patients’ health-related quality of life (HR-QoL). This criterion is relevant for drug reimbursement decisions. We wanted to assess the usage of HR-QoL in health technology assessments (HTA). MethodsAll HAS (Haute Autorité de Santé, the French HTA body) opinions published between January 1, 2009 and March 31, 2023 for the reimbursement of breast cancer drugs were analysed. Results51 distinct appraisals were found during the period, corresponding to 45 product-specific indications, of which 36 (80 %) including clinical studies in which HR-QoL was an endpoint. HAS explicitly rejected HR-QoL data in 25 out of 36 (69 %) indications with such data. Rejections are justified by methodological weaknesses, including lack of adjustment for type I error inflation (n=21 indications), open-label treatment (n=7), lack of a pre-specified clinically relevant HR-QoL threshold (n=6) or missing data (n=6). Regardless of rejection status, HR-QoL results were not mentioned as a determinant of value assessment in 3/36 (8 %) instances (2/25 for rejected data). ConclusionsHR-QoL data are inconsistently present in HTA assessments of new breast cancer drugs. Their methodological quality often hinders their use in determining the drug’s value. Policy summaryA rigorous and acceptable comparative experimental framework is expected for HR-QoL assessments. More detail on the precise impact of the absence or presence of HR-QoL data in the determination of the drug’s added value could help understanding how this dimension is influential in the assessments.

Providing data analytic services for national knowledge users in a federated system: learnings from two Canadian use cases

Objective and ApproachCanada’s federated health data system along with access pathways geared toward academic research, pose challenges for knowledge Users (KUs) requiring timely, pan-Canadian evidence to inform decisions. To understand challenges and explore solutions, we conducted two use cases for a pan-Canadian health technology assessment organization and a federal agency, using health administrative data at one federal and six provincial data centres. The population-based cohort studies described socio-demographics, comorbidities, treatment patterns, service utilization and costs. One focused on spinal muscular atrophy, a rare disease and the other on dementia, a complex chronic disease. ResultsAdministrative challenges included aligning varied ethical review and data access policies/procedures including requiring local and/or academic principal investigators and differing definitions of “research” vs. planning, evaluation, and monitoring. Data-related challenges included differences in structure, timeliness, and completeness across regions resulting in difficulty aligning constructs such as incident cases and episodes of care. Privacy requirements prohibited pooling jurisdictional estimates resulting in “small cells” that couldn’t be shared with KUs. ConclusionsWe provided analytic outputs from multiple regions, albeit with some differences and gaps, increasing knowledge around both diseases while developing capacity for combined analyses and gaining insight into national possibilities for data access. ImplicationsAs decision makers must rely on best available information, some data is better than none. However, to improve data-analytic services for Pan-Canadian KUs, next steps will include improving data harmonization, expanding data assets and filling data gaps, implementing common data models, and exploring options for federated and/or pooled analyses.

Urgent-start peritoneal dialysis for patients with end-stage renal disease. A health technology assessment

Urgent-start peritoneal dialysis for patients with end-stage renal disease. A health technology assessment

Initial assessment and management of adults with suspected acute respiratory infection: a rapid evidence synthesis of reviews and cost-effectiveness studies.

This work was undertaken to inform a National Institute for Health and Care Excellence guideline on the initial assessment of adults with suspected acute respiratory infection. To undertake a rapid evidence synthesis of systematic reviews and cost-effectiveness studies of signs, symptoms and early warning scores for the initial assessment of adults with suspected acute respiratory infection. MEDLINE, EMBASE and Cochrane Database of Systematic Reviews were searched for systematic reviews and MEDLINE, EMBASE, EconLit and National Health Service Economic Evaluation Database were searched for cost-effectiveness studies in May 2023. References of relevant studies were checked. Clinical outcomes of interest included escalation of care, antibiotic/antiviral use, time to resolution of symptoms, mortality and health-related quality of life. Risk of bias was assessed using the Risk of Bias in Systematic Reviews tool or the National Institute for Health and Care Excellence economic evaluations checklist. Results were summarised using narrative synthesis. Nine systematic reviews and one cost-effectiveness study met eligibility criteria. Seven reviews assessed several early warning scores for patients with community- acquired pneumonia, one assessed early warning scores for nursing home-acquired pneumonia and one assessed individual signs/symptoms and the Centor score for patients with sore throat symptoms; all in face-to-face settings. Two good-quality reviews concluded that further research is needed to validate the CRB-65 in primary care/community settings. One also concluded that further research is needed on the Pneumonia Severity Index in community settings; however, the Pneumonia Severity Index requires data from tests not routinely conducted in community settings. One good-quality review concluded that National Early Warning Score appears to be useful in an emergency department/acute medical setting. One review (unclear quality) concluded that the Pneumonia Severity Index and CURB-65 appear useful in an emergency department setting. Two poor-quality reviews concluded that early warning scores can support clinical judgement and one poor-quality review found numerous problems with using early warning scores in a nursing home setting. A good-quality review concluded that individual signs and symptoms have a modest ability to diagnose streptococcal pharyngitis, and that the Centor score can enhance appropriate prescribing of antibiotics. The cost-effectiveness study assessed clinical scores and rapid antigen detection tests for sore throat, compared to delayed antibiotic prescribing. The study concluded that the clinical score is a cost-effective approach when compared to delayed prescribing and rapid antigen testing. Several early warning scores have been evaluated in adults with suspected acute respiratory infection, mainly the CRB-65, CURB-65 and Pneumonia Severity Index in patients with community-acquired pneumonia. The evidence was insufficient to determine what triage strategies avoid serious illness. Some early warning scores (CURB-65, Pneumonia Severity Index and National Early Warning Score) appear to be useful in an emergency department/acute medical setting; however, further research is required to validate the CRB-65 and Pneumonia Severity Index in primary care/community settings. The economic evidence indicated that clinical scores may be a cost-effective approach to triage patients compared with delayed prescribing. Only systematic reviews were eligible for inclusion in the synthesis of clinical evidence. There was a great deal of overlap in the primary studies included in the reviews, many of which had significant limitations. No studies were undertaken in remote settings (e.g. NHS 111). Only one cost-effectiveness study was identified, with limited applicability to the review question. This article presents independent research funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme as award number NIHR159945.

Artificial intelligence applied in human health technology assessment: a scoping review protocol.

This scoping review aims to map studies that applied artificial intelligence (AI) tools to perform health technology assessment tasks in human health care. The review also aims to understand specific processes in which the AI tools were applied and to comprehend the technical characteristics of these tools. Health technology assessment is a complex, time-consuming, and labor-intensive endeavor. The development of automation techniques using AI has opened up new avenues for accelerating such assessments in human health settings. This could potentially aid health technology assessment researchers and decision-makers to deliver higher quality evidence. This review will consider studies that assesses the use of AI tools in any process of health technology assessment in human health. However, publications in which AI is a means of clinical aid, such as diagnostics or surgery will be excluded. A search for relevant articles will be conducted in databases such as CINAHL (EBSCOhost), Embase (Ovid), MEDLINE (PubMed), Science Direct, Computer and Applied Sciences Complete (EBSCOhost), LILACS, Scopus, and Web of Science Core Collection. A search for gray literature will be conducted in GreyLit.Org, ProQuest Dissertations and Theses, Google Scholar, and the Google search engine. No language filters will be applied. Screening, selection, and data extraction will be performed by 2 independent reviewers. The results will be presented in graphic and tabular format, accompanied by a narrative summary. osf.io/3rm8g.

Are Drug Novelty Characteristics Associated With Greater Health Benefits?

The aim of this study was to examine the association between characteristics of novel drugs and incremental health gains relative to standard of care, in terms of quality-adjusted life-years (QALYs). This study's unit of analysis is the drug-indication pair. For pairs approved by the US FDA from 1999 to 2018, we quantified incremental health gains using QALYs from the published literature and characterized each pair's novelty in terms of a series of six binary (yes/no) characteristics of novel drugs given special consideration by Health Technology Assessment agencies: Novel mechanism of action, Indicated for a rare disease, Indicated for a pediatric population, Treats a serious condition, Offers meaningful improvement over available therapies, and Potential to address unmet clinical needs. We analyzed measures of bivariate association (Mann-Whitney U and Kolmogorov-Smirnov tests) and multivariable regression, accounting for the influence of multiple novelty characteristics simultaneously. Our sample of 146 drugs represents 21% of drugs approved the FDA in the time period (1999-2018). Median and mean QALY gains for 'novel' drug-indication pairs exceeded corresponding QALY gains for non-novel drug-indication pairs. For most comparisons, the bivariate relationships between QALY gains and novelty characteristics were significant at p<0.05 except for novel mechanism of action (Kolmogorov-Smirnov test) and pediatric indication (both bivariate tests). Multivariable models revealed an independent association between novelty characteristics and QALY gain except for unmet clinical need and indicated for a rare disease. Drugs with novelty characteristics conferred larger health gains than drugs without these characteristics in bivariate analysis, multivariable models, or both. Future research should examine other aspects of drug novelty, such as patient and health system costs and equitable access.

Valuation of the EQ-5D-3L in Jordan.

In Jordan, no national value set is available for any preference-accompanied health utility measure. This study aims to develop a value set for EQ-5D-3L based on the preferences of the Jordanian general population. A representative sample of the Jordanian general population was obtained through quota sampling involving age, gender, and region. Participants aged above 18 years were interviewed via videoconferencing using the EuroQol Valuation Technology 2.1 protocol. Participants completed ten composite time trade-offs (cTTO) and ten discrete choice experiments (DCE) tasks. cTTO and DCE data were analyzed using linear and logistic regression models, respectively, and hybrid models were applied to the combined DCE and cTTO data. A total of 301 participants with complete data were included in the analysis. The sample was representative of the general population regarding region, age, and gender. All model types applied, that is, random intercept model, random intercept Tobit, linear model with correction for heteroskedasticity, Tobit with correction for heteroskedasticity, and all hybrid models, were statistically significant. They showed logical consistency in terms of higher utility decrements with more severe levels. The hybrid model corrected for heteroskedasticity was selected to construct the Jordanian EQ-5D-3L value set as it showed the best fit and lowest mean absolute error. The predicted value for the most severe health state (33333) was -0.563. Utility decrements due to mobility had the largest weight, followed by anxiety/depression, while usual activities had the smallest weight. This study provides the first EQ-5D-3L value set in the Middle East. The Jordanian EQ-5D-3L value set can now be used in health technology assessments for health policy planning by the Jordanian health sector's decision-makers.

Development of stakeholder-informed recommendations for inclusion of family spillover effects in health technology assessment.

The impacts of disease and treatment on a patient's family members and informal caregivers are known as "family spillover effects." Although many formal value frameworks call for the consideration of these effects, they are often not included in health technology assessments (HTAs) and cost-effectiveness analyses (CEAs). A formal evaluation of stakeholder perspectives may help address the disconnect for inclusion of family spillover effects observed in practice. To develop stakeholder-driven recommendations for the measurement and use of family spillover effects in the United States and to identify research opportunities. We first conducted a targeted literature review of US-based CEAs and HTA reports from the past 10 years to assess the current use of family spillover effects. We then used a purposeful sampling technique to conduct 25 qualitative interviews with outcomes researchers, patient advocates, health economists, and health policy and payer experts to gather perspectives on when and how family spillover effects should be considered in HTA processes. We conducted a thematic analysis of the interview transcripts to identify key themes and develop preliminary recommendations. Finally, we conducted an online workshop with 8 stakeholders to discuss, rate, and refine preliminary recommendations to develop final recommendations. A key theme identified in the stakeholder interviews was the role that data availability, analyst preferences, and prior precedence play in limiting the inclusion of spillover effects in HTAs. Additional themes included support for the inclusion of both qualitative and quantitative spillover effects and the need to capture broad and diverse impacts across populations. We developed 15 recommendations from the consensus building workshop addressing measurement, CEA modeling, and HTA processes. Key recommendations included (1) a transparent process for deciding when family spillover effects should be included, (2) measurement of direct and indirect costs with priority based on the magnitude of impact, (3) the use of validated measures, (4) the use of proxy information and expert elicitation when quality data are unavailable, and (5) the use of a modified impact inventory table for transparency of included effects. Research opportunities included patient involvement in family spillover effect research and HTAs, mapping algorithms and non-preference-based caregiver measures to generate utilities, and consensus best practices for modeling. The inconsistent inclusion of family spillover effects in HTAs and CEAs remains a persistent challenge. The stakeholder-driven recommendations and research opportunities identified in this study may help improve the transparency, measurement, and use of family spillover effects in assessing the clinical and economic value of novel medical technologies.