Health Technology Assessment International Research Articles

A genuine need or nice to have? Understanding HTA representatives' perspectives on the use of patient preference data.

The roles and potential value of patient preference (PP) data in health technology assessment (HTA) remain to be fully realized despite an expanding literature and various efforts to establish their utility. This article reports lessons learned through a series of collaborative workshops with HTA representatives, organized by the Health Technology Assessment International's Patient Preferences Project Subcommittee. Five online workshops were conducted between June 2022 and June 2023, seeking to facilitate collaborative learning and reflection on ways that PP data can be integrated into HTA. Participants included nine HTA representatives from the United States, Canada, Australia, England, and the Netherlands. Workshops were recorded, transcribed, and thematically analyzed. Despite appreciating the value of PP data, participants were ambivalent about their use in HTA. Some felt that they were already getting the information they needed from the cost-effectiveness analysis or existing patient involvement processes. Others thought that PP data would be very helpful at the initial and final stage of the decision-making process and, particularly, in the following cases: (a) when technology has important non-health benefits; (b) when the clinical and/or cost-effectiveness evidence is marginal; and (c) when treatment is indicated for a large and heterogeneous population. Issues related to the validity and reliability of PP studies were frequently raised, with preference heterogeneity at the core of these concerns. Collaborating with HTA representatives in the "co-creation" of PP research can help address their concerns and facilitate mutual learning about how PP data can be used in HTA.

Health technology assessment and innovation: here to help or hinder?

Innovative health technologies offer much to patients, clinicians, and health systems. Policy makers can, however, be slow to embrace innovation for many reasons, including a less robust body of evidence, perceived high costs, and a fear that once technologies enter the health system, they will be difficult to remove. Health technology funding decisions are usually made after a rigorous health technology assessment (HTA) process, including a cost analysis. However, by focusing on therapeutic value and cost-savings, the traditional HTA framework often fails to capture innovation in the assessment process. How HTA defines, evaluates, and values innovation is currently inconsistent, and it is generally agreed that by explicitly defining innovation would recognize and reward and, in turn, stimulate, encourage, and incentivize future innovation in the system. To foster innovation in health technology, policy needs to be innovative and utilize other HTA tools to inform decision making including horizon scanning, multicriteria decision analysis, and funding mechanisms such as managed agreements and coverage with evidence development. When properly supported and incentivized, and by shifting the focus from cost to investment, innovation in health technology such as genomics, point-of-care testing, and digital health may deliver better patient outcomes. Industry and agency members of the Health Technology Assessment International Asia Policy Forum (APF) met in Taiwan in November 2023 to discuss the potential of HTA to foster innovation, especially in the Asia region. Discussions and presentations during the 2023 APF were informed by a background paper, which forms the basis of this paper.

HTA model for laboratory medicine technologies: overview of approaches adopted in some international agencies.

The Health Technology Assessment (HTA) Working Group of the Emerging Technology Division of International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) aims to develop a methodological approach for producing structured HTA information for laboratory medicine technologies. This approach seeks to support decision-making processes at the country, regional, and/or hospital levels regarding the introduction of specific technologies. The focus of this model will primarily be ondefining assessment elements within the domains of 'organizational aspects' and 'costs and economic evaluations', potentially differentiated by the type of diagnostic technology (e.g., genetic tests, molecular tests). To achieve this project's goal, a literature review and examination ofwebsites of international HTA agencies have been conducted. The research aims to identify multidisciplinary methodological approaches used to assess laboratory diagnostic technologies and to pinpoint the domains and assessment elements utilized. Wefound 7 methodological articles describing methodological approaches adopted toassess laboratory diagnostic technologies. Among the HTA organizations considered, 23 reports were found, of which 7 were produced by the European Network of HTA (EUnetHTA), 4 by the National Institute for Health and Care Excellence Diagnostic Assessment Program (NICE DAP), and 12 by other HTA agencies. The EUnetHTA reports wererapid collaborative assessments covering various domains, while the NICE DAP reports focused on diagnostic guidances, including descriptions of technologies, clinical need and practice, diagnostic tests, accuracy, effectiveness, and cost-effectiveness. Finally, a survey targeting laboratory professionals will be conducted to introduce assessment elements, differentiated by the type of diagnostic technology, primarily for organizational and economic domains.

Costs and benefits in patients with NYHA class III heart failure treated with CardioMEMS in Italy.

CardioMEMS is a device suitable for telemedicine that is currently being evaluated by the Regional Health Technology Assessment (HTA) Committee of Tuscany. Two detailed HTA reports are available in the specialized literature, the results of which need to be transferred to our regional setting. These decisions in Tuscany are made by the so-called Centro Operativo HTA. To validate, with local cost-effectiveness data, the decision on CardioMEMS that will be made in the Tuscany region. Two detailed international HTA reports were rearranged and adapted to our regional setting to generate a simplified analysis that could form the basis of our decision. Two willingness-to-pay (WTP) thresholds of €20,000/quality-adjusted life year (QALY) and €50,000/QALY were considered. Based on epidemiological and regulatory information, the target population in Tuscany for this device is 166 cases. The value-based price of CardioMEMS is estimated to be €4,332 and €16,662 at WTP thresholds of 20,000/QALY and 50,000/QALY, respectively. Its current price in Italy is €12,000. In our region, the introduction of CardioMEMS is likely to be gradual, around 50 patients/year (or €0.60 million/year at current price). This example highlights the need to adapt the information published in the international literature to the local context in which the approval decision is made. In this context, simplified analyses are easier to apply than complex Markov models.

Is health technology assessment ready for generative pretrained transformer large language models? Report of a fishbowl inquiry.

The Health Technology Assessment International (HTAi) 2023 Annual Meeting included a novel "fishbowl" session intended to 1) probe the role of HTA in the emergence of generative pretrained transformer (GPT) large language models (LLMs) into health care and 2) demonstrate the semistructured, interactive fishbowl process applied to an emerging "hot topic" by diverse international participants. The fishbowl process is a format for conducting medium-to-large group discussions. Participants are separated into an inner group and an outer group on the periphery. The inner group responds to a set of questions, whereas the outer group listens actively. During the session, participants voluntarily enter and leave the inner group. The questions for this fishbowl were: What are current and potential future applications of GPT LLMs in health care? How can HTA assess intended and unintended impacts of GPT LLM applications in health care? How might GPT be used to improve HTA methodology? Participants offered approximately sixty responses across the three questions. Among the prominent themes were: improving operational efficiency, terminology and language, training and education, evidence synthesis, detecting and minimizing biases, stakeholder engagement, and recognizing and accounting for ethical, legal, and social implications. The interactive fishbowl format enabled the sharing of real-time input on how GPT LLMs and related disruptive technologies will influence what technologies will be assessed, how they will be assessed, and how they might be used to improve HTA. It offers novel perspectives from the HTA community and aligns with certain aspects of ongoing HTA and evidence framework development.

An operationalization framework for lifecycle health technology assessment: a Health Technology Assessment International Global Policy Forum Task Force report.

Operationalization guidance is needed to support health technology assessment (HTA) bodies considering implementing lifecycle HTA (LC-HTA) approaches. The 2022 Health Technology Assessment International (HTAi) Global Policy Forum (GPF) established a Task Force to develop a position paper on LC-HTA. In its first paper, the Task Force established a definition and framework for LC-HTA in order to tailor it to specific decision problems. This second paper focused on the provision of practical operational guidance to implement LC-HTA. Detailed descriptions of the three LC-HTA operational steps are provided (defining the decision problem, sequencing of HTA activities, and developing optimization criteria) and accompanied by worked examples and an operationalization checklist with 20 different questions for HTA bodies to consider when developing an LC-HTA approach. The questions were designed to be applicable across different types of HTA and scenarios, and require adaptation to local jurisdictions, remits, and context.

Lifecycle HTA: promising applications and a framework for implementation. An HTAi Global Policy Forum Task Force report.

The 2022 Health Technology Assessment International (HTAi) Global Policy Forum (GPF) established the goal of developing a position statement and framework for lifecycle HTA (LC-HTA), through a Task Force leveraging multi-stakeholder monthly discussions and GPF member input. The Task Force developed a working definition: LC-HTA is a systematic process utilizing sequential HTA activities to inform decision making where the evidence base, the health technology itself, or the context in which it is applied, has a potential to meaningfully change at different points in its LC. Four key scenarios were identified where it was considered that an LC-HTA approach would add sufficient value to HTA bodies and their key stakeholders to justify the additional resource burden. Based on the four scenarios, a high-level LC-HTA framework was developed consisting of (i) defining the decision problem, (ii) sequencing of HTA activities, and (iii) developing optimization criteria. Subsequently, the Task Force developed operationalization guidance for LC-HTA in a companion paper.

The three-domain impact framework for characterizing impact of patient involvement in health technology assessment.

Evaluating the impact of patient involvement in health technology assessments (HTA) may help improve practices and avoid ineffective activities. Evaluation, however, continues to be infrequent, inconsistent, and often only relates to process quantity or quality. The Patient and Citizen Involvement in HTA Interest Group (PCIG) within Health Technology Assessment International set out to contextualize this impact to support evaluation. Given the lack of established methodology to measure impact, the team performed a qualitative analysis of first-hand accounts about perceived changes in HTA due to involvement of patient stakeholders. A questionnaire was developed, piloted, and rolled out to collect personal perspectives from stakeholders with relevant experience. The stories were analyzed in the aggregate to identify themes in the data. From January 2019 to September 2021, twenty-four responses were collected through PCIG's network. Responses (including one joint industry-HTA body submission) came from patient representatives (12), HTA bodies (11), and industry representatives (2) from North America (5), South America (3), Europe (13), and Asia Pacific (3). Based on themes commonly reported, a three-domain framework for evaluating impact is proposed: impact on basis of HTA result or recommendation, impact on HTA body, and impact on patient participants. The framework includes components under each domain to support reporting. Using the Three-Domain Impact Framework may be useful in identifying, evaluating, and communicating the value of patient involvement in HTA. Enhancing and increasing reporting practices may improve transparency and facilitate process improvements for meaningful integration of patient stakeholders into HTA appraisals across jurisdictions.

How can managed entry agreements contribute to coverage decisions in Latin America?

Healthcare stakeholders in Latin America, including payers, manufacturers, and patients, seek to expedite access to technologies. However, uncertainty sometimes surrounds their true benefits and budgetary implications. Managed entry agreements (MEAs) are proposed to address this uncertainty by redistributing risks among key actors. The objective of Health Technology Assessment International's 2023 Latin American Policy Forum was to examine the potential utility of MEA in technology reimbursement and decision-making processes in the region. This article is based on a background document, a survey, and the deliberative work of the country representatives and others who participated in the Policy Forum. Interest in MEA in Latin America is increasing, with financial agreements being more prevalent than those based on clinical outcomes. During the Policy Forum, potential barriers to MEA implementation were identified, such as the lack of legal frameworks, insufficient reliable data, and, in some cases, distrust among stakeholders. Some potential solutions were also identified, including early stakeholder involvement to enhance dialogue and understanding, and piloting shorter-duration MEA to facilitate the revision of agreement terms, especially in situations of epidemiological uncertainty. The Policy Forum served as a valuable platform for discussing the importance of flexible MEA implementation that acknowledges data uncertainty, promotes transparent dialogue to incorporate opinions and values from all stakeholders, and develops legal frameworks to support effective technology access schemes in Latin America.

Application of natural language processing to predict final recommendation of Brazilian health technology assessment reports.

Health technology assessment (HTA) plays a vital role in healthcare decision-making globally, necessitating the identification of key factors impacting evaluation outcomes due to the significant workload faced by HTA agencies. The aim of this study was to predict the approval status of evaluations conducted by the Brazilian Committee for Health Technology Incorporation (CONITEC) using natural language processing (NLP). Data encompassing CONITEC's official report summaries from 2012 to 2022. Textual data was tokenized for NLP analysis. Least Absolute Shrinkage and Selection Operator, logistic regression, support vector machine, random forest, neural network, and extreme gradient boosting (XGBoost), were evaluated for accuracy, area under the receiver operating characteristic curve (ROC AUC) score, precision, and recall. Cluster analysis using the k-modes algorithm categorized entries into two clusters (approved, rejected). The neural network model exhibited the highest accuracy metrics (precision at 0.815, accuracy at 0.769, ROC AUC at 0.871, and recall at 0.746), followed by XGBoost model. The lexical analysis uncovered linguistic markers, like references to international HTA agencies' experiences and government as demandant, potentially influencing CONITEC's decisions. Cluster and XGBoost analyses emphasized that approved evaluations mainly concerned drug assessments, often government-initiated, while non-approved ones frequently evaluated drugs, with the industry as the requester. NLP model can predict health technology incorporation outcomes, opening avenues for future research using HTA reports from other agencies. This model has the potential to enhance HTA system efficiency by offering initial insights and decision-making criteria, thereby benefiting healthcare experts.

OP120 Developing A Call To Action For Patient Involvement In Health Technology Assessment (HTA) In Southern Africa

IntroductionIn building health technology assessment (HTA) and related decision processes in Southern Africa, institutions and stakeholders face region-specific challenges such as disease prevalence and population makeup. These can be addressed by collaboratively discussing patient engagement solutions that fit the local culture and systems and serve to ensure equitable and sustainable access to patient-relevant health technologies. Our aim is to initiate a collaboration for driving patient involvement (PI) suitable for the Southern African context and Sub-Saharan patient communities. In addition, we explore current experiences in PI, including the stakeholder expectations, gaps, limitations, and new opportunities.MethodsA one-day hybrid multi-stakeholder PI in HTA workshop was held in Johannesburg, South Africa. Co-created by the participants, the outputs are a call to action and a concept draft for the vital success criteria for PI in the region. The content of the call to action is gathered from pre-workshop surveys, interviews, and outcomes from historic meetings held in conjunction with the Health Technology Assessment International (HTAi) PI workstream as well as facilitated discussion from the actual workshop.ResultsThe workshop was attended by 42 participants from nine countries, representing diverse stakeholder groups. The attendees represented multiple PI stakeholder groups. The workshop survey was completed by 44 respondents, while 12 participants completed the post-event survey. A workshop outcomes document highlighting a high level of alignment and identifying seven key success factors was developed. A workshop proceeding detailing the outcomes is now being drafted.ConclusionsOver 95 percent of respondents to pre-and post-surveys indicated an interest in contributing to a more in-depth description of PI in their country. While the majority of participants were from South Africa, participants from Tanzania, Ethiopia, Zambia, and Zimbabwe emphasized that trans-African-engagement for HTA will provide an additional opportunity for HTA in Africa and patient and community participation in HTA and healthcare decision-making. Hence, a collaborative platform could help all African countries to advance and benefit from improved healthcare decision processes.

OP100 Patient Perspectives In Value Assessment Frameworks: The Asia Pacific Perspective

IntroductionThe importance of patient centricity in healthcare decision making has been recognized and advocated for decades. However, approaches for including the patient perspective are diverse, and progress varies among countries. Some reimbursement bodies acknowledge the importance of patient preferences in health technology assessment (HTA) and funding decision processes. However, patients’ perspectives are not yet systematically and transparently included in value assessment frameworks globally, and even less so in the Asia-Pacific (APAC) region. This systematic review aimed to investigate how patients’ perspectives are used to inform pricing and reimbursement decisions in the APAC region.MethodsA systematic review is ongoing that utilized a search of 12 databases, including MEDLINE and Embase, to identify publications on the consideration of patient perspectives in health policy decision-making published to November 2022. Conference abstracts published in the last five years from ISPOR and Health Technology Assessment International (HTAi) were screened, along with gray literature and government websites from Australia, China, Japan, Malaysia, New Zealand, the Philippines, Singapore, South Korea, Taiwan, and Thailand. Publications were included if the impact of either one or more of the following on HTA decision-making was assessed: active participation of patients or patient advocacy groups; type, extent, and evolution of patient-reported outcomes; health-related quality of life or quality of life tools; and themes where the impact of patients’ perspectives on value assessment was the primary outcome. Countries were characterized into archetypes based on similarities or differences in the weight and value assigned to patient perspectives in decision-making.ResultsA total of 6,438 retrieved citations will undergo the systematic review process. Additionally, 758 conference abstracts from ISPOR, 1,312 from HTAi conferences and 73 records from gray literature will be screened.The results of the systematic review will be consolidated into country archetypes, examples, and learnings. Gaps and opportunities will also be identified.ConclusionsThe research will provide recommendations to increase shared decision-making and support the development of decision-making frameworks that systematically incorporate patients’ perspectives in value assessment across APAC countries.

OP137 A Qualitative Exploration Of The National Institute For Health And Care Excellence’s Impact On International Health Technology Assessment

IntroductionThe National Institute For Health And Care Excellence (NICE) is widely acknowledged as a seminal health technology assessment (HTA) body, known for its transparent and accountable approach to decision-making. This research aimed to investigate the impact of NICE methodology and decisions on international HTA bodies. We sought to identify direct and indirect factors that may influence an international HTA body’s methods or outcomes. To the best of our knowledge, this is the first research to use a qualitative approach to understand the influence of NICE on other HTA bodies.MethodsWe conducted 13 semi-structured qualitative interviews with HTA and market access experts from industry and academia from nine countries (Brazil, Israel, Italy, Japan, Poland, Saudi Arabia, South Korea, Sweden, and the United Arab Emirates). The interview script was organized into three main sections: comparing NICE methods and processes with other HTA bodies; the impact of specific NICE decisions; and Likert scale questions (to allow for comparability of opinions).ResultsMost interviewees believed their local HTA body would consider NICE’s decision when evaluating a medicine. However, the way and extent to which NICE influences HTA varied across countries. The most common means of considering a NICE decision was as background information or context for an HTA evaluation. Generally, interviewees suggested that negative NICE decisions had more impact on local decision-making than positive decisions. Nine of the 13 interviewees agreed or strongly agreed that their country’s HTA body considers the decisions of other HTA bodies in their decision-making process. Eleven of the 13 interviewees agreed or strongly agreed that the development of their country’s HTA body methods and processes was influenced by NICE.ConclusionsNICE is perceived to be a seminal HTA body, with continued influence on HTA agencies in other countries. However, the mechanisms and extent of this influence varies considerably between countries. We suggest that implicit factors are likely to contribute more to NICE’s influence than individual decisions. Nevertheless, further research is needed to reveal these factors and increase efficiency in international HTA decision-making processes.

OP55 Did It Matter? Developing A Common Framework For Characterizing Impact Of Patient Involvement In Health Technology Assessment

IntroductionWhile the impact of health technology assessments (HTAs) is often not evaluated, some HTA bodies measure the impact of patient involvement in their processes. Evaluating how patient involvement is perceived by all stakeholders may help to improve practices and avoid activities that unduly burden patient and HTA communities. Frameworks and tools have been designed to analyze the impact of patient engagement along the healthcare development lifecycle. Reporting on the impact of patient involvement in HTA-specific activities, however, continues to be infrequent, unstandardized, and not comprehensive.Having a common framework to characterize and report on the impact of patient involvement may enable this practice to be optimized and harmonized across HTA contexts.MethodsThe Patient and Citizen Involvement Interest Group (PCIG) within Health Technology Assessment International set out to contextualize this impact and support reporting. A questionnaire was developed, piloted, and rolled out to collect multistakeholder personal perceptions of the impact of patient involvement in individual HTAs. Questions included: “What difference did you feel patient involvement made in the HTA activity?” and “What would have been missed without patient involvement?”. From January 2019 to September 2021, 24 responses (including one joint submission) were collected through the PCIG’s network from HTA bodies (11), patient representatives (12), and industry representatives (2) from North America (5), South America (3), Europe (13), and Australia (3).ResultsCommon themes were extracted from these experiences to characterize the impact of patient participation in HTA processes. Based on these commonalities, a harmonized framework consisting of three “domains” is proposed: impact on the decision-making process; impact on patient stakeholders; and impact on the HTA body. The framework includes a set of items under each domain to support reporting.ConclusionsBy having common language and measures, the HTA community can harmonize processes across jurisdictions to evaluate and communicate the value of patient involvement in HTA. Improving consistent reporting may facilitate more efficient process improvement for meaningful integration of patient stakeholders into HTA decision-making.

PP21 Are We Ready For It? Developing Criteria To Include Artificial Intelligence Medical Devices (AI-MDs) For Health Technology Assessment

IntroductionThe increasing pace at which artificial intelligence medical devices (AI-MDs) or digital health technologies (DHTs) have been introduced and integrated in healthcare has not been matched with appropriate selection criteria for health technology assessment (HTA) to inform funding decision-making. To align with international best practice and local regulatory guidance, the Agency for Care Effectiveness (ACE) developed criteria to include AI-MDs as part of its 2022 topic prioritization process for medical technologies. This abstract describes ACE’s approach to develop the inclusion criteria.MethodsTo develop key principles for including AI-MDs in ACE’s topic prioritization process, relevant information from overseas HTA agencies, local regulatory guidelines, and ACE’s existing topic selection criteria were reviewed. A search of international HTA agency websites was conducted in September 2022 to identify relevant information on inclusion of AI-MDs in healthcare for reimbursement recommendations.Additionally, local regulatory guidelines for AI-MDs in healthcare were also identified. The inclusion criteria were then piloted with AI-MDs identified from ACE’s horizon scanning workstream to examine their feasibility for HTA topic selection.ResultsOne overseas framework on DHTs from the National Institute for Health and Care Excellence (NICE) and two local regulatory guidelines were identified. Based on the key finding that the purpose of AI-MD use in guiding clinical management and its associated risks were important considerations, the following criteria were developed: (i) full registration with the regulatory body;(ii) device characteristics should be interventional, have direct impact on patient safety, or support accurate diagnosis or treatment which is critical to avoid death and serious health deterioration; and (iii) the AI algorithm should be fixed as opposed to adaptable as per regulatory requirements. Using this inclusion criteria, eight AI-MDs surfaced from horizon scanning were screened with the above criteria and deemed suitable for HTA topic selection.ConclusionsAs AI technologies are increasingly used to replace or supplement current clinical practice, continuous adaptation of HTA method is needed to ensure appropriate topic selection.

The international HTA database returned incomplete search results for NICE technology appraisals: An exploratory study and discussion of the implications

AbstractIntroductionThe International Network of Agencies for Health Technology Assessment (INAHTA) database offers a single point of access for identifying technology appraisals, in contrast to searching multiple websites directly. The aim of this research is to compare the coverage of the INAHTA and Centre for Reviews and Dissemination (CRD) Health Technology Assessment (HTA) databases with direct searching on the National Institute for Health and Care Excellence (NICE) website to identify Technology Appraisals published by NICE.MethodsNICE Technology Appraisals were downloaded from the NICE website (April 2022). Technology Appraisals were randomized and the first 20 Technology Appraisals constituted data for analysis. The INAHTA and CRD HTA databases were searched to determine if the 20 Technology Appraisals available on the NICE website were also available for retrieval.ResultsCoverage was incomplete. INAHTA: 15 of 20 Technology Appraisals (75%) were not identified via full title or intervention‐specific searches. CRD HTA: 7 of 12 Technology Appraisals (58%) that were published before the last update of the database were not identified.ConclusionFindings indicate that researchers seeking to identify NICE Technology Appraisals should search the NICE website directly. How this finding impacts identification of guidance from other agencies should be evaluated.

OP09 Developing A Patient And Consumer Training Tool Explaining Health Technology Assessment And Patient/Consumer Participation: The French Experience

IntroductionThe French National Authority for Health’s (HAS) 2019-2024 strategic workplan called for “making public involvement a priority.” This project was designed within the roadmap validated in 2021; “Strengthening public involvement in health technology assessment (HTA) at the HAS”, including an action of building a means of training patient organizations for their contribution. The project’s overall objective was to develop with patients and consumers a first training tool, representing an online knowledge base targeting French patients and consumers to explain the HAS HTA process and assist their participation in these assessments.MethodsThree stages were designed to meet this objective. Firstly, an international benchmark was performed of available online HTA training tools for patients and consumers, notably those used by HTA bodies and European and international patient and consumer groups (PCGs). Secondly, an internal HAS search for e-learning tools, was conducted to identify whether they could meet the training needs of French patients and consumers. Finally, the training tool was developed via a working group composed of patients and HAS scientific officers.ResultsThe benchmark identified 82 online training tools selected according to the specified inclusion criteria. Sixteen international HTA agencies, nine European and international PCGs and 13 other bodies provided online HTA training tools for patients and consumers during the research period, but no journal articles identified such tools. Eleven formats and 12 key themes, divided into two main categories were identified: important content related to HTA, and important content related to public involvement in HTA. The HAS search for e-learning tools resulted in internal e-learning tools offered for clinical experts not meeting the needs and preferences of patients and consumers. Finally, HAS based its training tool development on these preferences and needs to create a PowerPoint in two blocks of modules covering the two main categories above (six modules in total).ConclusionsFrench patients and consumers preferences and needs for a HTA training tool were inspired by the international benchmark, dividing key themes into two main categories: important content related to HTA, and important content related to public involvement in HTA. This resulted in HAS development of two blocks of modules in PowerPoint format covering these two categories.

OP08 International Benchmarking Of Health Technology Assessment Training Tools And Materials For Patients And Consumers

IntroductionThe objective was to conduct a benchmarking study of available online health technology assessment (HTA) training tools for patients, specifically those used by HTA agencies and major European and international patient and consumer groups (PCGs). We compared existing online training tools on this topic in order to develop in-house HTA training tools for French patients and consumers.MethodsA literature search and a scoping review of websites was conducted by including the websites of HTA agencies, European and international PCGs, and other bodies. This was supplemented with videoconference interviews with selected HTA agencies and patient groups. The inclusion criterion was the existence of content describing HTA and patient and public involvement (PPI) in HTA that PCGs could use (regardless of its format).ResultsEighty-two online training tools were selected according to the specified inclusion criterion. Sixteen international HTA bodies, nine European and international PCGs, and 13 other bodies provided online HTA training tools available for patients and consumers. No journal articles matching the inclusion criterion were found. Two broad categories of content were identified: the first relating to HTA and the second relating to PPI in HTA. Moreover, the formats of these tools ranged from interactive to non-interactive, with varying accessibility (freely available or with a paywall) and assessment methods.ConclusionsThese results should be considered together with budget requirements, project time constraints, human resources, and the preferences of HAS and patients when developing HTA training tools to improve the participation of patients and consumers in the HTA process at HAS.

Cost-Effectiveness of Pharmacist Care in Diabetes Management: A Systematic Review.

In recent years, the role of pharmacists has undergone significant transformation to become more patient-centered and involved in managing chronic diseases. Nonetheless, it remains unclear whether pharmacist involvement in diabetes management is cost-effective. This study aimed to systematically review the cost-effectiveness and reporting quality in comprehensive economic evaluations of pharmacist management compared to standard care in diabetes. Eligible studies included cost-effectiveness analyses employing pharmacist professional services as the intervention for diabetes. A literature search was conducted in the bibliographic databases Pubmed, Scopus, China National Knowledge Infrastructure (CNKI), and the International Health Technology Assessment (HTA) database from their inception until July 2023. Two independent reviewers performed title, abstract, full-text screening, and data abstraction and assessed the quality of reporting and methodological approaches using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS 2022) checklists. Twelve studies were identified with an average research quality score of 19.8, including cost-utility (n = 5) and cost-effectiveness (n = 7) analyses, with only four studies rated as high quality. The efficacy data were derived from randomized controlled trials (n = 7), retrospective studies (n = 2), and published literature sources (n = 2). Half of the included studies were conducted in high-income countries, while the other half was in upper-middle and lower-middle-income countries, respectively. Despite significant variations in the cost of pharmacist intervention, consistent findings demonstrate that pharmacist involvement in diabetes management is more cost-effective or even cost-saving than standard care, primarily attributed to better glycemic control, enhanced patient compliance, and reduced risks of medication-related problems. This systematic review substantiates that pharmacist involvement in diabetes management is cost-effective compared with standard care. However, the overall quality of reporting needs to be improved, and high-quality evidence is urgently needed to support healthcare decision-making in pharmacy practice.

A Meta-Review to Guide Military Screening andTreatment ofGambling Problems.

Excessive gambling can cause substantial biopsychosocial problems (e.g., difficulties with finances, relationships, mental, and physical health). For military Service Members, it can also result in security clearance denial or revocation, failure to achieve promotions, and premature career termination. Recent congressional mandates have obligated the U.S. Department of Defense to screen for problematic gambling, the predictive values of which are a function of (i) problem prevalence and (ii) tool sensitivity and specificity. This meta-review (i.e., systematic review of systematic reviews) on the screening properties of gambling assessment tools and the effectiveness of treatments for gambling disorder is to inform military services on responding to Service Members' gambling problems. EBSCO Discovery Service, PubMed, PsycINFO, Ovid Medline, Social Care Online, Epistemonikos, International Health Technology Assessment, and the Cochrane Central Register of Controlled Trials electronic databases were searched up to December 2022 for systematic reviews and meta-analyses on measurements of adult subclinical or gambling, and interventions targeting individuals with GD. Three and four studies were included in each section of the current meta-review (i.e., assessment tools and treatment). For review 1, the estimated risk of bias was assessed using the Risk of Bias in Systematic Reviews. Thirty-one tools were identified through the three systematic reviews. All had modest sensitivities and specificities; combined with low prevalences in the general SM population, positive results would be incorrect 64-99% of the time. However, if screening were conducted with SMs referred for alcohol problems, a positive result on the best screening tools would be correct 76% of the time. Several commonly used treatment approaches had demonstrated efficacy for GD. The combination of low prevalence of GD and subclinical gambling problems in the general population, coupled with modest sensitivity and specificity, makes screening unfeasible in the general SM population. However, dual-phase screening in higher-prevalence subpopulations (i.e., SMs already identified with substance-abuse or mental-health problems) would be viable. Regarding treatment, several interventions-already used in military healthcare-with extensive empirical track records have been successfully used to treat adults with GD.