Technology Assessment Framework Research Articles

Bridging the Visualization Gap

The integration of three-dimensional (3D) modelling tools in educational settings promises a transformative shift in teaching complex concepts. Despite their potential, the actual deployment of such tools faces substantial pedagogical and technical challenges, primarily due to the "visualization gap" between traditional 2D resources and 3D constructs. This gap can significantly hinder students' understanding and retention of complex spatial concepts critical in disciplines such as medicine, engineering, and architecture. To address these challenges, this paper introduces the Integrated VR Educational Technology Assessment (IVRETA) framework, designed to evaluate and guides the development of virtual reality (VR) and augmented reality (AR) tools in education. IVRETA assesses tools across three dimensions: Interaction and Usability, Learning Enhancement, and Authentic Pedagogy and Adaptability. Applying this framework, we evaluate 3D Whiteboard, a practical tool designed to facilitate dynamic interaction with 3D models and enhance educational outcomes through immersive learning experiences. The paper underscores the potential of the 3D Whiteboard in bridging the visualization gap and improving educational practices across various disciplines, demonstrating how IVRETA can guide the assessment and improvement of educational technologies. By providing a robust foundation for the development and enhancement of educational technologies, IVRETA supports ongoing innovation in educational settings.

The Development of a New Approach for the Harmonized Multi-Sectoral and Multi-Country Cost Valuation of Services: The PECUNIA Reference Unit Cost (RUC) Templates.

Increasing healthcare costs require evidence-based resource use allocation for which assessing costs rigorously and comparably is crucial. Harmonized cross-country costing methods for evaluating interventions from a societal perspective are lacking. This study presents the development process and content of the service costing templates developed as part of the European project PECUNIA. The six developmental steps towards technological readiness of the templates included (1) a common conceptual costing framework and review of methodological costing issues, (2) harmonization strategy formulation, (3) proof-of-concept with expert feedback, (4) piloting, (5) validation, and (6) demonstration in six European countries. The PECUNIA Reference Unit Cost (RUC) Templates for service costing are three new self-completion tools to be used with secondary or primary data for top-down micro-costing or top-down gross-costing approaches. Complementary data collection and unit cost aggregation/weighting templates are available. The applications leading to the final versions including (4) piloting through calculation of 15-unit costs, (5) validation within a Health Technology Assessment framework, and (6) RUC calculations mostly based on secondary data demonstrated the templates' general feasibility, with feedback for improved usability incorporated and a supplementary user guide developed. The validated PECUNIA RUC Templates for multi-sectoral and multi-country service costing allow for harmonized RUC development while incorporating flexibility and transparency in the choice of costing approaches, data sources and magnitude of remaining heterogeneity. The templates are expected to significantly improve the quality, comparability and availability of unit costs for economic evaluations, and promote the transferability of service cost information across Europe.

Health technology assessment implementation in WHO South-East Asia Region: a realist review protocol.

A robust Health Technology Assessment (HTA) framework is crucial to address the rising burden of healthcare costs and to inform decision-making to promote high-quality health systems. This research aims to describe the HTA methods and mechanisms for the successful implementation of HTA in the WHO South-East Asia region, and contextualize the synthesized evidence relevant to Indian settings. Realist review involves developing a program theory by conducting a systematic search strategy, screening, study selection, data extraction, and data synthesis. A systematic search for literature will be conducted on PubMed (NCBI), EMBASE (Elsevier), Scopus (Elsevier), Web of Science (Clarivate), and ProQuest Central for identifying the methods used for HTA of health technology interventions. Stakeholder consultations will be conducted to develop a program theory following the Context-Mechanism-Outcome configurations (CMOcs) framework. Searches for primary evidence will be conducted iteratively. Data will be extracted and tested against the programme theory. The proposed realist review will be reported as per the Realist and MEta-narrative Evidence Syntheses: Evolving Standards [RAMESES II] guidelines. To our knowledge, there has been no comprehensive review conducted to understand the mechanisms of HTA methods in the WHO South-East Asia region. The findings from the realist review will help us understand the mechanisms through which the HTA could work in WHO South-East Asian countries. We will then contextualize the findings obtained from evidence to Indian settings, based on program theory development through stakeholder consultation. A framework will be developed that can be used by policymakers/HTA experts in India for effective implementation of the same.

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review.

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking. This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices. We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites. A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation). The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Intelligent Technology Assessment of High-Speed Railway Based on Knowledge Graphs

This paper introduces an intelligent technology assessment framework for high-speed railways based on a knowledge graph approach. We employ rule-based knowledge extraction algorithms and a Bert-BiLSTM-CRF model for entity extraction from technical texts. Subsequently, we establish relationships among various entities, constructing a knowledge graph specific to high-peed railways. The knowledge graph is stored in a Neo4j graph database in triple format. Furthermore, we establish a comprehensive evaluation metric system, integrating knowledge graph insights to assess the utility of enabling technologies. We employ the CRITIC weighting method to calculate the value assessment results for target technologies. Simulation results indicate that the training results for word segmentation and sentence splitting are favorable, and the Bert-BiLSTM-CRF model achieves convergence in accuracy, recall, and F1 score after 30 iterations. The technical assessment results in this paper align closely with the actual technological value assessment.

An operationalization framework for lifecycle health technology assessment: a Health Technology Assessment International Global Policy Forum Task Force report.

Operationalization guidance is needed to support health technology assessment (HTA) bodies considering implementing lifecycle HTA (LC-HTA) approaches. The 2022 Health Technology Assessment International (HTAi) Global Policy Forum (GPF) established a Task Force to develop a position paper on LC-HTA. In its first paper, the Task Force established a definition and framework for LC-HTA in order to tailor it to specific decision problems. This second paper focused on the provision of practical operational guidance to implement LC-HTA. Detailed descriptions of the three LC-HTA operational steps are provided (defining the decision problem, sequencing of HTA activities, and developing optimization criteria) and accompanied by worked examples and an operationalization checklist with 20 different questions for HTA bodies to consider when developing an LC-HTA approach. The questions were designed to be applicable across different types of HTA and scenarios, and require adaptation to local jurisdictions, remits, and context.

Comparison of Indocyanine Green with conventional tracers for sentinel lymph node biopsy in breast cancer: A multidisciplinary evaluation of clinical effectiveness, safety, organizational and economic impact.

Breast cancer is a global health problem, and sentinel lymph node biopsy (SLNB) is the standard procedure for early-stage breast cancer. Technetium-99 (TC-99), alone or combined with blue dye (BD) are conventional tracers for SLNB, but they have safety, availability, and cost limitations. Indocyanine green (ICG) is an alternative tracer that has been gaining acceptance among healthcare professionals. This study aimed at assessing the clinical and economic value of ICG in hospital settings, using the health technology assessment (HTA) framework. We conducted a comprehensive evaluation of ICG for SLNB, based on literature sources and data collected from two Italian hospitals that switched from TC-99 to ICG. We analyzed ICG's technical attributes through technology documentation and relevant databases. We performed a systematic literature review of 36 studies to assess the clinical effectiveness and safety of ICG. We obtained organizational insights from clinicians and the clinical engineer involved in the study. We applied Time-Driven Activity-Based Costing (TDABC) and Budget Impact Analysis (BIA) to estimate the economic impact of ICG. The ethical, legal, and social implications of ICG were considered through clinicians' inputs and technology documentation. Our results showed that ICG had equivalent or superior clinical effectiveness compared to TC-99 and BD, with minimal adverse events. ICG simplified the surgical pathways, by streamlining procedures, reducing waiting times, and increasing flexibility in scheduling surgeries. Moreover, the TDABC analysis showed significant cost reductions by avoiding the need for pre-operative lymphoscintigraphy and hospitalization, with average savings per single care pathway of around 18% for ICG compared to TC-99. Finally, ICG improved patient experience, and proved regulatory compliance. This study provided strong evidence for ICG's clinical and economic value for SLNB in breast cancer. It ascertained ICG as a valuable alternative to conventional tracers, ensuring clinical effectiveness along with economic and organizational benefits.

Commissioning [Integrated] Care in England: An Analysis of the Current Decision Context

Background: The emergence of Integrated Care Systems (ICSs) across England poses an additional challenge and responsibility for local commissioners to accelerate the implementation of integrated care programmes and improve the overall efficiency across the system. To do this, ICS healthcare commissioners could learn from the experience of the former local commissioning structures and identify areas of improvement in the commissioning process. 
 Aim & Audience: This study describes the investment decision process in integrated care amid the transition toward ICSs, highlights challenges, and provides recommendations to inform ICSs in their healthcare commissioning role. It is expected that this study encourages an open discussion within the emerging ICSs on the barriers and enablers of the local commissioning of integrated care. We also believe that findings of this study are likely to be of international interest as countries are gradually moving towards integrated care, and local purchasers of healthcare from high-income economies are likely to encounter similar challenges as the ones faced by local commissioners in England.
 Methods: We conducted twenty-six semi-structured interviews with local commissioners and other relevant stakeholders in South East England in 2021. Interviews were supplemented with existing evidence from the literature.
 Results: England’s local healthcare commissioning has made the transition towards a new organisational architecture, with some integrated care programmes running, and a dual top-down and bottom-up prioritisation process in place. The commissioning and consequent development of integrated care programmes have been hindered by various barriers, including difficulties in accessing and using information, operational challenges, and resource constraints. Investment decisions have mainly been driven by national directives and budget considerations, with a mixture of subjective and objective approaches. This contrasts with what seems to be a set of desirable prioritisation criteria, with the triple aim framework at the front. A systematic and data-driven framework could replace this ad-hoc prioritisation of integrated care and contribute to a more rational and transparent commissioning process. To develop such a framework, a good reference point could be the health technology assessment framework established at national level to guide priority-setting decisions. 
 Conclusion & next-steps: The local healthcare commissioning structures in England are complex, the evidence available is rich, and integrated care is undoubtedly the goal to achieve. However, the multiple barriers that commissioners face hinder the development of integrated care programmes and limit the local use of evidence in healthcare decision-making. The emerging ICSs seem to open an opportunity for local commissioners to strengthen the commissioning process of integrated care with evidence-based priority-setting approaches similar to the well-established health technology assessment framework at the national level. To support this, we are developing a data-driven framework to monitor and assess ‘integrated care programmes’. 

OP102 Towards Universal Health Coverage: Health Technology Assessment Roadmap Development In The Emirate Of Abu Dhabi Involving The Whole Ecosystem

IntroductionThe mission of the Department of Health (DoH) of Abu Dhabi in the United Arab Emirates is to provide its population with a healthy life and world leading preventive and curative services. While the DoH has regulations in place to grant market approval to new health technologies, there is a need to develop a clear overall framework for reimbursement and disinvestment decisions. Establishing a structured health technology assessment (HTA) framework is critical for informing decisions on health technologies that offer value for money, with the aim of improving equitable access to health care, financial risk protection, and, ultimately, better health outcomes.MethodsDuring 2022, the DoH collaborated with the Radboud University Medical Center to explore the feasibility of applying an evidence-informed deliberative process (EDP) HTA approach through workshops and interviews involving all stakeholders in the ecosystem, such as policy makers, principal investigators, providers, patients and public groups, product manufacturers, payers, and purchasers. A situational analysis was conducted to collect stakeholders’ views and build EDPs. Based on this analysis, a structured roadmap was developed.ResultsThe comprehensive five-year roadmap to implement a holistic HTA framework in Abu Dhabi consisted of five major elements, starting with the establishment of an appropriate HTA policy framework as a foundation. Abu Dhabi should firmly establish its HTA structure and program (in one to two years), and at the same time invest in developing and retaining HTA training capacity so that over time (within three to five years) the country can build up its own expertise to sustain the program. This needs to be accompanied by continuous awareness raising among all relevant stakeholders.ConclusionsThis roadmap is the first and most important step toward implementing a holistic HTA framework in Abu Dhabi. Technical work needs to be complemented by continuously raising awareness and involving all relevant stakeholders. Looking at the initial results and international benchmarks, HTA will significantly contribute to achieving a sustainable, high quality healthcare system.

Embedding the Patient-Citizen Perspective into an Operational Framework for the Development and the Introduction of New Technologies in Rehabilitation Care: The Smart&Touch-ID Model.

To date, at least 2.41 billion people with Non-Communicable Diseases (NCDs) are in need of rehabilitation. Rehabilitation care through innovative technologies is the ideal candidate to reach all people with NCDs in need. To obtain these innovative solutions available in the public health system calls for a rigorous multidimensional evaluation that, with an articulated approach, is carried out through the Health Technology Assessment (HTA) methodology. In this context, the aim of the present paper is to illustrate how the Smart&TouchID (STID) model addresses the need to incorporate patients' evaluations into a multidimensional technology assessment framework by presenting a feasibility study of model application with regard to the rehabilitation experiences of people living with NCDs. After sketching out the STID model's vision and operational process, preliminary evidence on the experiences and attitudes of patients and citizens on rehabilitation care will be described and discussed, showing how they operate, enabling the co-design of technological solutions with a multi-stakeholder approach. Implications for public health are discussed including the view on the STID model as a tool to be integrated into public health governance strategies aimed at tuning the agenda-setting of innovation in rehabilitation care through a participatory methodology.

Real-world data for precision cancer medicine-A European perspective.

Leveraging real-world data (RWD) for drug access is necessary to overcome a key challenge of modern precision oncology: tackling numerous low-prevalence oncogenic mutations across cancers. Withholding a potentially active medication in patients with rare mutations for the sake of control chemotherapy or "best" supportive care is neither practicable nor ethically justifiable anymore, particularly as RWD could meanwhile be used instead, according to scientific principles outlined by the US Food and Drug Administration, European Medicines Agency and other stakeholders. However, practical implementation varies, with occasionally opposite recommendations based on the same evidence in different countries. In the face of growing need for precision drugs, more transparency of evaluation, a priori availability of guidance for the academia and industry, as well as a harmonized framework for health technology assessment across the European Union (EU) are imperative. These could in turn trigger infrastructural changes in national and pan-European registries, cancer management guidelines (e.g., frequency of routine radiologic restaging, inclusion of patient-reported outcomes), and the health data space, to ensure conformity with declared standards and facilitate extraction of RWD sets (including patient-level data) suitable for approval and pricing with minimal effort. For an EU-wide unification of precision cancer medicine, collective negotiation of drug supply contracts and funding solidarity would additionally be required to handle the financial burden. According to experience from pivotal European programs, off-label use could potentially also be harmonized across EU-states to accelerate availability of novel drugs, streamline collection of valuable RWD, and mitigate related costs through wider partnerships with pharmaceutical companies.

HTA191 Health Technology Assessment in Greece: Evaluation of Current Status and Prospects

To investigate strengths, weaknesses and opportunities for development of the recently established Health Technology Assessment framework in Greece.

HTA supporting clinical practice: the case of surgical repair of thoracoabdominal aortic aneurysms

Abstract Background Thoracoabdominal aortic aneurysms (TAAAs) are defined as those aortic aneurysms involving renovisceral arteries. They account for around 10% of aortic aneurysms, and their treatment is burdened by considerable mortality and morbidity. Open surgical repair has been practised as the standard of care since the 1950s. In 2001 endovascular repair was introduced to reduce treatment invasiveness, and the technology is still evolving. The potential benefits of endovascular repair over open surgery should be carefully weighed in a multidimensional framework. Methods We applied the Health Technology Assessment (HTA) framework (EUnetHTA core model with 9 dimensions) to conduct a report comparing the two technologies. A multidisciplinary working group was established. We derived and pooled: i) secondary data derived from systematic literature reviews, and ii) original data from IRCCS San Raffaele Hospital, Milan, a national referral centre for TAAA (qualitative and economic data). Results Endovascular repair resulted superior to the traditional open surgery in terms of efficacy and safety, as justified by the meta-analysis we performed. Despite the higher costs, a significant impact on budget and slightly lower cost-effectiveness, the endovascular protheses’ adoption could provide conspicuous benefits in terms of social and ethical dimensions without affecting long-term organisational and legal aspects. Conclusions The multi-criteria decision analysis carried out from a hospital point of view shows that there is no significant difference (final score endovascular repair 0.68 vs open surgery 0.63) between the two procedures considering all the dimensions. Still, the endovascular repair is slightly superior to the open surgery in terms of safety, effectiveness, social, ethical, legal, and organisational impact. From the policy maker’s point of view, technologies with a score superior to 0.6 are equally valuable, and the final decision should be left to the clinicians. Key messages • Further research is needed to compare endovascular prostheses and open surgery’s long-term population benefits, balancing clinical, economic, organisational and patient-related outcomes. • HTA methodology offers substantial support to compare in-use technologies, informing clinicians’ and decision-makers’ choices to strengthen healthcare provision equity and preparedness.

Commissioning [Integrated] Care in England: An Analysis of the Current Decision Context.

Background:The emergence of Integrated Care Systems (ICSs) across England poses an additional challenge and responsibility for local commissioners to accelerate the implementation of integrated care programmes and improve the overall efficiency across the system. To do this, ICS healthcare commissioners could learn from the experience of the former local commissioning structures and identify areas of improvement in the commissioning process. This study describes the investment decision process in integrated care amid the transition toward ICSs, highlights challenges, and provides recommendations to inform ICSs in their healthcare commissioning role.Methods:Twenty-six semi-structured interviews were conducted with local commissioners and other relevant stakeholders in South East England in 2021. Interviews were supplemented with literature.Results:England’s local healthcare commissioning has made the transition towards a new organisational architecture, with some integrated care programmes running, and a dual top-down and bottom-up prioritisation process in place. The commissioning and consequent development of integrated care programmes have been hindered by various barriers, including difficulties in accessing and using information, operational challenges, and resource constraints. Investment decisions have mainly been driven by national directives and budget considerations, with a mixture of subjective and objective approaches. A systematic and data-driven framework could replace this ad-hoc prioritisation of integrated care and contribute to a more rational and transparent commissioning process.Conclusion:The emerging ICSs seem to open an opportunity for local commissioners to strengthen the commissioning process of integrated care with evidence-based priority-setting approaches similar to the well-established health technology assessment framework at the national level.

Assessing the value of precision medicine health technologies to detect and manage melanoma.

Assessing the value of precision medicine health technologies to detect and manage melanoma.

A Technology Development Matrix for Carbon Capture: Technology Status and R&D Gap Assessment

Numerous carbon capture, utilization, and storage (CCUS) technologies are under development to reduce CO2 emissions. To evaluate the status of a CCUS technology under development and identify potential gaps for further advancement, we have established a new technology assessment framework and are developing a decision-making tool, the technology development matrix (TDM), starting with available carbon capture technology (CCT) data. TDM is a data inventory system and screening tool. As a screening tool, it can be used for resource allocation decisions in research, development, and deployment (RD&D) by academia, government, and industry. It shares data with techno-economic analysis (TEA) and life-cycle assessment (LCA) tools as an inventory system. By using available data, this TDM framework has been demonstrated on amine-based (monoethanolamine) absorption post-combustion CO2 capture, for pulverized coal (PC) power plant flue gas, as the best available technology (BAT) for comparison. Three groups of promising post-combustion CCTs under development are presented as Alternative Technology (Alt Tech) case studies, including membrane, solid adsorption, and calcium-based chemical looping. By using available data, preliminary analysis enabled technology benchmarking and highlighted knowledge, data, and technology gaps, all providing potential future RD&D focus.

Hospital-Based Health Technology Assessment of Machine Perfusion Systems for Human Liver Transplantation

Based on published data, we have carried out a hospital-based health technology assessment of machine perfusion in adult liver transplantation using cold storage as a comparator, and within the perspective of a national health system-based hospital practice and disease-related group reimbursement policy. A systematic literature review on machine perfusion for adult liver transplantation was conducted exploring the Pubmed, CINAHL, Scopus, Embase, and Cochrane databases. The literature was analyzed with the intent to provide information on 6 dimensions and 19 items of the hospital-based health technology assessment framework derived from previous studies. Out of 705 references, 47 (6.7%) were retained for current analysis. Use of machine perfusion was associated with advantages over cold storage, i.e., a 10%–50% reduced risk for early allograft dysfunction, 7%–15% less ischemia reperfusion injury; 7%–50% fewer ischemic biliary complications, comparable or improved 1-year graft and patient survival, and up to a 50% lower graft discard rate. Hospital stay was not longer, and technical failures were anecdotal. Information on costs of machine perfusion is limited, but this technology is projected to increase hospital costs while cost-effectiveness analysis requires data over the transplant patient lifetime. No hospital-based health technology assessment study on machine perfusion in liver transplantation was previously conducted. From the hospital perspective, there is evidence of the clinical advantages of this novel technology, but strategies to counterbalance the increased costs of liver transplantation are urgently needed. Further studies should focus on the ethical, social, and organizational issues related to machine perfusion.

Development and assessment of an integrated anatomy mobile app

Curricular hours for anatomical sub-disciplines (gross anatomy, embryology, histology, and neuroanatomy) continue to decline, while medical schools are simultaneously transitioning to systems-based, vertically integrated curricula. This requires students to learn and integrate all basic science content for a learning block prior to the summative assessment. Currently, no educational technology resource exists that integrates the four anatomical sub-disciplines into a single resource to supplement integrated curricula. The objective of this study was to assess a novel integrated anatomical sciences mobile app for medical students. The 4natomy mobile app was developed to integrate the four sub-disciplines for a single topic, the spinal cord. The app was distributed to first-year medical students during the neurological disorders learning. Following the learning block, assessment of the student acceptance and experience with the app was conducted through a technology acceptance model (TAM) framework survey. The results indicated that students found the app to be useful (p < 0.001) and easy to use (p < 0.05), predicting continued future usage of the app. Students requested expanded anatomy content for the entire learning block, as well as more clinical correlations, videos, and animations. The integrated anatomy mobile app developed in this study was useful and easy to use, indicating continued use within an integrated medical curriculum. This was the first study to utilize the TAM as a conceptual framework for technology assessment in medical education, suggesting that future studies that develop new technologies should adapt the TAM for user testing.

Health technology assessment: a tool for evidence-based decisions for quality health care in India

Health technology assessment is widely used methodology internationally for optimization of healthcare resource allocation. It is a multidisciplinary process that gathers policy relevant evidence about the clinical effectiveness, cost effectiveness, ethical and social issues related to the use of a health intervention in a systematic, comprehensive, transparent and robust manner to help policy makers in decision making while formulating policies for incorporating or excluding health interventions from the health system. In order to achieve the ultimate goal of universal health coverage, Government of India has set up health technology assessment in India under the department of health research, ministry of health and family welfare. The health technology assessment framework in India must utilize its entire capacity to guide government and policy makers in explicit priority setting that ensures that available health budgets are spent after weighing all options, and coming to a fair and just conclusion.

Technologies for Medication Adherence Monitoring and Technology Assessment Criteria: Narrative Review.

BackgroundAccurate measurement and monitoring of patient medication adherence is a global challenge because of the absence of gold standard methods for adherence measurement. Recent attention has been directed toward the adoption of technologies for medication adherence monitoring, as they provide the opportunity for continuous tracking of individual medication adherence behavior. However, current medication adherence monitoring technologies vary according to their technical features and data capture methods, leading to differences in their respective advantages and limitations. Overall, appropriate criteria to guide the assessment of medication adherence monitoring technologies for optimal adoption and use are lacking.ObjectiveThis study aims to provide a narrative review of current medication adherence monitoring technologies and propose a set of technology assessment criteria to support technology development and adoption.MethodsA literature search was conducted on PubMed, Scopus, CINAHL, and ProQuest Technology Collection (2010-present) using the combination of keywords medication adherence, measurement technology, and monitoring technology. The selection focused on studies related to medication adherence monitoring technology and its development and use. The technological features, data capture methods, and potential advantages and limitations of the identified technology applications were extracted. Methods for using data for adherence monitoring were also identified. Common recurring elements were synthesized as potential technology assessment criteria.ResultsOf the 3865 articles retrieved, 98 (2.54%) were included in the final review, which reported a variety of technology applications for monitoring medication adherence, including electronic pill bottles or boxes, ingestible sensors, electronic medication management systems, blister pack technology, patient self-report technology, video-based technology, and motion sensor technology. Technical features varied by technology type, with common expectations for using these technologies to accurately monitor medication adherence and increase adoption in patients’ daily lives owing to their unobtrusiveness and convenience of use. Most technologies were able to provide real-time monitoring of medication-taking behaviors but relied on proxy measures of medication adherence. Successful implementation of these technologies in clinical settings has rarely been reported. In all, 28 technology assessment criteria were identified and organized into the following five categories: development information, technology features, adherence to data collection and management, feasibility and implementation, and acceptability and usability.ConclusionsThis narrative review summarizes the technical features, data capture methods, and various advantages and limitations of medication adherence monitoring technology reported in the literature and the proposed criteria for assessing medication adherence monitoring technologies. This collection of assessment criteria can be a useful tool to guide the development and selection of relevant technologies, facilitating the optimal adoption and effective use of technology to improve medication adherence outcomes. Future studies are needed to further validate the medication adherence monitoring technology assessment criteria and construct an appropriate technology assessment framework.