The authorization process of observational studies in Italy: exploring two decades of Ethics Committee approval data.

The evaluation of pharmaceutical innovation and therapeutic value is an increasingly complex exercise for which different approaches are adopted at the national level, despite the need for standardisation of processes and harmonisation of public health decisions. The objective of our analysis was to compare the approaches of the AIFA (Agenzia Italiana del Farmaco) and the HAS (Haute Autorité de Santé) in assessing the same medicinal products. In Italy, the 1525/2017 AIFA Deliberation introduces a transparent scheme for the evaluation of innovative status (innovative, conditional, not innovative) based on the therapeutic added value (TAV), therapeutic need, and quality of evidence. In contrast, in France, the HAS makes judgements using the effective clinical benefit (Service Médical Rendu) and improvement of effective clinical benefit (Amélioration du Service Médical Rendu, ASMR). This analysis focused on medicinal products evaluated both by the AIFA and by the HAS from July 2017 to September 2021. Similarities between AIFA and HAS evaluations were investigated in terms of the TAV, recognition of innovativeness, and the ASMR. Both total and partial agreements were considered relevant. Therefore, raw agreement, Cohen's kappa (weighted and unweighted), and Bangdiwala's B-statistic were estimated. A total of 102 medicinal products were included in this study. Out of these, 38 (37.2%) were orphan drugs, while 56 (54.9%) had a clinical indication for the treatment of cancer. The AIFA and HAS reached a higher level of agreement on the innovativeness status compared with the TAV. A moderate total agreement emerged in the recognition of innovativeness (k = 0.463, p-value ≤0.0001), and partial agreement was substantial (equal weight k = 0.547, squared k = 0.638), while a lack of agreement resulted in a comparison of the TAV according to the AIFA and the ASMR recognised by the HAS. Indeed, whereas the AIFA determined the TAV to be important, the HAS considered it to be moderate. In addition, whereas the AIFA identified a bias towards a moderate TAV, the HAS identified a bias towards a minor ASMR. A higher level of agreement was reached, both on the TAV and on innovative status, for less critical medical products (non-cancer-related, or non-orphan, or with a standard European Medicines Agency approval). These results underline the importance of implementing European procedures that are more broadly aligned in terms of value definition criteria.

Objective: The term Spinal Muscular Atrophy (SMA) identifies a group of genetic disorders affecting spinal motor neurons. It is caused by the loss of the SMN1 gene, resulting in degeneration of spinal alpha motor neurons and muscle atrophy. This study is focused on innovative gene therapies with onasemnogene abeparvovec approved in Italy in March 2021 with full reimbursement by the National Health Service. The objective pursued is verify, by means of the CHOP-INTEND scores obtained, whether therapy with onasemnogene abeparvovec led to an improvement in the clinical picture of the treated subjects and any adverse reactions that occurred. Methods: this study was conducted by evaluating the scores in the different re-evaluations of individual patients treated in our hospital (Fondazione Policlinico Universitario Agostino Gemelli IRCCS - Rome) and comparing them with the results of the CL-303 study described in SPC (Summary of Product Characteristics). The data were extracted from the patients' clinical records on the AIFA (Agenzia Italiana del Farmaco - Italian Medicines Agency) registries, also collecting information on any post-infusion ADRs. Everything was then represented graphically to have a clear comparison with the data from the study registered for drug approval. Results: from the data obtained, 7 out of 8 patients improved their health status post infusion with, in some cases, a significant increase in score. Conclusions: this result allows us to understand how crucial it is to start treatment as soon as possible after the diagnosis of the condition as the greatest improvements were seen in subjects who received treatment within 2 months of birth.

Registries, Research, and Quality Improvement

Commentary on Point-of-Care Clinical Trials in Sports Medicine Research: Identifying Effective Treatment Interventions Through Real-World Evidence.

IntroductionDepression is a highly prevalent condition in the elderly, with a vast impact on quality of life, life expectancy, and medical outcomes. Selective serotonin reuptake inhibitors (SSRIs) are the most commonly prescribed agents in this condition and, although generally safe, tolerability issues cannot be overlooked. Vortioxetine is an antidepressant with a novel mechanism of action. Based on studies to date, it may have a promising tolerability profile in the elderly, as it does not adversely affect psychomotor or cognitive performance and does not alter cardiovascular and endocrine parameters. The present study aims to assess the tolerability profile of vortioxetine in comparison with the SSRIs considered as a single group in elderly participants with depression. The rate of participants withdrawing from treatment due to adverse events after 6 months of follow up will be the primary outcome.Methods and analysisThis is a pragmatic, multicentre, open-label, parallel-group, superiority, randomized trial funded by the Italian Medicines Agency (AIFA - Agenzia Italiana del Farmaco). Thirteen Italian Community Psychiatric Services will consecutively enrol elderly participants suffering from an episode of major depression over a period of 12 months. Participants will be assessed at baseline and after 1, 3 and 6 months of follow up. At each time point, the following validated rating scales will be administered: Montgomery–Åsberg Depression Rating Scale (MADRS), Antidepressant Side-Effect Checklist (ASEC), EuroQual 5 Dimensions (EQ-5D), Short Blessed Test (SBT), and Charlson Age-Comorbidity Index (CACI). Outcome assessors and the statistician will be masked to treatment allocation. A total of 358 participants (179 in each group) will be enrolled.Ethics and disseminationThis study will fully adhere to the ICH E6 Guideline for Good Clinical Practice. Participants’ data will be managed and safeguarded according to the European Data Protection Regulation 2016/679. An external Ethical Advisory Board will help guarantee high ethical standards.Trial registrationClinicaltrials.gov: NCT03779789, Registered on 19 December 2018. Submitted on 19 December. EudraCT number: 2018–001444-66.Trial statusProtocol version 1.5; 09/06/2018. Recruitment started In February 2019 and it is ongoing. It is expected to end approximately on 30 September 2021.

The 19 of February 2018 the Italian Medicines Agency (AIFA - Agenzia Italiana del Farmaco) temporary stopped the new administration of Ulipristal Acetate (UPA) for treating uterine leiomyomas symptoms, because liver injury and hepatic failure had been reported in relationship with UPA use. After the European Medicines Agency review of risks of UPA, the 3 of August 2018 the AIFA produced another note, disclosing that a cause-effect relationship between the UPA use and liver injury is not proved and that some patients can be discontinuously treated if surgery is not recommended. However, a close monitoring of hepatic function must be done in Ulipristal users. As Ulipristal has not been prescribed since February 2018 in our center, the rate of surgical operations for uterine leiomyomas significantly doubled. Therefore it will be useful know exactly which restricted indications allow to use UPA for more than 3 months. In this way it could be minimized the risks of liver injury and it could be prevented the rise of surgeries for uterine leiomyomas.

Reporting methods of observational cohort studies in CMI

ObjectivesReports of quality improvement (QI) research from low- and middle-income countries (LMICs) remain sparse in the scientific literature. The authors reviewed the published literature to describe the characteristics of such...

The General Data Protection Regulation (GDPR) is applicable as of May 25, 2018 in all member states to harmonize data privacy laws across Europe. GDPR impacts also on medical data research. Non-interventional studies (NIS) in hospital are an important part of health services research and might need to be assessed by the local data protection officer. This study investigates all NIS (in house or sponsored) initiated between April 1, 2017 and July 31, 2018 in Nuremberg Hospital and their methods dealing with the GDPR. All studies in Nuremberg Hospital have to be reported to the study center of Nuremberg Hospital. We implemented some actions to fullfill GDPR, e. g. checklist for GDPR, quality circle, and all studies were assigned to a data protection officer specialized in scientific and clinical studies. We analyzed in each study the kind of data encryption (e. g., pseudonymous vs. anonymous), the need for approval from the official ethics commitee according to §15BO, and the need for approval from the hospital data protection officer. The data was analyzed using descriptive statistics. After GDPR came into effect, more NIS were started (n=77 vs. n=59), especially investigator-initiated NIS increased significantly (+84%, p<0.01). The majority of inhouse studies were dealing with absolute anonymous data (before GDPR: n=28 anonymous vs. n=4 pseudonymous; after R: 51 vs.7; n.s.). 22 studies, mostly IITs (86%), needed a statement of the local data protection officer and used a patient's information. After GDPR 19% of in-house NIS showed the need for a statement of approval from the ethics committee (accordingly to §15BO) (before GDPR 12.5%; n.s.). One year after GDPR was implemented, the average processing time of the data protection officer for an NIS was 10.5 work days. Investigator-initiated NIS are an important part of scientific research at Nuremberg Hospital. After GDPR, there was an increase in the number of self-initiated studies. Standardized procedures and simple actions help implement GDPR in medical research without critical delays at the start of study.

Real-world evidence: Methods for assessing long-term health and effectiveness of allergy immunotherapy

IntroductionStroke is the most disabling neurological disorder and often causes spasticity. Transmucosal cannabinoids (tetrahydrocannabinol and cannabidiol (THC:CBD), Sativex) is currently available to treat spasticity-associated symptoms in patients with multiple sclerosis....

To replicateor not to replicate? Insights and interpretations from a randomized trial duplication initiative.

In the contemporary era of evidence-based medicine (EBM), the question arises as to what would constitute the best research evidence. Editors of high-quality journals have a variety of manuscripts flung at them, and for them, selecting a good manuscript is like identifying 'a cygnet from a paddling of ducklings'. Study design, which is often not correctly formulated, plays a dominant role not only in interpretation but also in the acceptance and publication of research. It has been mentioned time and again, that faulty study design can be a cause for manuscript rejection.[1] There exists a general hierarchy that ranks the type of research based on the validity of the findings and effectiveness of the intervention. There are several types of study designs, and randomised controlled trials (RCTs) were initially ranked as the highest level of evidence which has been currently replaced by meta-analysis and systematic reviews.[2] [Figure 1] In another recent modification, Murad et al. removed them from the pyramid and suggested them to be a lens through which evidence is reviewed.[3]Figure 1: Hierarchy of Level of Evidence (RCT:Randomised controlled trial; SR: Systematic review; MA: Meta-analysis)WHY ARE RCTS RATED SO HIGH? Clinical trials generally aim to ascertain whether any intervention, program, or drug treatment brings about a positive outcome for the recipients. An RCT is a prospective, comparative, interventional study of quantitative nature performed in controlled conditions in randomly selected subjects.[4] It provides the most dependable evidence of the efficacy of preventive, diagnostic, and therapeutic interventions because of the robust and rigorous scientific techniques used to ascertain a cause-effect relationship between intervention and outcome.[2] RCTs are ubiquitously regarded as the 'gold standard' of biomedical research. However, when the population being studied for research is divided into groups, there is a chanceof imbalance between them with respect to known or unknown confounding factors even before a comparison is started. Randomness and blinding in the selection process are important aspects to eliminate biases, ensure the veracity of the results in clinical research and maintenance of scientific reliability.[5] The utility of a control group makes these randomised trials the most powerful research tools in the current scientific era. A 'double-blind' study, in which the concealment of allocation is maintained till analysis, removes our all-too-human misery, optimism, and aspiration from the comparison. However, these aspects have often been found to be deficient in the studies submitted for peer review; nevertheless, several workshops and sessions on 'Research Methodology and Publication' are being conducted in various national and state conferences and Continuing Medical Education (CME) activities which provide a basic understanding of biomedical research and statistics. DEFICIENCIES OF RCTS A rose, however, beautiful has thorns. Similarly, though RCTs constitute the best quality evidence, it is possible only when their methodology is rigorous, and they are conducted in a scientific manner. Hence, not all RCTs qualify as a high level of evidence and while grading them, the presence of selection bias, inadequate sample size, improper randomisation, lack of blinding, inconsistency, imprecision, not performing intention to treat analysis or not following Consolidated Standards of Reporting Trials (CONSORT) statement can lead to a serious deterioration in their quality and downgrading of the evidence generated by them. A meticulously designed clinical trial is not always practical, and it has been documented in the past that the quality of the randomised trial and randomisation process itself is not always properly maintained. There is ample evidence that the quality of randomisation is often suboptimal in RCTs, and these are not truly randomised clinical trials.[6] It may not be practical to perform RCTs in some scenarios such as trials where results are dependent on patient cooperation or conditions for which there is already an established gold standard for treatment. It may be difficult to attain and conceal a true placebo in an RCT. In fact, it may be unethical to give a placebo in certain situations such as in a trial on a life-limiting illness. A placebo may not be justified if it would mean refuting the participant's usual management. Further, animal research can be inadequate for making recommendations for or against the treatment in humans as the response may not be identical in many circumstances. In fact, authorisation of medications based on animal research has led to substantial harm to the human population in the past. The animal studies may be conducted in conditions that would never be used while conducting anaesthesia on human infants and children. Also, biologically, postnatal growth and development in animals and human infants do not match even in similar age-groups. Huge costs are often incurred in conducting RCTs. Rarely, the results come out to be so beneficial that it would be considered unethical to deprive the control group of its benefits. In some medication trials, the investigators must terminate the trial prematurely because of harmful or negative results in the interim analysis. Sometimes, the results may not mimic real-life treatment, and the subjects will not reciprocate the highly controlled environment involved in the selection and exclusion of patients As it is not always feasible to conduct an RCT, researchers have to, at times, resort to other trial designs. It has also been contended that it is not always possible to guide every clinical decision on RCTs.[7] WHAT ARE THE ALTERNATIVES TO RCTS? There are other forms of interventional studies which are not categorised as RCTs but are ranked higher than their observational counterparts.[8] When RCTs cannot be used, the interrupted time series design (ITS) is a possible alternative. Many a times, intervention can be done, and the pre- and post-effects can be compared without a control group. This issue of the Indian Journal of Anaesthesia (IJA) has one such study wherein the pre- and post-effects of an intervention have been compared.[9] The main objective of ITS is to examine whether the data pattern observed post-intervention is different from that of pre-intervention.[10] Sometimes, a control group can be an active group receiving another form of treatment instead of a placebo to avoid ethical problems and to provide additional benefit for the participants in the control group. Few studies need not require a control group to validate the results. Such studies follow a single group interventional design as has been followed in the study on paediatric thoracotomy cases published in this issue.[11] ROLE OF SYSTEMATIC REVIEWS AND META-ANALYSES Many of the scientific articles that are published have contradictory results, lack certainty, and many results have been refuted over time. In such circumstances, clinical decision-making can be guided only by the reconciliation of studies and reviewing them scientifically. A systematic review uses a transparent process to identify and compile explicit results of multiple studies for a specific focused question after critical appraisal of these studies. These data can be pooled in a graphic form usually as a forest plot also known as the blobbogram, where the point estimate and 95% confidence intervals are presented on an individual line.[12] An interesting observation is that the number of systematic reviews has increased drastically over time with initiatives such as the Cochrane collaboration providing assistance and free software which helps in the process of compiling the data and providing meaningful results. Bias unique to this type of research is publication bias. The chance of publication is more for studies with positive results and in the English language. This forms the major difference between systematic reviews and narrative reviews. A well-conducted systematic review attempts to reduce such bias. Whenever there is a difficulty in doing multicentre trials which include a large number of patients, a meta-analysis can be conducted. The word ' meta' stands for 'beyond' in Greek. This tool, which has a systematic approach, analyses the results in a transparent manner by combining many studies, thus, increasing the sample size. It helps us to draw meaningful conclusions, resolve conflicting results and clear uncertainties. Meta-analyses provide results with increased precision and true estimation of the effect size.[13] As has been mentioned time and again, in the IJA, systematic reviews and meta-analyses get top priority in the publication process. SO WHERE DO OBSERVATIONAL STUDIES OR SURVEYS STAND? The great agnostic Robert G Ingersoll had stated 'reason, observation and experience'as the holy trinity of science. One has to always observe to identify and analyse which is the first step in the practice of any research. It is the process where a question leads to many more questions and many more possibilities. Such observations can imply associations and lead to concepts. One has to evaluate to establish such concepts and intervene to solve the problem. Understanding the natural history of the disease and its complications is an area of research exclusive to observational studies. The Mayo Anesthesia Safety in Kids (MASK) and Pediatric Anesthesia Neurodevelopment Assessment (PANDA) are some of the historical observational studies which have helped to provide additional information which cannot always be evaluated using a randomised study design.[1415] Though the General Anesthesia or Awake-regional Anesthesia in Infancy (GAS) study was performed as a muliticentre randomised controlled equivalence trial assessing the effect of an hour of sevoflurane anaesthesia exposure and suggested that it is safe in infants, the effect of multiple exposures could only be determined by observational studies due to ethical constraints.[16] Observational studies (cohort, cross-sectional studies or case-control studies) have the potential for a higher external validity than RCTs which means that their results can be extrapolated to a broad population to a higher degree.[17] However, they have a lesser internal validity because of the possibility of bias and confounding variables. Nonetheless, the limitations in observational studies can be overcome to a certain extent by few statistical methods. Identification of potential confounders can be done using logistic regression analysis, and the effect of these potential confounders can be offset by propensity analysis scoring and, thus, reducing the selection bias.[18] Feinstein and Horwitz had in their article stressed that RCTs may be an 'elusive ideal' and stated that the high-quality prospective cohort or retrospective epidemiologic studies offer a sustainable alternative for the (many-a-times) unachievable scientific gold standard of an RCT.[7] They emphasised the need to conduct other clinical epidemiological research designs in a very rigorous manner. Another alternative is to set up international registries in which the registration of various data would be necessary. Though not free of biases, they have various advantages viz., no need for informed consent, data collected in an efficient manner, the feasibility of including large sample sizes, less costly or time-consuming, rare diseases or manifestations can be studied, and easier analysis of long-term effects.[19] CASE SERIES AND CASE REPORTS: WHAT IS THEIR WORTH? The least ranked form of research, that is, case series and reports are descriptive studies that describe clinical circumstances of individual patients and focus on the contextual analysis of events or conditions and their relationships. They are often not given preference by major reputed journals. Recently, numerous open access journals which exclusively publish anecdotal cases and series have come up.[20] These rekindle the interest and evoke curiosity among the readers. However, the utility of such knowledge in routine clinical practice remains questionable. In a recent amendment, the National Medical Commission has added 'cases series' in addition to the pre-existing criteria of 'original research articles' including systematic reviews and meta-analyses for academic promotions in medical colleges. From a reader's point of view, a letter to the editor is a much more popular, effective, precise and authentic means of conveying the relevant message as compared to a case report and that too in minimal words. QUESTIONNAIRES AND SURVEYS: CURRENTLY POPULAR RESEARCH TRENDS? Questionnaires and surveys are inexpensive and quick research tools applicable for the assessment of the current knowledge among clinicians as well as an assessment of the impact and reach of certain treatment methodologies or guidelines. Surveys also help to identify deficiencies and focus on areas of improvement.[21] A survey study in this issue of the IJA focuses on the improvement in postgraduate medical education in the country.[22] Electronic surveys are common and are easy to conduct. The coronavirus disease (COVID)-19 pandemic saw a multitude of e-surveys conducted conveniently during the lockdown period. Two more surveys published in this issue: a survey describing the practice of oropharyngeal pack insertion and removal practices amongst the anaesthesiologists of our country and a survey by showcasing extubation practices among anaesthesiologists are an attempt to improve safety and quality in health care.[2324] Questionnaires have their own set of limitations and biases such as self-reporting bias and social desirability bias. There is an article in this issue of the IJA that deals with the development and validation of a questionnaire.[25] This issue also has two interesting studies related to assessment and learning in postgraduate medical education, and they have questionnaires with a variety of questions in their study methodology for the study participants.[2627] REGISTRATION OF RESEARCH STUDIES: A VOLLEY OF DOUBTS? Registration of clinical trials is an important process to ensure transparency and credibility of the study and, thereby, improving the quality of evidence. Awareness about the registration of clinical studies is minimal among young researchers, and the purpose of registration is not completely understood by many. There are certain misconceptions involving the registration of clinical research. The IJA has been flooded with manuscripts in the past year with authors pouring in queries and doubts regarding the registration of their studies. Do observational studies, retrospective studies and surveys need to be registered? Can Clinical trial registry of India (CTRI) non-registration be a reason for manuscript rejection? CTRI is a domain thatprovides registration of clinical research performed in the country. This was launched in the year 2007, and the registration process which was initially voluntary has been made mandatory since 2009. Subsequently, editors of major journals in India, including the IJA have declared that only registered trials would be considered for publication. Any trial involving human participants, of any intervention such as drugs, devices, surgical procedures, preventive measures, lifestyle modifications, educational or behavioral treatment, and rehabilitation strategies is expected to be registered in the CTRI before enrolment of the first participant. The registration process is easy if an ethics committee approval is obtained. The committee approving the ethical perspectives of the study should be registered with the Drug Controller General of India (DCGI). Registration of certain phase 1 trials requires direct approval from the DCGI. At this point, it is important for all researchers (past, present and future) to note that registration is not limited to interventional clinical trials but also extends to observational clinical studies, post-marketing surveillance trials, bioavailability and bio- equivalence studies. International multicentre trials can be registered with international registries like the Clinical Trials Register hosted by the United States National Library of Medicine. These studies should also be registered additionally in the National Register. (ctri.nic.in) [28] WHAT NEXT? THE KIND OF RESEARCH TO BE TAKEN UP…. (RCTS?OBSERVATIONAL STUDIES? SURVEYS?) The year 2020 stands as evidence of various complexities and adversaries of clinical research. The withdrawal of published articles on hydroxychloroquine from The Lancet stands proof of bias, errors and lack of transparency in research. We were guided throughout the course of the coronavirus pandemic by the RCTs pouring in from all over the world. In the race of evidence, the supremacy of the quintessential RCTs over cross-sectional surveys and observational studies is undeniable, but the scientific evidence has its own value depending upon the research question and the methodological rigor. In 1998, René Favaloro, a revered cardiac surgeon, while signaling on the long debate about the need for RCTs for bypass grafting, had aptly mentioned, "RCTs have developed such high scientific stature and acceptance that they are accorded almost religious sanctification. If relied on exclusively, they may be dangerous."[29] This sets us thinking. Is it time for us to adopt and accept a diversity of approaches in research study and design? To conclude, one thing is certain. RCTs or meta-analyses……Surveys or observational studies…the clinical research journey has to continue and move on.

In 2015, the Italian Medicines Agency (Agenzia Italiana del Farmaco; AIFA) issued the Determination 809/2015 with new requirements for phase I clinical trials. Before it came into force, we explored the extent to which several Italian oncology centers were working to implement it. A survey was conducted among 80 Italian centers involved in clinical trials. Investigators and research coordinators were surveyed. Answers from 42 institutions were collected: among them 88.1% were involved in oncology research. In the last 5 years, 55% had conducted from 1 to 5 phase I trials, and only 16.7% more than 5. A third were involved in not-first-in-human research and none with healthy volunteers. The majority (57.1%) of the centers did not run any projects and trials are non-commercial, and about 35%, no more than 2. While 9.5% already met the standards for self-certification, 71.4% were working to achieve them. Standard operating procedures dedicated to research and the required good clinical practice training had been established by 57.1% and 76.2%, respectively. Fifty percent of laboratories were almost compliant with the Determination. After 10 months from its coming into force, 98 sites had applied for certification, of which 34 were oncology units. The new AIFA Determination imposes a certified organizational model on units and laboratories involved in phase I trials. Our results showed that great efforts were made to qualify for phase I research suggesting that other oncology units will apply for certification in the near future. Predictably, Italy will set the pace as a highly qualified country in which to conduct early-phase research.

Most countries in the Organisation for Economic Co-operation and Development apply managed entry agreements (MEAs), reimbursement arrangements between manufacturers and payers, to pharmaceuticals. Few data exist regarding their ability to lower expenditures. To analyze the financial outcomes of MEAs for pharmaceuticals from 2019 to 2021 in Italy. In this observational study of MEAs and pharmaceutical spending in Italy, medications that were monitored through individually collected data and generated paybacks from manufacturers during the 2019 to 2021 study period were included in the analysis. Payback data were collected through pharmaceutical spending monitoring activities conducted by the Agenzia Italiana del Farmaco (Italian Medicines Agency). Expenditure data were collected through the Italian Drug Traceability System. Products were categorized by type of MEA: financial-based, outcome-based, or mixed. The main outcome was median payback as a proportion of expenditure by category of MEA. Results were also provided by subtype: cost sharing or capping models for financial-based MEAs and risk-sharing or payment-by-result models for outcome-based MEAs. Mixed MEAs were considered when medications had multiple indications with different MEA types. A total of 73 medications with MEAs generated a payback by manufacturers during the study period. Six were either not reimbursable or delivered within the Italian National Health Service, and 5 had incomplete data. Of the 62 medications analyzed, 24 (38.7%) had financial-based MEAs, 30 (48.4%) had outcome-based MEAs, and 8 (12.9%) had mixed MEAs. A total payback amount of €327.5 million was calculated during the 3 years, corresponding to 0.9% of the €41.1 billion of total expenditures for medications purchased by public health facilities in Italy. Financial-based MEAs returned the highest payback revenues, €158.1 million; the outcome-based MEAs and mixed MEAs generated smaller paybacks of €74.5 million and €94.9 million, respectively. Overall, the median proportion of payback to expenditure on the medications analyzed was 3.8%. For mixed MEAs, the payback-to-expenditure proportion was 6.7%; for outcome-based MEAs, 3.3%; and for financial-based MEAs, 3.7%. This observational study found limited evidence that MEAs lower pharmaceutical expenditures. Determining criteria for prioritizing MEA use, identifying potential design changes, and improving implementation may be needed in the future.