Background and objectiveMethylmalonic acidemia (MMA) and propionic acidemia (PA) are rare inborn errors of metabolism with shared signs and symptoms that are associated with significant morbidity and mortality. No disease-specific clinical outcomes assessment instruments for MMA and/or PA currently exist to capture the patient perspective in clinical trials. Because patients with these conditions are generally young and have cognitive impairments, an observer-reported outcome (ObsRO) instrument is crucial. We report results from qualitative research supporting development of the Methylmalonic Acidemia and Propionic Acidemia Questionnaire (MMAPAQ), a signs and symptoms ObsRO measure for caregivers of patients with MMA and/or PA. MethodsConcept elicitation (CE) interviews were conducted with 35 participants across 2 studies who were aged ≥18 years and caregivers of patients with a confirmed diagnosis of MMA or PA, and an additional 5 patients aged ≥6 years with MMA or PA in Study 1, to identify core signs/symptoms for inclusion in the MMAPAQ. All interviews were conducted in English. Study 2 included cognitive interviews (CI) with caregivers and clinical experts to further assess content validity. CE and a conceptual framework review were also conducted with clinical experts to further support findings. ResultsA consistent set of signs/symptoms of MMA and PA were reported by eligible caregivers interviewed in study 1 (n = 21) and study 2 (n = 14), representing 11 patients with MMA and 20 with PA. Based on concepts reported in study 1, a draft instrument was constructed and compared with the Pediatric Quality of Life Inventory™ (PedsQL™) and Family Impact module, demonstrating face validity for measuring key signs/symptoms important to patients and caregivers. The PedsQL™ and Family Impact modules were preferred to assess patient and caregiver impacts. Two waves of CE and CIs were conducted in study 2, with wave 1 resulting in removal of 7 items and other revisions to improve clarity, and wave 2 resulting in modification of examples used for 2 items. The final instrument consisted of the following 7 items assessed over the past 7 days using a Likert-type response scale ranging from “never” to “very often”: uncontrollable or involuntary movements, dehydration, rapid breathing at rest, appearing lethargic, appearing disinterested in eating, refusing to eat, and vomiting. ConclusionsThis study establishes the content validity of the MMAPAQ as the first ObsRO questionnaire for measuring core signs and symptoms of MMA and PA in clinical trials and community research. Scoring and psychometric measurement properties of the MMAPAQ will be established in future studies. The PedsQL™ was found to have face validity in measuring concepts that affect the MMA and PA patient populations and should also be considered for use in clinical trials in MMA and PA.