Delphi, non-RAND modified Delphi, RAND/UCLA appropriateness method and a novel group awareness and consensus methodology for consensus measurement: a systematic literature review

Abstract

Introduction Increasing demand for reliable evidence in patient care and its delivery has necessitated the development of several approaches for generating quality evidence. In particular, the solicitation of expert opinion has been recognised as a reliable data collection method. However, there are variations and limitations in study approaches using expert opinion as a method of data collection, thereby necessitating the development of a standardised, novel consensus method. Methods A systematic literature review was conducted to assess the characteristics of all studies utilising a “Delphi” or “Modified Delphi” methods between January 2008 and December 2018. A search framework was developed, and the review was conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Results In total, 764 studies met the study inclusion and exclusion criteria and were included in the review. Heterogeneity on core defining characteristics of the constituent study types was observed in this control group. These 764 studies were compared against the four case studies using the Jandhyala method. Four key themes were identified and discussed: Assessment of Forced or Observed consensus, Assessment and reporting of item Awareness and advisor awareness, Minimum expert engagement profile, and Efficiency of Minimum Engagement Profile. Conclusions Existing consensus methodologies have undergone significant modifications by successive authors over time, including ones contradicting core principles where an original method had been defined. The Jandhyala method for generating group consensus and awareness is unique in observing consensus and measuring awareness of subject matter across experts. The Jandhyala method also improves upon the traditional Delphi-style methodologies, through the introduction of new insights into awareness of subject matter in the expert group. A wider application of the Jandhyala method is required to corroborate findings from this research.