Abstract

6603 Background: Little is known about the validity and reliability of value assessment frameworks. Methods: Eight panelists used the ASCO, ESMO, ICER, and NCCN frameworks to conduct value assessments of 15 drugs for advanced lung and breast cancers and castration refractory prostate cancer. Panelists received instructions and published clinical data to complete the assessments, assigning each drug a numeric or letter score. We used Kendall’s W coefficient to measure convergent validity by cancer type among frameworks and intraclass correlation coefficients (ICC) to measure framework inter-rater reliability across cancers. Panelists were surveyed on their experiences. Results: Kendall’s W for breast, lung, and prostate cancer drugs were 0.560 ( p= 0.010), 0.562 ( p= 0.010), and 0.920 ( p< 0.001), respectively. Pairwise and subdomain W are shown in the table. ICC (95% CI) for ASCO, ESMO, ICER, and NCCN were 0.800 (0.660-0.913), 0.818 (0.686-0.921), 0.652 (0.466-0.834), and 0.153 (0.045-0.371), respectively. Panelists generally agreed the frameworks were logically organized and easy to use. Conclusions: Convergent validity among the frameworks was fair to excellent, increasing with clinical benefit subdomain concordance and simplicity of drug trial data. Inter-rater reliability, highest for ASCO and ESMO, improved with clarity of instructions and specificity of score definitions. Continued use, analyses, and refinements of the frameworks will bring us closer to using value-based treatment decisions to improve patient care and outcomes. [Table: see text]

Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.