Development of an index system for the comprehensive evaluation on public health emergency events surveillance system in China

Abstract

To establish a comprehensive evaluation index system for the China Public Health Emergency Events Surveillance System (CPHEESS). A draft index system was built through literature review and under the consideration of the characteristics on CPHEESS. Delphi method was adapted to determine the final index system. The index system was divided into primary, secondary and tertiary levels. There were 4 primary indicators: System structure, Network platform, Surveillance implementation reports with Data analysis and utilization. There were 16 secondary and 70 tertiary indicators being set, with System structure including 14 tertiary indicators (accounted for 20.00%), 21 Network platforms (accounted for 30.00%). Twenty-four Surveillance implementation reports (accounted for 34.29%), 11 Data analysis and utilization (accounted for 15.71%). The average score of importance of each indicators was 4.29 (3.77-4.94), with an average coefficient variation as 0.14 (0.12-0.16). The mean Chronbach's α index was 0.84 (0.81-0.89). The adaptability of each related facilities indicator was specified. The primary indicators were set in accordance with the characteristics and goals of the surveillance systems. Secondary indicators provided key elements in the management and control of the system while the tertiary indicators were available and operative. The agreement rate of experts was high with good validity and reliability. This index system could be used for CPHEESS in future.