Maturity Assessment of the Health Information System Using Stages of Continuous Improvement Methodology: Results From Serbia.

Abstract

Since the health information system (HIS) in public health care services in Serbia was introduced in 2009, it has gradually expanded. However, it is unclear how well the HIS components have developed and the whole system's stage of maturity. In June-September 2021, a maturity assessment of the Serbian HIS was conducted for the first time using the HIS Stages of Continuous Improvement (SOCI) toolkit. The toolkit measures HIS status across 5 HIS domains: leadership and governance, management and workforce, information and communication technology (ICT), standards and interoperability, and data quality and use. The domains were further divided into 13 components and 39 subcomponents whose maturity stage was assessed on a 5-point Likert scale, indicating the level of development: (1) emerging/ad hoc; (2) repeatable; (3) defined; (4) managed; and (5) optimized. The toolkit was applied in a working group of 32 professionals and experts who were engaged in developing the new national eHealth strategy and action plan. The overall maturity score of the Serbian HIS was 1.6, which indicates a low level. The highest baseline score (2) was given to the standards and interoperability domain, and the lowest (1.1) was given to ICT infrastructure. The remaining 3 domains (leadership and governance, Management and Workforce, and Data Quality and Use) were similarly rated (1.7, 1.7, and 1.6, respectively). A baseline assessment of the maturity level of Serbian HIS indicates that the majority of components are between the emerging/ad hoc stage and repeatable, which represent isolated, ad hoc efforts, with some basic processes in place and existing and accessible policies. This exercise provided an opportunity to address identified weaknesses in the upcoming national eHealth strategy.