The Development of Model and Measuring Tool for Specialists Accreditation in Area of Public Health Services

Zhanna M Sizova,Victor I Zvonnikov,Zehra N Ersozlu,Alfiya R Masalimova,Tatyana V Semenova

doi:10.12973/ejmste/77042

Abstract

The main purpose of the paper is to present some theoretical approaches and some methods providing assessment optimization in specialists’ accreditation in area of public health services. The results of research presented in this paper, include the model of multistage adaptive measurements and two methods for reliability and validity analysis, providing high justice decisions in accreditation and corresponding to requirements in High-Stakes Testing procedures. The assessment optimization intends for minimization time of assessment and for reliability and validity data increasing. For optimization the special model of measurements based on multistage adaptive testing is offered. The using of offered model in assessment design allows to realize the advantages of traditional adaptive testing and linear testing, while minimizing their disadvantages. So, this model is recommended as dominating for assessment in accreditation. For validity increasing in assessment in accreditation the approach based on Structural Equation Modeling is offered. This method allows to analyze the significance of relations between observed and latent variables that have any interpretation as causal effects, and to construct the model of their relations. The example of model of casual relations between disciplines, latent variables (competencies) and factors is offered. The model helps to increase construct and content validity of measuring tool using in public health services accreditation. The methods of reliability estimation in multistage measurements, offered in paper, has innovative character. It has branching structure as the value of reliability in multistage measurements depends not only on reliability of separate stages, but also from correlations between them. The presented approaches allow to increase validity and reliability of decisions in public health services specialists’ assessment or in other spheres of assessment during accreditation.

Highlights

Relevance of the ProblemThe first experience of specialists’ accreditation in area of public health services in Russia on 2016 and 2017 has shown that assessment processes require optimization
The results of research presented in this paper, include the model of multistage adaptive measurements and two methods for reliability and validity analysis, providing high justice decisions in accreditation and corresponding to requirements in High-Stakes Testing procedures
For approbation of methods for reliability estimation in multistage measurements 258 examinees were chosen from population examinees participated in approbation on 2017 in First Moscow State Medical University of I.M

Summary

Introduction

The first experience of specialists’ accreditation in area of public health services in Russia on 2016 and 2017 has shown that assessment processes require optimization. Thousands of specialists of public health services as examinees, thousands of items and long time, necessary for multistage procedures of measurement, are involved in accreditation process. According to this problem of optimization some questions have defined the paper purposes in which the attempt to give the answers for these questions is presented.

Objectives

Methods

Results

Conclusion