Abstract

Known scales (criteria) for assessing the competence of experts in the field of technical regulation using the method of analytical hierarchy process (AHP) and Rasch model are investigated. The main features of constructing the mathematical Rash model are presented. The results of the analysis of scales for assessing the competence of experts in the field of technical regulation on a specific example of questioned specialists in measurement of time and frequency were considered. The results were processed using the specialized software “Competence MAI 1.1” (Ukraine) and MINISTEP 4.0.1 (USA). A comparative analysis of the results was carried out in order to determine the effectiveness of the assessment scales. The obtained results showed the possibility of applying the Rasch model for the analysis of the scale of expert assessment in the field of technical regulation. The analysis of the results obtained on the multidimensional Rasch model showed that the chosen criteria scale for experts corresponds to the requirements set by the Rash model. The obtained measurement data for this model allow you to calculate the established statistics for both the criteria and for the evaluated experts. A comparative analysis of the results obtained with the use of AHP and Rasch model showed convergence, suitability and correlation of the obtained values for experts. Only two out of twenty one (9.5 %) evaluated experts have data that are unsuitable for the analysis by the Rasch model, which indicates a low level of competence. AHP to a lesser extent allows for the consideration of less competent experts than with the use of the Rash model. This is evidenced by a lower coefficient of competence for the AHP than in the application of the Rasch model. AHP and Rasch model should be used in various fields of activity as a useful tool for comparative assessment of the competence of technical experts on the basis of objective data according to established criteria.

Highlights

  • For the acceptance of reasonable decisions in any spheres of activity, it is necessary to lean against experience, knowledge and intuition of specialists

  • Relevant is the use of methods of group expert evaluation for the implementation of reforms in the field of technical regulation, in particular, in metrology

  • The choice of the most optimal method for group expert evaluation and a comparative analysis of suitability for application to increase the efficiency of complex systems were the subject of previous studies by the authors [1,2,3,4,5]

Read more

Summary

Introduction

For the acceptance of reasonable decisions in any spheres of activity, it is necessary to lean against experience, knowledge and intuition of specialists. Relevant is the use of methods of group expert evaluation for the implementation of reforms in the field of technical regulation, in particular, in metrology. In this area, specialists work in different directions, in particular standardization, metrology, conformity assessment, etc. In order to obtain reliable estimates of group expert evaluation in any field of activity, it is needed to select the most optimal method. To this end, a comparative analysis of the assessment of the suitability of the methods is used. The choice of the most optimal method for group expert evaluation and a comparative analysis of suitability for application to increase the efficiency of complex systems were the subject of previous studies by the authors [1,2,3,4,5]

Literature review and problem statement
The aim and objectives of the study
Results of data conversion concerning experts
The obtained results showed the possibility of
A comparative analysis of the results obtained with
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call