Анализ качества тестов при сертификации специалистов по акустико-эмиссионному методу контроля объектов железнодорожного транспорта

Abstract

The results of qualification exams during specialist certification on acoustic emission nondestructive testing of railway objects are analyzed. The correspondence of task test difficulty with the level of specialist preparedness for certification is considered using the Rush method. Analysis of test results in specialist certification has shown:
 - the presence of the deviation in the distribution of test task difficulty level histograms from the uniform law, especially for special exam tests, that requires the elimination of the tasks with very low and very high difficulty level logits, as well as increasing the number of the tasks with the minimum function of task test difficulty logit;
 - the necessity of training intensification in the test topics corresponding to minimum specialist preparedness logits. 
 The obtained results are the bases for following analyses of the test task difficulty; the reasons of insufficient learning topic tasks with a low percentage of answer; making the possible adjustments in the consulting sessions, as well as the content and form of the test. 
 To exclude the test bias, the interview with certified specialist is carried out in examination center allowing specifying whether the specialist knows the basic concepts and has acoustic emission testing technology skills.
 In general the performed analysis showed a high preparedness degree for most specialists due to regular training and at least a year work experience on acoustic emission testing.