Mini-ICF-APP Inter-Rater Reliability and Development of Capacity Disorders Over the Course of a Vocational Training Program\u2014A Longitudinal Study

Abstract

The Mini-ICF-APP is an established instrument in social medicine, especially in the context of work ability assessment. In this study, the 13 capacity dimensions of Mini-ICF-APP were tested for its inter-rater reliability in the context of a vocational training program for persons with chronic and mental health problems in Switzerland. Also, the development of capacity impairments was investigated over the course of the long-term vocational training programs.61 training reports on chronically ill persons with mental health impairments were collected within a vocational training program in 2018–2019. Capacity impairment of the trainees were assessed at the beginning of the intervention (t0), after three months (t1) and after 6 to 9 months (t2) by a job attendant and a consultant at each of the three time points. Inter-rater reliabilities for each time point have been calculated. Development of capacity impairment over the course of the vocational training were investigated by variance analysis with repeated measurements.The inter-rater reliability increased in all 13 Mini-ICF-APP capacity dimensions over the course from t0 to t2. Spearman correlation in each capacity dimension reached sufficient values (r = 0.55*–0.97**). There was no statistically significant change of capacity impairment over the course of the vocational training. Ten capacity dimensions showed a decreasing tendency, three showed a tendency to improve capacity levels.Through repeated application and training programs the capacity raters seem to be able to improve reliability of their assessments. The phenomenon of slight increase of capacity impairments over the time may be due to the fact that context and rater’s knowledge on participants and context demands changed over the time.