Developing a change management measurement instrument for effective use of examination administration system

Abstract

The quantitative change management measurement for effective use, which consists of operationalized change drivers, dimensions and sub-dimensions for effective use of Examination Administration System (EAS) in the South African context, has been scarcely discussed in the literature. This paper intends to develop and validate a change management measurement instrument (CHAMI) to measure the effective use of EAS in South Africa’s (SA) Technical and Vocational Education and Training (TVET) colleges. The CHAMI was developed drawing on the survey measurement instruments literature for change management and effective use and assessed quantitatively using data collected from 215 EAS users across all 318 TVET colleges from nine provinces of SA. The empirical results found the existence of construct validity of the CHAMI with 11 dimensions (i.e. user involvement and change recognition, user satisfaction, performance measurement, technology use, EAS adaptive use, EAS verification, user learning, transparent interaction, representational fidelity, informed action, and effective use) and 63 questions. Another contribution this study stems from the way the research constructs in a measurement model are operationalized as they incorporate measurement class (i.e. reflective or formative). This paper presents a CHAMI for effective use of EAS. In the future, management, researchers and practitioners can use the CHAMI to measure effective use, espouse or adapt instrument as an additional use measurement dimension on United Nations digital transformation programmes index or test it in different settings to advance its generalizability.