Towards measuring and quantifying the comprehensibility of process models: the process model comprehension framework

Abstract

Process models constitute crucial artifacts in modern information systems, and their proper comprehension is of utmost importance in utilizing such systems. Generally, process models are considered from two different perspectives: process modelers and readers. Both perspectives share similarities and differences in the comprehension of process models (e.g., diverse experiences when working with process models). The literature proposed many rules and guidelines to ensure proper comprehension of process models for both perspectives. As a novel contribution in this context, this paper introduces the process model comprehension framework (PMCF), constituting a first approach towards the measurement and quantification of the perspectives of process modelers and readers, as well as the interaction of both regarding the comprehension of process models. Therefore, the PMCF describes an Evaluation theory tree based on the communication theory and the conceptual modeling quality framework and considers a total of 96 quality metrics to quantify process model comprehension. Furthermore, the PMCF was evaluated in a survey with 131 participants and has been implemented and applied successfully in a practical case study including 33 participants. To conclude, the PMCF allows for the identification of pitfalls and provides related information about how to assist process modelers and readers in fostering and enabling a proper comprehension of process models.