An artificial intelligence-driven learning analytics method to examine the collaborative problem-solving process from the complex adaptive systems perspective

Abstract

Collaborative problem solving (CPS) enables student groups to complete learning tasks, construct knowledge, and solve problems. Previous research has argued the importance of examining the complexity of CPS, including its multimodality, dynamics, and synergy from the complex adaptive systems perspective. However, there is limited empirical research examining the adaptive and temporal characteristics of CPS, which may have led to an oversimplified representation of the real complexity of the CPS process. To expand our understanding of the nature of CPS in online interaction settings, the present research collected multimodal process and performance data (i.e., speech, computer screen recordings, concept map data) and proposed a three-layered analytical framework that integrated AI algorithms with learning analytics to analyze the regularity of groups’ collaboration patterns. The results surfaced three types of collaborative patterns in groups, namely the behaviour-oriented collaborative pattern (Type 1) associated with medium-level performance, the communication-behaviour-synergistic collaborative pattern (Type 2) associated with high-level performance, and the communication-oriented collaborative pattern (Type 3) associated with low-level performance. This research further highlighted the multimodal, dynamic, and synergistic characteristics of groups’ collaborative patterns to explain the emergence of an adaptive, self-organizing system during the CPS process. According to the empirical research results, theoretical, pedagogical, and analytical implications were discussed to guide the future research and practice of CPS.