The effects of structural and group knowledge on complex problem solving performance

Abstract

This thesis analyzes the influence of structural knowledge on the individual level and the influence of knowledge heterogeneity on the group level on complex problem solving (CPS) performance. For the elicitation of structural knowledge, a computer based method, the association structure test (AST), is developed. Through term associations, measurement of thinking times, and through pairwise concept comparisons, the AST elicits a graph for each participant. The AST is tested in the domain of CPS. As complex problems are usually addressed by groups, a group setting is chosen. A curvilinear n-shaped connection between the group''s knowledge heterogeneity and its CPS performance is assumed. In an experiment, 150 participants were divided into dyads. Each participant received a text with seven knowledge elements on the control of a complex scenario. The heterogeneity of knowledge in a dyad was varied (small, medium, and large). After learning, dyad members self-assessed their knowledge. Knowledge similarity was calculated with knowledge management system (the skillMap). The knowledge similarity was also used for performance prediction. A discussion followed, during which dyad members taught each other what they had learned. Their structural knowledge was then assessed with the AST. In the following CPS task, dyads with medium heterogeneity exhibited a significant superior performance in comparison with the other two conditions. Knowledge heterogeneity exhibited a curvilinear relationship with the dyad''s CPS performance. The weighted density of AST-elicited knowledge graphs weakly correlated with CPS performance and explained a small but unique fraction of its variance. The skillMap similarity measure correlated significantly with CPS performance. Computer-based knowledge elicitation tools are thus potentially suited for performance prediction. CPS performance of groups is partially determined by the way in which knowledge is distributed inside the group.