Complex Problem-solving Tasks Research Articles

Coupling simulation and experiment: The bimodal strategy in integrative systems biology

The importation of computational methods into biology is generating novel methodological strategies for managing complexity which philosophers are only just starting to explore and elaborate. This paper aims to enrich our understanding of methodology in integrative systems biology, which is developing novel epistemic and cognitive strategies for managing complex problem-solving tasks. We illustrate this through developing a case study of a bimodal researcher from our ethnographic investigation of two systems biology research labs. The researcher constructed models of metabolic and cell-signaling pathways by conducting her own wet-lab experimentation while building simulation models. We show how this coupling of experiment and simulation enabled her to build and validate her models and also triangulate and localize errors and uncertainties in them. This method can be contrasted with the unimodal modeling strategy in systems biology which relies more on mathematical or algorithmic methods to reduce complexity. We discuss the relative affordances and limitations of these strategies, which represent distinct opinions in the field about how to handle the investigation of complex biological systems.

Multiple levels of metacognition and their elicitation through complex problem-solving tasks

Building on prior efforts, we re-conceptualize metacognition on multiple levels, looking at the sources that trigger metacognition at the individual level, the social level, and the environmental level. This helps resolve the paradox of metacognition: metacognition is personal, but it cannot be explained exclusively by individualistic conceptions. We develop a theoretical model of metacognition in collaborative problem solving based on models and modeling perspectives. The theoretical model addresses several challenges previously found in the research of metacognition. This paper illustrates how metacognition was elicited, at the environmental level, through problems requiring different problem-solving processes (definition building and operationalizing definitions), and how metacognition operated at both the individual level and the social level during complex problem solving. The re-conceptualization of metacognition has the potential to guide the development of metacognitive activities and effective instructional methods to integrate them into existing curricula that are necessary to engage students in active, higher-order learning.

Computer-based assessment of Complex Problem Solving: concept, implementation, and application

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate item construction, delivery, and scoring. The lack of assessment tools, however, has slowed down research on and understanding of CPS. This paper first presents the MicroDYN framework for assessing CPS, which is based on linear structural equation systems with input and output variables and opaque relations among them. Second, a versatile assessment platform, the CBA Item Builder, which allows the authoring, delivery, and scoring of CPS tasks for scientific and educational purposes is introduced. Third, we demonstrate the potential of such a tool for research by reporting an experimental study illustrating the effect of domain specific content knowledge on performance in CPS tasks both on an overall performance and on a process level. The importance of accessible and versatile technical platforms not only for assessment and research but also for intervention and learning are discussed with a particular focus on educational contexts.

The Road Not Taken

To investigate individual differences in creativity as measured with a complex problem-solving task, we developed a computational model of the remote associates test (RAT). For 50 years, the RAT has been used to measure creativity. Each RAT question presents three cue words that are linked by a fourth word, which is the correct answer. We hypothesized that individuals perform poorly on the RAT when they are biased to consider high-frequency candidate answers. To assess this hypothesis, we tested individuals with 48 RAT questions and required speeded responding to encourage guessing. Results supported our hypothesis. We generated a norm-based model of the RAT using a high-dimensional semantic space, and this model accurately identified correct answers. A frequency-biased model that included different levels of bias for high-frequency candidate answers explained variance for both correct and incorrect responses. Providing new insight into the nature of creativity, the model explains why some RAT questions are more difficult than others, and why some people perform better than others on the RAT.

Endoscopic Skills Training in a Simulated Clinical Setting

We describe a simulation and scenario-based model of training in gastrointestinal endoscopic hemostasis, which combines acquisition of procedural and problem-solving skills in a close to reality simulated clinical setting. Two day courses in endoscopic hemostasis were conducted at the Clinical Training and Education Centre, the University of Western Australia, Perth, Australia. In total, 23 trainees were enrolled. The Erlangen Endo-Trainer simulator, porcine specimens of esophagus, stomach, and duodenum with a range of simulated bleeding sources, a separate catheter and a pump to simulate massive bleeding, and a full arm model with injectable veins were used. The SimMan monitor and software package were used to simulate hemodynamic parameters and electrocardiogram. Faculty members adjusted the rate of bleeding and vital parameters. The exercise was video recorded. On the first day, the group underwent simulator training in techniques of endoscopic hemostasis. On the second day, participants were scenario-based trained in full management of a "bleeding patient," which included resuscitation, sedation, endoscopy, and hemostasis, acting as leaders in teams of three. The course was evaluated by participants using a standardized questionnaire. A complex clinical setting of acute gastrointestinal bleeding was recreated with a high degree of realism. All participants reported that the simulated clinical scenario was a positive learning experience, helpful in managing complications and performing complex problem-solving tasks in a dynamic environment. Scenario and simulation-based training in endoscopic hemostasis may provide an opportunity to improve procedural skills and acquire practical experience in managing this medical emergency, which requires the ability to process, integrate, and adequately and quickly respond to complex information in unexpected conditions working as a team leader.

Knowledge and information awareness for initiating transactive memory system processes of computer-supported collaborating ad hoc groups

This paper presents an innovative approach for initiating processes of a transactive memory system in newly formed groups of experts collaborating computer-supported in a complex problem-solving task. Our empirical study compared 15 experimental and 15 control groups, each consisting of triads. In the experimental condition, the triads were provided with a tool for fostering knowledge and information awareness, that is, being informed about the knowledge and the underlying information of the collaboration partners in form of digital concept maps. In the control condition, the groups had no access to this tool. Results confirmed the potential of the tool to initiate processes of a transactive memory system: shared agreement of the knowledge of the other group members’ knowledge proved to influence group performance positively. In addition, previous findings of the tool’s potential to establish knowledge and information awareness and to augment group performance could be replicated. However, the postulated mediating effect of processes of a transactive memory system concerning the impact of knowledge and information awareness on group performance did not reach statistical significance. Aspects for future studies and implications of these findings regarding their practical implementation, for example, in teams of organizations, are discussed.

Toward an Understanding of Macrocognition in Teams: Predicting Processes in Complex Collaborative Contexts

This article presents a model for predicting complex collaborative processes as they arise in one-of-a-kind problem-solving situations to predict performance outcomes. The goal is to outline a set of key processes and their interrelationship and to describe how these can be used to predict collaboration processes embedded within problem-solving contexts. Teams are increasingly called upon to address complex problem-solving tasks in novel situations. This represents a domain of performance that to date has been underrepresented in the research literature. Multidisciplinary theoretical and empirical literature relating to knowledge work in teams is synthesized. A set of propositions developed to guide research into how teams externalize cognition and build knowledge in service of problem solving is presented. First, a brief overview of macrocognition in teams is provided to distinguish the present work from other views of team cognition. Second, a description of the foundational theoretical concepts driving the theory of macrocognition in teams presented here is provided. Third, a set of propositions described within the context of a model of macrocognition in teams is forwarded. The theoretical framework described in this article provides a set of empirically testable propositions that can ultimately guide practitioners in efforts to support macrocognition in teams. A theory of macrocognition in teams can provide guidance for the development of training interventions and the design of collaborative tools to facilitate knowledge-based performance in teams.

You need to know: There is a causal relationship between structural knowledge and control performance in complex problem solving tasks

This study investigates the relationships between structural knowledge, control performance and fluid intelligence in a complex problem solving (CPS) task. 75 participants received either complete, partial or no information regarding the underlying structure of a complex problem solving task, and controlled the task to reach specific goals. Control was best when complete structural information was available and was not better than random when no information was provided. In comparison to previous studies, a moderate to strong correlation between fluid intelligence and control performance was observed across all conditions. It appears that effective complex problem solving requires a combination of task-specific knowledge and abstract thinking skills.

Kolmogorov entropy changes and cortical lateralization during complex problem solving task measured with EEG

The objective is to study changes in EEG time-domain Kolmogorov entropy and cortical lateralization of brain function areas during complex problem solving mental task in healthy human subjects. EEG data for healthy subjects are acquired during complex problem solving mental task using a net of 6 electrodes. The subject was given a nontrivial multiplication problem to solve and the signals were recorded for 10s during the task. Kolmogorov entropy values during the task were calculated. It was found that Kolmogorov entropy values were obviously greater in P4 channel (right) than ones in P3 channel (left) during complex problem solving task. It indicated that all subjects presented significant left parietal lateralization for the total frequency spectrum. These results suggest that it may be possible to noninvasively lateralize, and even eventually localize, cerebral regions essential for particular mental tasks from scalp EEG data.

Designer Thinking: How Novices and Experts Think About Instructional Design

Instructional design can be characterized as a complex problem-solving task, yet little is known about what cognitive processes it requires. This research sought to identify differences in the thinking of expert and novice instructional designers given the same design task. A talk-aloud procedure was used to capture their problem-solving procedures and representations while designing instruction for a computer simulation. A coding scheme based on design principles, strategies, and subtasks was applied to the verbal protocols. Quantitative and qualitative analyses indicated that expert and novice instructional designers do appear to use divergent design paths. These design paths were further analyzed using design trees.

Language Ability and Verbal and Nonverbal Executive Functioning in Deaf Students Communicating in Spoken English

The internal use of language during problem solving is considered to play a key role in executive functioning. This role provides a means for self-reflection and self-questioning during the formation of rules and plans and a capacity to control and monitor behavior during problem-solving activity. Given that increasingly sophisticated language is required for effective executive functioning as an individual matures, it is likely that students with poor language abilities will have difficulties performing complex problem-solving tasks. The aim of this study was to investigate the relationship between language ability and verbal and nonverbal executive functioning in a group of deaf students who communicate using spoken English, as measured by their performance on two standardized tests of executive function: the Delis-Kaplan Executive Function System (D-KEFS) 20 Questions Test and the D-KEFS Tower Test. Expressive language ability accounted for more than 40% of variability in performance on the D-KEFS 20 Questions Test. There was no significant relationship between language ability and performance on the D-KEFS Tower Test. There was no relationship between language ability and familiarity with the specific problem-solving strategies of both D-KEFS Tests. Implications of the findings are discussed.

Enhancing problem-based learning designs with a single e-learning scaffolding tool: Two case studies using challenge FRAP

Problem-based learning (PBL) is a powerful instructional approach. By working through assessable complex problem-solving tasks learners can be encouraged to actively engage in investigation and inquiry and to use high level cognitive thought processes to solve real-life problems in professional contexts. A critical element of a successful PBL design is the inclusion of instructional support, such as scaffolding, to guide and assist the learner through the reasoning process that is crucial to successful problem-solving. The e-learning tool ‘Challenge FRAP’ (Form for the Recording of the Analysis of Problems) is client-based public domain authoring software which facilitates the use of scaffolding, the provision of progressive feedback and can promote student reflection at key decision-making points. This paper illustrates the benefits of such an e-learning scaffolding tool through two PBL case studies; one group-based PBL task in science and technology and one self-directed PBL task in plant pathology.

Problem Solving Ability in Patients With Mild Cognitive Impairment

It is important to determine which patients with mild cognitive impairment (MCI) are at risk for progression to dementia. The presence of mild impairments not restricted to the domain of memory may suggest such progression. Our goal is to determine how well a visuospatial problem solving task assessing the cumulative burden of frontal and posterior damage differentiates MCI patients from matched controls. Twenty-six patients with MCI [Clinical Dementia Rating (CDR) score of 0.5] and mini-mental state examination (MMSE) scores of at least 24/30, were compared with 20 age and education level matched controls without cognitive impairment. All patients were given the MMSE, Hopkins Verbal Learning Test (HVLT), Boston Naming Test (BNT), Rey Complex Figures copying (RCF), anagrams, and visuospatial problem solving battery (VPS). The VPS is a complex problem solving task, which we predicted would better discriminate patient groups than the relatively simpler tasks. Differences existed between groups on most tasks, but logistic regression revealed that the VPS discriminated the 2 groups better than the other nonmemory cognitive tests. The VPS, a problem solving task assessing the cumulative burden of frontal and posterior damage is more sensitive for detecting nonmemory impairments in MCI than other tasks. Future research will be needed to determine if impairment in the VPS is a sensitive predictor of progression to dementia or treatment response.

Self-Efficacy, Interest, and Task Performance

Abstract. The aim of this study was to examine how possible changes in self-efficacy and interest during a task relate to each other and whether such changes independently predict overall task performance. To achieve this, the participants, one hundred ninth-grade students, were repetitively asked to rate their efficacy judgments and interest while they were working on a complex problem-solving task. The results from a series of latent growth curve models showed a significant overall increase in students' self-efficacy during the task. Changes in interest and self-efficacy were positively correlated, and, after controlling for the effects of prior mathematics achievement, both the initial level of self-efficacy and the rate of change in interest independently predicted final task performance.

Decomposition of planning problems

The ability to decompose a problem into manageable sub-components is a necessity in complex problem-solving tasks. In planning, the application of a divide-and-conquer methodology is known as plann...

The Effects of Experience on Complex Problem Representation and Judgment In Auditing: An Experimental Investigation

The purpose of this study is to investigate problem representation and judgment by auditing professionals within the context of a going-concern task. Our results suggest more experienced auditors have more concise problem representations than do novices. In addition, our results show that some types of concepts listed in the problem representation are associated with judgment, regardless of experience level. This study makes several contributions. First, understanding differences in problem representation at different levels of experience (novice, intermediate, and experienced) gives insight into the process of how representations change as experience changes/develops. Understanding the development of “becoming qualified” to make judgments regarding the going-concern evaluation assists in (1) the development of teaching approaches for analyzing a company's financial condition, and (2) professional development for less-experienced professionals. Further, our measure of problem representation, similar to that in Christ's (1993) study, provides a task-sensitive measure of problem representation for accounting research. This should have important implications for understanding expertise development in complex problem-solving tasks that auditors and accountants face.

A pilot study on the effectiveness of tele-analogy-based problem-solving training for people with brain injuries

People with brain injuries must often deal with cognitive problems, including social problem solving. The present study evaluated the effectiveness of a 20-session, online, interactive, skill-training programme on the solving of problems using analogies. It was hypothesized that the programme could help people with brain injuries learn better problem-solving skills through systematic, theoretically driven learning strategies. Fifteen Hong Kong-Chinese with brain injuries participated in this pilot study. They were randomly assigned to an online programme, a computer-assisted programme or a therapist-administered programme. The three programmes had a similar structure and contents, including basic components problem solving, reflective sessions and functional problem solving. Outcome measures included the Category Test of Halstead-Reitan Test Battery, and a daily problem-solving performance and self-efficacy checklist. The results showed that the subjects of the three programmes generally demonstrated higher post-training self-efficacy and basic problem-solving skills. The group using the online programme, however, showed better and quicker improvements in problem-solving performance, and demonstrated a general trend towards making fewer errors in complex problem-solving tasks. In conclusion, people with brain injuries can use the successful problem-solving experiences obtained in the training programmes with different delivery modes to solve daily living problems that are similar in nature. However, the generalizability of the effects of the programme is still to be determined.

Complex problem-solving: a field in search of a definition?

Complex problem-solving (CPS) is as an area of cognitive science that has received a good amount of attention, but theories in the field have not progressed accordingly. The reasons could be the lack of good definitions and classifications of the tasks (taxonomies). Although complexity is a term used pervasively in psychology and is operationalized in different ways, there are no psychological theories of complexity. The definition of problem-solving has been changed in the past to reflect the varied interests of the researchers and has lost its initial concreteness. These two facts together make it difficult to define CPS or make clear if CPS should reuse the theory and methods of classical problem-solving or on the contrary should build a theoretical structure starting from scratch. A taxonomy is offered of tasks using both formal features and psychological features that are theory-independent that could help compare the CPS tasks used in the literature. The adequateness is also reviewed of the most extended definitions of CPS and conclude that they are in serious need of review, since they cover tasks that are not considered problem-solving by their own authors or are not complex, but ignore others that should clearly be included.

From T-Mazes to Labyrinths: Learning from Model-Based Feedback

Many organizational actions need not have any immediate or direct payoff consequence but set the stage for subsequent actions that bring the organization toward some actual payoff. Learning in such settings poses the challenge of credit assignment (Minsky 1961), that is, how to assign credit for the overall outcome of a sequence of actions to each of the antecedent actions. To explore the process of learning in such contexts, we create a formal model in which the actors develop a mental model of the value of stage-setting actions as a complex problem-solving task is repeated. Partial knowledge, either of particular states in the problem space or inefficient and circuitous routines through the space, is shown to be quite valuable. Because of the interdependence of intelligent action when a sequence of actions must be identified, however, organizational knowledge is relatively fragile. As a consequence, while turnover may stimulate search and have largely benign implications in less interdependent task settings, it is very destructive of the organization's near-term performance when the learning problem requires a complementarity among the actors' knowledge.

Timing of cueing in complex problem-solving tasks: Learner versus system control

Task-specific cueing formats that promote the automation and construction of problem-solving schemas should ideally be presented just in time to students learning to solve complex problems. This article reports experimental work comparing learner-controlled cueing, system-controlled cueing, and no cueing among 34 sophomore law students in a multimedia practical aimed at learning to prepare and hold a plea in court. The cueing consisted of a combination of process worksheets (PW) and worked out examples (WOE). Our main hypotheses that participants with cueing would outperform those without cueing and that participants with learner-controlled cueing would outperform those with system-controlled cueing were partly confirmed by the learning and transfer outcomes on a training and transfer task. Theoretical and practical implications of these findings are discussed.