Goal-directed Systems Research Articles

Making and breaking habits: Revisiting the definitions and behavioral factors that influence habits in animals.

Habits have garnered significant interest in studies of associative learning and maladaptive behavior. However, habit research has faced scrutiny and challenges related to the definitions and methods. Differences in the conceptualizations of habits between animal and human studies create difficulties for translational research. Here, we review the definitions and commonly used methods for studying habits in animals and humans and discuss potential alternative ways to assess habits, such as automaticity. To better understand habits, we then focus on the behavioral factors that have been shown to make or break habits in animals, as well as potential mechanisms underlying the influence of these factors. We discuss the evidence that habitual and goal-directed systems learn in parallel and that they seem to interact in competitive and cooperative manners. Finally, we draw parallels between habitual responding and compulsive drug seeking in animals to delineate the similarities and differences in these behaviors.

Goal Directedness and the Field Concept

Abstract A long-standing problem in understanding goal-directed systems has been the insufficiency of mechanistic explanations to make sense of them. This article offers a solution to this problem. It begins by observing the limitations of mechanistic decompositions when it comes to understanding physical fields. We argue that introducing the field concept, as it has been developed in field theory, alongside mechanisms is able to provide an account of goal directedness in the sciences.

Neurocognitive basis of model-based decision making and its metacontrol in childhood

Human behavior is supported by both goal-directed (model-based) and habitual (model-free) decision-making, each differing in its flexibility, accuracy, and computational cost. The arbitration between habitual and goal-directed systems is thought to be regulated by a process known as metacontrol. However, how these systems emerge and develop remains poorly understood. Recently, we found that while children between 5 and 11 years displayed robust signatures of model-based decision-making, which increased during this developmental period, there were substantial individual differences in the display of metacontrol. Here, we inspect the neurocognitive basis of model-based decision-making and metacontrol in childhood and focus this investigation on executive functions, fluid reasoning, and brain structure. A total of 69 participants between the ages of 6–13 completed a two-step decision-making task and an extensive behavioral test battery. A subset of 44 participants also completed a structural magnetic resonance imaging scan. We find that individual differences in metacontrol are specifically associated with performance on an inhibition task and individual differences in thickness of dorsolateral prefrontal, temporal, and superior-parietal cortices. These brain regions likely reflect the involvement of cognitive processes crucial to metacontrol, such as cognitive control and contextual processing.

Beyond “Use It or Lose It”: The Impact of Engagement on Cognitive Aging

Biologically based senescence processes and cumulative opportunities for experience collectively give rise to profound changes in cognition in later adulthood, the trajectories of which vary considerably across individuals. This review focuses on how cognitive aging is shaped by engagement—defined as the ongoing investment of personal resources (e.g., time, attention) to activities, social networks, and experiences—through the adult life span. We review evidence for the effects of different forms of engagement on cognitive aging and consider plausible mechanistic pathways for such effects. Working within an ecological framework, we consider “design solutions” for lifestyle engagement to shape adult cognitive development given the necessary trade-offs endemic to goal-directed systems (e.g., current needs versus long-term preparation, flexibility versus robustness, exploration versus exploitation). Given the limited evidence for broad-based effects of skill training on late-life cognitive health, we argue that a promising paradigm for successful cognitive aging will be to probe synergistic effects of engagement on cognitive aging. Recent developments in personal technology offer promise for innovation in intervention and in measurement.

The meaning and origin of goal-directedness: a dynamical systems perspective

Abstract This paper attempts to clarify the notion of goal-directedness, which is often misunderstood as being inconsistent with standard causal mechanisms. We first note that goal-directedness does not presuppose any mysterious forces, such as intelligent design, vitalism, conscious intention or backward causation. We then review attempts at defining goal-directedness by means of more operational characteristics: equifinality, plasticity, persistence, concerted action and negative feedback. We show that all these features can be explained by interpreting a goal as a far-from-equilibrium attractor of a dynamical system. This implies that perturbations that make the system deviate from its goal-directed trajectory are automatically compensated—at least as long as the system stays within the same basin of attraction. We argue that attractors and basins with the necessary degree of resilience tend to self-organize in complex reaction networks, thus producing self-maintaining ‘organizations’. These can be seen as an abstract model of the first goal-directed systems, and thus of the origin of life.

Goal Directedness, Chemical Organizations, and Cybernetic Mechanisms.

In this article, we attempt at developing a scenario for the self-organization of goal-directed systems out of networks of (chemical) reactions. Related scenarios have been proposed to explain the origin of life starting from autocatalytic sets, but these sets tend to be too unstable and dependent on their environment to maintain. We apply instead a framework called Chemical Organization Theory (COT), which shows mathematically under which conditions reaction networks are able to form self-maintaining, autopoietic organizations. We introduce the concepts of perturbation, action, and goal based on an operationalization of the notion of change developed within COT. Next, we incorporate the latter with notions native to the theory of cybernetics aimed to explain goal directedness: reference levels and negative feedback among others. To test and refine these theoretical results, we present some examples that illustrate our approach. We finally discuss how this could result in a realistic, step-by-step scenario for the evolution of goal directedness, thus providing a theoretical solution to the age-old question of the origins of purpose.

The imbalance between goal-directed and habitual systems in internet gaming disorder: Results from the disturbed thalamocortical communications

BackgroundConverging evidence has identified the imbalance between goal-directed systems and habitual systems in the addiction process. The thalamocortical loop plays an important role in the habitual/goal-directed system. However, little is known about the role of the thalamus in goal-directed and habitual systems in Internet gaming disorder (IGD) patients. This study investigated whether thalamocortical circuit was disrupted and how they affected goal-directed and habitual behaviors in IGD patients. MethodsThis is a functional magnetic resonance imaging (fMRI) study. Twenty-five IGD patients and 25 matched recreational game users (RGUs) were scanned when they were in a resting state and were performing an instrumental learning task to obtain behavioral data related to habitual/goal-directed behavior. We used the whole-brain seed-based functional connectivity (FC) of the four thalamic nuclei (bilateral) and correlation analyses to examine the thalamocortical loop difference and relationship with habitual/goal-directed performance. ResultsCompared with RGUs, IGD patients demonstrated significantly increased FC between the left midline nucleus (MN) and the right postcentral gyrus (PCG), and between the pulvinar and medial frontal gyrus (MFG). Correlation results showed that within the IGD group, the correct response rates of the participants to inconsistent stimulus-result pairs were positively correlated with the FC between the pulvinar and MFG. Inhibition-control scores were negatively correlated with the FC between the left MN and the PCG. ConclusionsIGD patients showed disrupted thalamocortical communication that could further result in an imbalance between the goal-directed and habitual systems in IGD patients. These findings provide more information about the involvement of the thalamus in the pathophysiology of IGD, and as potential circuit-level biomarkers of IGD patients, these circuit alterations may be useful in treatment development and in monitoring treatment outcomes.

Computational models of drug use and addiction: A review.

In this brief review, we describe current computational models of drug-use and addiction that fall into 2 broad categories: mathematically based models that rely on computational theories, and brain-based models that link computations to brain areas or circuits. Across categories, many are models of learning and decision-making, which may be compromised in addiction. Several mathematical models take predictive coding approaches, focusing on Bayesian prediction error. Other models focus on learning processes and (traditional) prediction error. Brain-based models have incorporated prefrontal cortex, basal ganglia, and the dopamine system, based on the effects of drugs on dopamine, motivation, and executive control circuits. Several models specifically describe how behavioral control may transition from habitual to goal-directed systems, consistent with computational accounts of compromised "model-based" control. Some brain-based models have linked this to the transition of behavioral control from ventral to dorsal striatum. Overall, we propose that while computational models capture some aspects of addiction and have advanced our thinking, most have focused on the effects of drug use rather than addiction per se, most have not been tested on and/or supported by human data, and few capture multiple stages and symptoms of addiction. We conclude by suggesting a path forward for computational models of addiction. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Operationalizing Goal Directedness: An Empirical Route to Advancing a Philosophical Discussion

Goal directedness is one of the most commonly observed behavior patterns in biology, exemplified by systems ranging in complexity from cellular migration to human motivations. Philosophers have long tried to understand goal directedness in terms of necessary and sufficient conditions, but no consensus has been reached. Here we take an entirely novel approach to goal directedness, postponing the search for necessary and sufficient conditions, and instead trying to advance understanding by an empirical route. In particular, we introduce quantitative measures of goal directedness, applicable to systems that are generally agreed to be goal directed. The measures allow one to assess two signature properties of goal-directed systems, persistence and plasticity. Persistence is the tendency for an entity that is on a trajectory toward a goal to return to that trajectory following perturbations. Plasticity we understand as the tendency for an entity to find a trajectory toward a goal from a variety of different starting distances. We demonstrate the metrics by applying them to goal-directed behavior in two biological systems, bacteria moving up a chemoattractant gradient and a human following a heat gradient. Our approach reveals goal directedness to be an empirically tractable notion, one that makes possible a variety of comparative studies in biology, including comparing degree of goal directedness in different species, or in one species under different conditions, as well as studying evolutionary trends. More generally, the metrics make it possible to investigate the correlates and causes of goal-directed behavior. Finally, our approach challenges the conventional view of goal directedness as a discrete and unitary property, by showing that it can be treated as continuous, as a matter of degree, and that it can be broken down into at least two, and possibly more, partly independent components.

Morphological, Natural, Analog, and Other Unconventional Forms of Computing for Cognition and Intelligence

According to the currently dominant view, cognitive science is a study of mind and intelligence focused on computational models of knowledge in humans. It is described in terms of symbol manipulation over formal language. This approach is connected with a variety of unsolvable problems, as pointed out by Thagard. In this paper, I argue that the main reason for the inadequacy of the traditional view of cognition is that it detaches the body of a human as the cognizing agent from the higher-level abstract knowledge generation. It neglects the dynamical aspects of cognitive processes, emotions, consciousness, and social aspects of cognition. It is also uninterested in other cognizing agents such as other living beings or intelligent machines. Contrary to the traditional computationalism in cognitive science, the morphological computation approach offers a framework that connects low-level with high-level approaches to cognition, capable of meeting challenges listed by Thagard. To establish this connection, morphological computation generalizes the idea of computation from symbol manipulation to natural/physical computation and the idea of cognition from the exclusively human capacity to the capacity of all goal-directed adaptive self-reflective systems, living organisms as well as robots. Cognition is modeled as a layered process, where at the lowest level, systems acquire data from the environment, which in combination with the already stored data in the morphology of an agent, presents the basis for further structuring and self-organization of data into information and knowledge.

Basic functional trade-offs in cognition: An integrative framework

Trade-offs between advantageous but conflicting properties (e.g., speed vs. accuracy) are ubiquitous in cognition, but the relevant literature is conceptually fragmented, scattered across disciplines, and has not been organized in a coherent framework. This paper takes an initial step toward a general theory of cognitive trade-offs by examining four key properties of goal-directed systems: performance, efficiency, robustness, and flexibility. These properties define a number of basic functional trade-offs that can be used to map the abstract “design space” of natural and artificial cognitive systems. Basic functional trade-offs provide a shared vocabulary to describe a variety of specific trade-offs including speed vs. accuracy, generalist vs. specialist, exploration vs. exploitation, and many others. By linking specific features of cognitive functioning to general properties such as robustness and efficiency, it becomes possible to harness some powerful insights from systems engineering and systems biology to suggest useful generalizations, point to under-explored but potentially important trade-offs, and prompt novel hypotheses and connections between disparate areas of research.

Dorsolateral Striatum Engagement Interferes with Early Discrimination Learning

SUMMARYIn current models, learning the relationship between environmental stimuli and the outcomes of actions involves both stimulus-driven and goal-directed systems, mediated in part by the DLS and DMS, respectively. However, though these models emphasize the importance of the DLS in governing actions after extensive experience has accumulated, there is growing evidence of DLS engagement from the onset of training. Here, we used in vivo photosilencing to reveal that DLS recruitment interferes with early touchscreen discrimination learning. We also show that the direct output pathway of the DLS is preferentially recruited and causally involved in early learning and find that silencing the normal contribution of the DLS produces plasticity-related alterations in a PL-DMS circuit. These data provide further evidence suggesting that the DLS is recruited in the construction of stimulus-elicited actions that ultimately automate behavior and liberate cognitive resources for other demands, but with a cost to performance at the outset of learning.

Serotonin 4 Receptors: A Cornerstone in Anorexia Nervosa?

Adaptive decision-making to eat is crucial for survival but in anorexia nervosa, the brain persistently supports reduced food intake despite the physiological need to consume food. How the brain persists in reducing food intake sometimes even to the point of death despite the evolution of multiple mechanisms to ensure survival by governing adaptive eating behaviors remains mysterious. Food intake is a conserved behavioral trait between all species and involves numerous biological systems including the old phylogenetically serotonergic system. The present review focuses on anorexia and the implication of specific serotonin (5-HT, 5-hydroxytryptamine) receptors in food intake. In this context, we found that an early restrictive food intake due to stress, critically engages goaldirected (decision-making) systems upon the control of the serotonin 5-HT4 receptors, supporting that an early food restriction may first protect from depressive-like states but could become a deadly dependence. Finally, in the face to environmental challenges, an initial protective and beneficial adaptive response could become a pathologic dependence.

General Habit Propensity Relates to the Sensation Seeking Subdomain of Impulsivity But Not Obesity.

According to dual-system theory, instrumental learning and performance depend on the balance between goal-directed and habitual action control. Overreliance on habits has been argued to characterize clinical conditions such as drug addiction or obsessive-compulsive disorder as well as obesity and excessive impulsivity. A tendency toward habitual action control in obesity has already been indicated in the food domain. However, impairments might not be restricted to eating behavior. This has been suggested by domain-general obesity-associated disturbances in executive function as well as alterations in corticostriatal circuits underlying the goal-directed and habitual systems. In this study we examined the balance of goal-directed and habitual action control in a sample of normal-weight, overweight, and obese participants (n = 105) using the slips-of-action test in a non-food context. We tested for continuous or group-based associations between body weight status (BMI) and the devaluation sensitivity index (DSI), a parameter representing the balance of the goal-directed and habitual systems in action control. As personality differences in the domain of impulsivity might affect this relationship, we also examined whether the interaction between BMI and self-reported impulsivity, based on the UPPS Impulsive Behavior Scale, was related to the DSI. In addition to that, we tested for direct, i.e., weight status independent, relationships between UPPS subdomains of impulsivity and the DSI. We failed to find evidence for a relationship between weight status and sensitivity to devaluation as indexed by the DSI. However, independent of weight status, we observed lower sensitivity to devaluation in sensation seekers, a subtype of impulsivity. To conclude, behavioral flexibility in the sense of disturbances in the balance between the habitual and goal-directed systems seems to be unaffected by weight status in a non-food context. Consequently, stimuli and behavior might not be generally excessively linked in overweight or obesity. However, according to ceiling effects we cannot rule out subtle effects the paradigm was not able to disentangle. Further, future studies are needed to clarify the role of specific subtypes of obesity (e.g., food addiction). The indicated habit propensity in sensation seekers may account for previous reports of weak avoidance behavior and risky decision making.

How Does the Brain Implement Adaptive Decision Making to Eat?

An improved understanding of the neural basis of eating disorders is a timely challenge because these disorders can be deadly. Up to 70 million of people in the world suffer from eating disorders. Anorexia nervosa affects 1-4% of women in United States and is the first cause of death among adolescents in Europe. Studies relying on animal models suggest that decision making to eat (or not) can prevail over actual energy requirements due to emotional disturbances resulting in abnormal habitual behavior, mimicking dependence. These recent studies provide a foundation for developing more specific and effective interventions for these disorders.

Using Computer-Based Programmed Instruction to Train Goal-Directed Systems Design

The purpose of this study was to evaluate two versions of a programmed instruction training program designed to teach undergraduate college students a goal-directed systems approach to analyzing organizational systems (Malott & Garcia, 1987). The first version was a paper-based programmed instruction module that had previously been shown to be effective at training the basic knowledge of the concepts, however was ineffective at training the application of these concepts. A computer-based programmed instruction (CBPI) version was created to improve the application of these concepts, which was tested through a series of three open-ended posttests with increasingly explicit prompts for each successive test. The results of the study showed higher performance results for the CBPI versions across all three dependent variables. The results of a nonparametric global test showed a standardized effect size of .86 and a p-value of <.001.

A cybernetic big five theory for personality psychology

Cybernetics, the study of goal-directed systems, offers a framework in which to develop an integrative theory of personality. Personality traits describe individual differences in the frequency and intensity of various emotional, motivational, cognitive, and behavioural states. A major challenge for personality psychology is to link descriptive models of traits to the underlying psychological and biological processes that generate the relevant states. Focusing on characteristic adaptations, adequately defined as cybernetic constructs, can aid in meeting this challenge. Characteristic adaptations comprise three categories that together describe the informational contents of a cybernetic system: (1) goals, (2) evaluations and representations of the aspects of the world relevant to those goals, and (3) strategies, plans, and habits that allow movement toward those goals. In this theory, personality traits from the Big Five hierarchy can be explained in terms of the functional parameters of this system, related to goal pursuit, error detection, and exploration.

Machine wanting

Wants, preferences, and cares are physical things or events, not ideas or propositions, and therefore no chain of pure logic can conclude with a want, preference, or care. It follows that no pure-logic machine will ever want, prefer, or care. And its behavior will never be driven in the way that deliberate human behavior is driven, in other words, it will not be motivated or goal directed. Therefore, if we want to simulate human-style interactions with the world, we will need to first understand the physical structure of goal-directed systems. I argue that all such systems share a common nested structure, consisting of a smaller entity that moves within and is driven by a larger field that contains it. In such systems, the smaller contained entity is directed by the field, but also moves to some degree independently of it, allowing the entity to deviate and return, to show the plasticity and persistence that is characteristic of goal direction. If all this is right, then human want-driven behavior probably involves a behavior-generating mechanism that is contained within a neural field of some kind. In principle, for goal directedness generally, the containment can be virtual, raising the possibility that want-driven behavior could be simulated in standard computational systems. But there are also reasons to believe that goal-direction works better when containment is also physical, suggesting that a new kind of hardware may be necessary.

A Tale of Two Systems

The two systems of managing health and safety and of managing preservation of cultural property have many parallels. Either, or both, can exist as predominantly habit-based systems. However, when managed from a proactive perspective, they can be considered goal-directed systems. In the first case, the goal is to maintain health and avoid accidents to people. In the second case, the goal is to avoid damage and loss to cultural property. Both goals are clear, widely accepted, and even inarguably noble and worthy, a great advantage for both systems. Health and safety and cultural property preservation systems will operate best when they are mutually supportive. As a simple example, wearing appropriate gloves while handling objects protects the wearer as well as the collection object/specimen from contamination. Some examples of conflicts between the two risk management systems can also be found. For instance, an old collection of pharmaceuticals can pose many risks. From a health and safety perspective, disposal seems the obvious solution. From a curatorial perspective, keeping contents intact for future analysis may be important. The exercise of developing a creative solution that protects both people and collections can lead to improved understanding among all parties. Viewing health and safety and cultural property preservation as parallel and closely related risk management systems opens the way to improvements in both. Combining the two encourages synergies that can lead to effective risk management and resource allocation by custodians of our collected heritage.

Upper-directed systems: a new approach to teleology in biology

How shall we understand apparently teleological systems? What explains their persistence (returning to past trajectories following errors) and their plasticity (finding the same trajectory from different starting points)? Here I argue that all seemingly goal-directed systems—e.g., a food-seeking organism, human-made devices like thermostats and torpedoes, biological development, human goal seeking, and the evolutionary process itself—share a common organization. Specifically, they consist of an entity that moves within a larger containing structure, one that directs its behavior in a general way without precisely determining it. If so, then teleology lies within the domain of the theory of compositional hierarchies.