Abstract

Feedback control is used by many distributed systems to optimize behaviour. Traditional feedback control algorithms spend significant resources to constantly sense and stabilize a continuous control variable of interest, such as vehicle speed for implementing cruise control, or body temperature for maintaining homeostasis. By contrast, discrete-event feedback (e.g. a server acknowledging when data are successfully transmitted, or a brief antennal interaction when an ant returns to the nest after successful foraging) can reduce costs associated with monitoring a continuous variable; however, optimizing behaviour in this setting requires alternative strategies. Here, we studied parallels between discrete-event feedback control strategies in biological and engineered systems. We found that two common engineering rules—additive-increase, upon positive feedback, and multiplicative-decrease, upon negative feedback, and multiplicative-increase multiplicative-decrease—are used by diverse biological systems, including for regulating foraging by harvester ant colonies, for maintaining cell-size homeostasis, and for synaptic learning and adaptation in neural circuits. These rules support several goals of these systems, including optimizing efficiency (i.e. using all available resources); splitting resources fairly among cooperating agents, or conversely, acquiring resources quickly among competing agents; and minimizing the latency of responses, especially when conditions change. We hypothesize that theoretical frameworks from distributed computing may offer new ways to analyse adaptation behaviour of biology systems, and in return, biological strategies may inspire new algorithms for discrete-event feedback control in engineering.

Highlights

  • Homeostasis refers to the ability of a system to recover to a desired set point after being changed or perturbed [1]

  • Feedback control is applied in dynamical systems that provide a continuous variable as feedback [2], such as in cruise control to keep a vehicle at a constant speed, or in the homeostatic regulation of body temperature

  • We show that two common rules—additive-increase multiplicativedecrease (AIMD), which adds a small constant to the control variable upon positive feedback, and multiplies the variable by a constant

Read more

Summary

Introduction

Homeostasis refers to the ability of a system to recover to a desired set point after being changed or perturbed [1]. We apply this framework to examples from three biological systems (foraging by harvester ants, cell size control and homeostasis, and rules for adaptive synaptic plasticity in the brain), as well as two engineered systems (bandwidth control on the Internet, and online decisionmaking in machine learning) From these systems, we show that two common rules—additive-increase multiplicativedecrease (AIMD), which adds a small constant to the control variable upon positive feedback, and multiplies the variable by a constant

A model of discrete-event feedback
Properties of additive and multiplicative rules
Examples of discrete-event feedback in biology
Foraging behaviour by harvester ants (figure 1)
Cell size control and homeostasis (figure 2)
Synaptic plasticity in the brain
Novelty detection via reinforcement feedback (figure 3a)
Mechanisms for homeostatic plasticity (figure 3b)
Spike-timing-dependent plasticity (figure 3c)
Discrete-event feedback in engineering
The transport control protocol on the Internet (figure 4)
Multiplicative weight updates in machine learning
Efficiency
Fairness
Competition
Latency
Slow start
Summary
Complexities of biological systems and opportunities for theorists
Future work and guidance
42. Aso Y et al 2014 The neuronal architecture of the
Findings
36. Li F et al 2020 The connectome of the adult
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call