Abstract

For the brain to recognize local orientations within images, neurons must spontaneously break the translation and rotation symmetry of their response functions—an archetypal example of unsupervised learning. The dominant framework for unsupervised learning in biology is Hebb’s principle, but how Hebbian learning could break such symmetries is a longstanding biophysical riddle. Theoretical studies argue that this requires inputs to the visual cortex to invert the relative magnitude of their correlations at long distances. Empirical measurements have searched in vain for such an inversion and report the opposite to be true. We formally approach the question through the Hermitianization of a multilayer model, which maps it into a problem of zero-temperature phase transitions. In the emerging phase diagram, both symmetries break spontaneously as long as (i) recurrent interactions are sufficiently long range and (ii) Hebbian competition is duly accounted for. A key ingredient for symmetry breaking is competition among connections sprouting from the same afferent cell. Such a competition, along with simple monotonic falloff of input correlations with distance, is capable of triggering the broken-symmetry phase required by image processing. We provide analytic predictions on the relative magnitudes of the relevant length scales needed for this novel mechanism to occur. These results reconcile experimental observations to the Hebbian paradigm, shed light on a new mechanism for visual cortex development, and contribute to our growing understanding of the relationship between learning and symmetry breaking.4 MoreReceived 8 October 2021Revised 3 May 2022Accepted 28 June 2022DOI:https://doi.org/10.1103/PhysRevX.12.031024Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article’s title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasLearningNeuronal networksNeuroplasticityNeuroscienceSynapsesBiological Physics

Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call