Formal concepts expressed by compositional hierarchical Hebbian cell assemblies

Abstract

Hebbian cell assemblies can be formalised as sets of tightly connected cells in autoand hetero-associative memories. Direct evidence for such has recently been obtained in multiple-unit recordings from rat hippocampal neurons [1,2]. These experiments suggest a hierarchical organisation where cliques are embedded in each other such that larger cliques represent less specific stimulus conditions. We here suggest an extended interpretation stating that the firing patterns may not just reflect nested categories but a lattice of concepts about stimulus-response mappings in the sense of formal concept analysis, an applied branch of set theory. We present an implementation of formal concept lattices in bidirectional associative memories that, in contrast to previous work by Belohlavek [3], satisfies Dale's principle and uses balanced excitation and inhibition [4]. Inhibitory cells have fixed, non-plastic synapses even if the model learns new concepts. As an extreme case a single global inhibitory cell is enough that controls the total level of activation. The excitatory cells can further learn incrementally using a Hebbian coincidence learning rule. A spiking neuron variant of the model is further presented and implications of the model for retrieval in auto-associative memories are outlined. Overall the model is well suited for representing hierarchical compositional relationships between entities in the form of correlated memory traces in the brain. Acknowledgements The author acknowledges support by the Engineering and Physical Sciences Research Council of the United Kingdom (EP/C010841/1, COLAMN – A Novel Computing Architecture for Cognitive Systems based on the Laminar Microcircuitry of the Neocortex) and the European Community (IST2001-35282, FACETS – Fast Analog Computing with Emergent Transient States).