Optimal information storage and the distribution of synaptic weights: perceptron versus Purkinje cell.

Archive ouverte

Brunel, Nicolas | Hakim, Vincent | Isope, Philippe | Nadal, Jean-Pierre | Barbour, Boris

Edité par CCSD ; Elsevier -

International audience. It is widely believed that synaptic modifications underlie learning and memory. However, few studies have examined what can be deduced about the learning process from the distribution of synaptic weights. We analyze the perceptron, a prototypical feedforward neural network, and obtain the optimal synaptic weight distribution for a perceptron with excitatory synapses. It contains more than 50% silent synapses, and this fraction increases with storage reliability: silent synapses are therefore a necessary byproduct of optimizing learning and reliability. Exploiting the classical analogy between the perceptron and the cerebellar Purkinje cell, we fitted the optimal weight distribution to that measured for granule cell-Purkinje cell synapses. The two distributions agreed well, suggesting that the Purkinje cell can learn up to 5 kilobytes of information, in the form of 40,000 input-output associations.

Consulter en ligne

Suggestions

Du même auteur

Cerebellar learning using perturbations

Archive ouverte | Bouvier, Guy | CCSD

International audience. The cerebellum aids the learning of fast, coordinated movements. According to current consensus, erroneously active parallel fibre synapses are depressed by complex spikes signalling movement...

Burst-Dependent Bidirectional Plasticity in the Cerebellum Is Driven by Presynaptic NMDA Receptors

Archive ouverte | Bouvier, Guy | CCSD

International audience. Numerous studies have shown that cerebellar function is related to the plasticity at the synapses between parallel fibers and Purkinje cells. How specific input patterns determine plasticity ...

Mutual information, Fisher information and population coding

Archive ouverte | Brunel, Nicolas | CCSD

International audience. In the context of parameter estimation and model selection, it is only quite recently that a direct link between the Fisher information and information theoretic quantities has been exhibited...

Chargement des enrichissements...