An objective function for Hebbian self-limiting synaptic plasticity rules

GROS, CLAUDIUS; ECKMANN, SAMUEL; ECHEVESTE, RODRIGO

Encuentro; APS March Meeting 2016; 2016

Objective functions, formulated in terms of information theoretical measures with respect to the input and output probability distributions, provide a useful framework for the formulation of guiding principles for information processing systems, such as neural networks. In the present work, a guiding principle for neural plasticity is formulated in terms of an objective function expressed as the Fisher information with respect to an operator that we denote as the synaptic flux. By minimization of this objective function, we obtain Hebbian self-limiting synaptic plasticity rules, avoiding unbounded weight growth. Furthermore, we show how the rules are selective to directions of maximal negative excess kurtosis, making them suitable for independent component analysis.