Thumbnail
Access Restriction
Subscribed

Author Shimansky, Yury P.
Source SpringerLink
Content type Text
Publisher Springer-Verlag
File Format PDF
Copyright Year ©2009
Language English
Subject Domain (in DDC) Technology ♦ Medicine & health
Subject Keyword Learning ♦ Neural networks ♦ Biological optimization ♦ Bacterial chemotaxis ♦ Modification probability ♦ Statistical Physics, Dynamical Systems and Complexity ♦ Neurobiology ♦ Computer Application in Life Sciences ♦ Neurosciences ♦ Bioinformatics
Abstract Learning processes in the brain are usually associated with plastic changes made to optimize the strength of connections between neurons. Although many details related to biophysical mechanisms of synaptic plasticity have been discovered, it is unclear how the concurrent performance of adaptive modifications in a huge number of spatial locations is organized to minimize a given objective function. Since direct experimental observation of even a relatively small subset of such changes is not feasible, computational modeling is an indispensable investigation tool for solving this problem. However, the conventional method of error back-propagation (EBP) employed for optimizing synaptic weights in artificial neural networks is not biologically plausible. This study based on computational experiments demonstrated that such optimization can be performed rather efficiently using the same general method that bacteria employ for moving closer to an attractant or away from a repellent. With regard to neural network optimization, this method consists of regulating the probability of an abrupt change in the direction of synaptic weight modification according to the temporal gradient of the objective function. Neural networks utilizing this method (regulation of modification probability, RMP) can be viewed as analogous to swimming in the multidimensional space of their parameters in the flow of biochemical agents carrying information about the optimality criterion. The efficiency of RMP is comparable to that of EBP, while RMP has several important advantages. Since the biological plausibility of RMP is beyond a reasonable doubt, the RMP concept provides a constructive framework for the experimental analysis of learning in natural neural networks.
ISSN 03401200
Age Range 18 to 22 years ♦ above 22 year
Educational Use Research
Education Level UG and PG
Learning Resource Type Article
Publisher Date 2009-10-21
Publisher Place Berlin/Heidelberg
e-ISSN 14320770
Journal Biological Cybernetics
Volume Number 101
Issue Number 5
Page Count 7
Starting Page 379
Ending Page 385


Source: SpringerLink