Consolidation in Neural Networks and in the Sleeping Brain
作者:
Anthony Robins,
期刊:
Connection Science
(Taylor Available online 1996)
卷期:
Volume 8,
issue 2
页码: 259-276
ISSN:0954-0091
年代: 1996
DOI:10.1080/095400996116910
出版商: Taylor & Francis Group
关键词: Consolidation;Learning;Hippocampus;Catastrophic Forgetting;Catastrophic Interference;Rehearsal;Pseudorehearsal
数据来源: Taylor
摘要:
In this paper we explore the topic of the consolidation of information in neural network learning. One problem in particular has limited the ability of a broad range of neural networks to perform ongoing learning and consolidation. This is 'catastrophic forgetting', the tendency for new information, when it is learned, to disrupt old information. We will review and slightly extend the rehearsal and pseudorehearsal solutions to the catastrophic forgetting problem presented in Robins (1995). The main focus of this paper is to then relate these mechanisms to the consolidation processes which have been proposed in the psychological literature regarding sleep. We suggest that the catastrophic forgetting problem in artificial neural networks (ANNs) is a problem that has actually occurred in the evolution of the mammalian brain, and that the pseudorehearsal solution to the problem in ANNs is functionally equivalent to the sleep consolidation solution adopted by the brain. Finally, we review related work by McClelland et al. (1995) and propose a tentative model of learning and sleep that emphasizes consolidation mechanisms and the role of the hippocampus.
点击下载:
PDF (246KB)
返 回