首页   按字顺浏览 期刊浏览 卷期浏览 Catastrophic Forgetting and the Pseudorehearsal Solution in Hopfield-type Networks
Catastrophic Forgetting and the Pseudorehearsal Solution in Hopfield-type Networks

 

作者: ANTHONY ROBINS,   SIMON McCALLUM,  

 

期刊: Connection Science  (Taylor Available online 1998)
卷期: Volume 10, issue 2  

页码: 121-135

 

ISSN:0954-0091

 

年代: 1998

 

DOI:10.1080/095400998116530

 

出版商: Taylor & Francis Group

 

关键词: Catastrophic Forgetting;Catastrophic Interference;Consolidation;Rehearsal;Pseudorehearsal;Hopfield Network

 

数据来源: Taylor

 

摘要:

Pseudorehearsal is a mechanism proposed by Robins which alleviates catastrophic forgetting in multi-layer perceptron networks. In this paper, we extend the exploration of pseudorehearsal to a Hopfield-type net. The same general principles apply: old information can be rehearsed if it is available, and if it is not available, then generating and rehearsing approximations of old information that 'map' the behaviour of the network can also be effective at preserving the actual old information itself. The details of the pseudorehearsal mechanism, however, benefit from being adapted to the dynamics of Hopfield nets so as to exploit the extra attractors created in state space during learning. These attractors are usually described as 'spurious' or 'cross-talk', and regarded as undesirable, interfering with the retention of the trained population items. Our simulations have shown that, in another sense, such attractors can in fact be useful in preserving the learned population. In general terms, a solution to the catastrophic forgetting problem enables the on-going or sequential learning of information in artificial neural networks, and consequently also provides a framework for the modelling of lifelong learning/developmental effects in cognition.

 

点击下载:  PDF (247KB)



返 回