摘要:

We propose that the ability to extract regularities from time series through prediction learning can be enhanced if we use a hierarchical architecture in which higher layers are trained to predict the internal state of lower layers when such states change significantly. This hierarchical organization has two functions: (a) it forces the system to recode sensory information progressively so as to enhance useful regularities and filter out useless information; and (b) it progressively reduces the length of the sequences which should be predicted going from lower to higher layers. This, in turn, allows higher levels to extract higher-level regularities which are hidden at the sensory level. By training an architecture of this type to predict the next sensory state of a robot navigating in an environment divided into two rooms, we show how the first-level prediction layer extracts low-level regularities such as 'walls', 'corners' and 'corridors', while the second-level prediction layer extracts higher-level regularities such as 'the left side wall of the large room'. The extraction of these regularities allows the robot to localize its position in the environment and to detect changes in the environment (e.g. the presence of a new object or the fact that a door has been closed).

ISSN:0954-0091    

DOI:10.1080/095400999116313

出版商:Taylor & Francis Group    

年代:1999

数据来源: Taylor

摘要:

This paper presents a modular connectionist network model of the development of seriation (sorting) in children. The model uses the cascade-correlation generative connectionist algorithm. These cascade-correlation networks do better than existing rule-based models at developing through soft stage transitions, sorting more correctly with larger stimulus size increments and showing variation in seriation performance within stages. However, the full generative power of cascade-correlation was not found to be a necessary component for successfully modelling the development of seriation abilities. Analysis of network weights indicates that improvements in seriation are due to continuous small changes instead of the radical restructuring suggested by Piaget. The model suggests that seriation skills are present early in development and increase in precision during later development. The required learning environment has a bias towards smaller and nearly ordered arrays. The variability characteristic of children's performance arises from sorting subsets of the total array. The model predicts better sorting moves with more array disorder, and a dissociation between which element should be moved and where it should be moved.

ISSN:0954-0091    

DOI:10.1080/095400999116322

出版商:Taylor & Francis Group    

年代:1999

数据来源: Taylor

摘要:

One kind of prosodic structure that apparently underlies both music and some examples of speech production is meter. Yet detailed measurements of the timing of both music and speech show that the nested periodicities that define metrical structure can be quite noisy in time. What kind of system could produce or perceive such variable metrical timing patterns? And what would it take to be able to store and reproduce particular metrical patterns from long-term memory? We have developed a network of coupled oscillators that both produces and perceives patterns of pulses that conform to particular meters. In addition, beginning with an initial state with no biases, it can learn to prefer the particular meter that it has been previously exposed to.

ISSN:0954-0091    

DOI:10.1080/095400999116331

出版商:Taylor & Francis Group    

年代:1999

数据来源: Taylor