On the convergence of thelp‐norm algorithm for polynomial perceptron having different error signal distributions
作者:
Ching‐Haur Chang,
Sammy Siu,
Che‐Ho Wei,
期刊:
Journal of the Chinese Institute of Engineers
(Taylor Available online 1995)
卷期:
Volume 18,
issue 2
页码: 293-302
ISSN:0253-3839
年代: 1995
DOI:10.1080/02533839.1995.9677691
出版商: Taylor & Francis Group
关键词: lp‐norm error criterion;polynomial perceptron;activation function
数据来源: Taylor
摘要:
The convergence property of thelp‐norm algorithm for polynomial‐perceptron having different error signal distributions will be analyzed in this paper. To see the effect of error signal on the convergence rate, two types of activation functions are considered in the analysis: one is of a linear type and the other is of a sigmoidal type. Different activation functions yield different ranges of output signal and, in turn, yield different error signal distributions. Linear activation function causes the error signal to be distributed in an uncertain way, while sigmoidal activation function causes it to be distributed in a tightly bounded region. Based on this difference the convergence property of thelp‐norm algorithm, 1 ≤p ≤2, is investigated in this paper. Expressions of average learning gains are obtained in terms of the power metricp, the error probability, and the upper bound of the error signal distribution. Analytic results indicate that it is of particular value in using thelp‐norm algorithm for the perceptron using sigmoidal activation functions. Computer simulation of an adaptive equalizer using this algorithm confirms the theoretical analysis.
点击下载:
PDF (604KB)
返 回