The University of Southampton
University of Southampton Institutional Repository

On the Convergence Rate Performance of Normalized Least-Mean-Square Adaptation

Record type: Article

This paper compares the convergence rate performance of the Normalized Least-Mean-Square (or NLMS) algorithm to that of the standard Least-Mean-Square (LMS) algorithm, which is based on a well known interpretation of the NLMS algorithm as a form of LMS via input normalization. With this interpretation, the analysis is considerably simplified, and the difference in the rate of parameter convergence can be compared directly by evaluating the condition number of the normalized input correlation matrix and the unnormalized one. The main contribution of this paper has two parts. Firstly, it derives exact condition number expressions for the normalized input correlation matrix using an arbitrary odd-order filter length with two distinct unnormalized eigenvalues; whereas the corresponding even-order NLMS condition numbers are shown to be bounded between their odd-order counterparts. These expressions require that the input samples be statistically stationary and zero-mean Gaussian distributed, and provide an important insight into the relative convergence performance of the NLMS algorithm as a function of the filter length to that of the LMS. Secondly, this paper provides a conjecture which set bounds on the NLMS condition number for any arbitrary number of distinct unnormalized eigenvalues, and this conjecture has been found to be consistent with extensive computer simulations. Given that the same maximum and minimum unnormalized eigenvalues but with varying power levels associated with intermediate eigenvalues, this bound suggests that the NLMS convergence rate decreases with the number of unnormalized eigenvalues with excessive power levels.

Full text not available from this repository.

Citation

An, P.E., Brown, M. and Harris, C.J. (1995) On the Convergence Rate Performance of Normalized Least-Mean-Square Adaptation IEEE Trans. on Neural Networks, 6, (6), 1549--1552.

More information

Published date: 1995
Organisations: Southampton Wireless Group

Identifiers

Local EPrints ID: 250281
URI: http://eprints.soton.ac.uk/id/eprint/250281
PURE UUID: 55fb2274-a52a-48a6-ad55-cd9ab73ff23f

Catalogue record

Date deposited: 04 May 1999
Last modified: 18 Jul 2017 10:43

Export record

Contributors

Author: P.E. An
Author: M. Brown
Author: C.J. Harris

University divisions


Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×