Matrix analysis of neural network architectures for audio signal classification
Matrix analysis of neural network architectures for audio signal classification
Given the increased use of neural networks for various tasks in audio signal processing, this paper concentrates firstly on providing a rigorous analysis of forward and backward propagation for general network architectures. This paper concentrates on the Multi-layer Perceptron (MLP) and use the basic vectorized forward propagation to derive general backpropagation equations for an MLP model with any number of hidden layers. The rules of matrix calculus are used when applying the derivatives for the chain rule and simplified equations in vector and matrix form are defined for the computation of the gradients of the error with respect to the weights of the network. The equations derived are investigated further by using examples of signal processing tasks such as the classification of audio spectra. The singular value decomposition (SVD) is applied to the weight matrices to help understand the network behaviour.
Paul, Vlad Stefan
a643f880-7e70-4ae0-a27b-4e77c3c451de
Nelson, Philip
5c6f5cc9-ea52-4fe2-9edf-05d696b0c1a9
17 November 2020
Paul, Vlad Stefan
a643f880-7e70-4ae0-a27b-4e77c3c451de
Nelson, Philip
5c6f5cc9-ea52-4fe2-9edf-05d696b0c1a9
Paul, Vlad Stefan and Nelson, Philip
(2020)
Matrix analysis of neural network architectures for audio signal classification.
In Proceedings of the Institute of Acoustics.
vol. 42,
Institute of Acoustics..
Record type:
Conference or Workshop Item
(Paper)
Abstract
Given the increased use of neural networks for various tasks in audio signal processing, this paper concentrates firstly on providing a rigorous analysis of forward and backward propagation for general network architectures. This paper concentrates on the Multi-layer Perceptron (MLP) and use the basic vectorized forward propagation to derive general backpropagation equations for an MLP model with any number of hidden layers. The rules of matrix calculus are used when applying the derivatives for the chain rule and simplified equations in vector and matrix form are defined for the computation of the gradients of the error with respect to the weights of the network. The equations derived are investigated further by using examples of signal processing tasks such as the classification of audio spectra. The singular value decomposition (SVD) is applied to the weight matrices to help understand the network behaviour.
This record has no associated files available for download.
More information
Published date: 17 November 2020
Identifiers
Local EPrints ID: 446421
URI: http://eprints.soton.ac.uk/id/eprint/446421
PURE UUID: ae9f2c32-2beb-447a-9b55-6d48aab37d31
Catalogue record
Date deposited: 09 Feb 2021 17:30
Last modified: 21 Feb 2024 03:03
Export record
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics