The University of Southampton
University of Southampton Institutional Repository

Matrix analysis of neural network architectures for audio signal classification

Matrix analysis of neural network architectures for audio signal classification
Matrix analysis of neural network architectures for audio signal classification
Given the increased use of neural networks for various tasks in audio signal processing, this paper concentrates firstly on providing a rigorous analysis of forward and backward propagation for general network architectures. This paper concentrates on the Multi-layer Perceptron (MLP) and use the basic vectorized forward propagation to derive general backpropagation equations for an MLP model with any number of hidden layers. The rules of matrix calculus are used when applying the derivatives for the chain rule and simplified equations in vector and matrix form are defined for the computation of the gradients of the error with respect to the weights of the network. The equations derived are investigated further by using examples of signal processing tasks such as the classification of audio spectra. The singular value decomposition (SVD) is applied to the weight matrices to help understand the network behaviour.
Institute of Acoustics
Paul, Vlad Stefan
a643f880-7e70-4ae0-a27b-4e77c3c451de
Nelson, Philip
5c6f5cc9-ea52-4fe2-9edf-05d696b0c1a9
Paul, Vlad Stefan
a643f880-7e70-4ae0-a27b-4e77c3c451de
Nelson, Philip
5c6f5cc9-ea52-4fe2-9edf-05d696b0c1a9

Paul, Vlad Stefan and Nelson, Philip (2020) Matrix analysis of neural network architectures for audio signal classification. In Proceedings of the Institute of Acoustics. vol. 42, Institute of Acoustics..

Record type: Conference or Workshop Item (Paper)

Abstract

Given the increased use of neural networks for various tasks in audio signal processing, this paper concentrates firstly on providing a rigorous analysis of forward and backward propagation for general network architectures. This paper concentrates on the Multi-layer Perceptron (MLP) and use the basic vectorized forward propagation to derive general backpropagation equations for an MLP model with any number of hidden layers. The rules of matrix calculus are used when applying the derivatives for the chain rule and simplified equations in vector and matrix form are defined for the computation of the gradients of the error with respect to the weights of the network. The equations derived are investigated further by using examples of signal processing tasks such as the classification of audio spectra. The singular value decomposition (SVD) is applied to the weight matrices to help understand the network behaviour.

This record has no associated files available for download.

More information

Published date: 17 November 2020

Identifiers

Local EPrints ID: 446421
URI: http://eprints.soton.ac.uk/id/eprint/446421
PURE UUID: ae9f2c32-2beb-447a-9b55-6d48aab37d31
ORCID for Vlad Stefan Paul: ORCID iD orcid.org/0000-0002-5562-6102
ORCID for Philip Nelson: ORCID iD orcid.org/0000-0002-9563-3235

Catalogue record

Date deposited: 09 Feb 2021 17:30
Last modified: 21 Feb 2024 03:03

Export record

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×