Channel response-aware photonic neural network accelerators for high-speed inference through bandwidth-limited optics
Channel response-aware photonic neural network accelerators for high-speed inference through bandwidth-limited optics
Photonic neural network accelerators (PNNAs) have been lately brought into the spotlight as a new class of custom hardware that can leverage the maturity of photonic integration towards addressing the low-energy and computational power requirements of deep learning (DL) workloads. Transferring, however, the high-speed credentials of photonic circuitry into analogue neuromorphic computing necessitates a new set of DL training methods aligned along certain analogue photonic hardware characteristics. Herein, we present a novel channel response-aware (CRA) DL architecture that can address the implementation challenges of high-speed compute rates on bandwidth-limited photonic devices by incorporating their frequency response into the training procedure. The proposed architecture was validated both through software and experimentally by implementing the output layer of a neural network (NN) that classifies images of the MNIST dataset on an integrated SiPho coherent linear neuron (COLN) with a 3dB channel bandwidth of 7 GHz. A comparative analysis between the baseline and CRA model at 20, 25 and 32GMAC/sec/axon revealed respective experimental accuracies of 98.5%, 97.3% and 92.1% for the CRA model, outperforming the baseline model by 7.9%, 12.3% and 15.6%, respectively.
10664-10671
Mourgias-Alexandris, George
57c31ebb-de8d-4d7e-b17e-8be4ec646318
Moralis-Pegios, Miltiadis
ed2f6e60-508e-4307-a692-620fad3aa31e
Tsakyridis, Apostolos
d938ba9c-0ea8-4772-bd4a-6107ed9ef4f2
Passalis, Nikolaos
f2b2d030-36ec-4c04-81d5-84b1fc5c6f15
Kirtas, Manos
cd8891ae-f270-423d-bc40-9d624003986c
Rutirawut, Teerapat
590101f7-65c8-4da3-9a5d-e3d2efd74349
Gardes, Frederic
7a49fc6d-dade-4099-b016-c60737cb5bb2
Pleros, Nikos
31745dfe-bbc5-490a-bd49-0384f573f353
15 March 2022
Mourgias-Alexandris, George
57c31ebb-de8d-4d7e-b17e-8be4ec646318
Moralis-Pegios, Miltiadis
ed2f6e60-508e-4307-a692-620fad3aa31e
Tsakyridis, Apostolos
d938ba9c-0ea8-4772-bd4a-6107ed9ef4f2
Passalis, Nikolaos
f2b2d030-36ec-4c04-81d5-84b1fc5c6f15
Kirtas, Manos
cd8891ae-f270-423d-bc40-9d624003986c
Rutirawut, Teerapat
590101f7-65c8-4da3-9a5d-e3d2efd74349
Gardes, Frederic
7a49fc6d-dade-4099-b016-c60737cb5bb2
Pleros, Nikos
31745dfe-bbc5-490a-bd49-0384f573f353
Mourgias-Alexandris, George, Moralis-Pegios, Miltiadis, Tsakyridis, Apostolos, Passalis, Nikolaos, Kirtas, Manos, Rutirawut, Teerapat, Gardes, Frederic and Pleros, Nikos
(2022)
Channel response-aware photonic neural network accelerators for high-speed inference through bandwidth-limited optics.
Optics Express, 30 (7), .
(doi:10.1364/OE.452803).
Abstract
Photonic neural network accelerators (PNNAs) have been lately brought into the spotlight as a new class of custom hardware that can leverage the maturity of photonic integration towards addressing the low-energy and computational power requirements of deep learning (DL) workloads. Transferring, however, the high-speed credentials of photonic circuitry into analogue neuromorphic computing necessitates a new set of DL training methods aligned along certain analogue photonic hardware characteristics. Herein, we present a novel channel response-aware (CRA) DL architecture that can address the implementation challenges of high-speed compute rates on bandwidth-limited photonic devices by incorporating their frequency response into the training procedure. The proposed architecture was validated both through software and experimentally by implementing the output layer of a neural network (NN) that classifies images of the MNIST dataset on an integrated SiPho coherent linear neuron (COLN) with a 3dB channel bandwidth of 7 GHz. A comparative analysis between the baseline and CRA model at 20, 25 and 32GMAC/sec/axon revealed respective experimental accuracies of 98.5%, 97.3% and 92.1% for the CRA model, outperforming the baseline model by 7.9%, 12.3% and 15.6%, respectively.
Text
oe-30-7-10664
- Version of Record
More information
Accepted/In Press date: 4 February 2022
Published date: 15 March 2022
Identifiers
Local EPrints ID: 457192
URI: http://eprints.soton.ac.uk/id/eprint/457192
ISSN: 1094-4087
PURE UUID: 0c719c3d-b697-4288-bccc-d102b4a192d8
Catalogue record
Date deposited: 26 May 2022 16:36
Last modified: 17 Mar 2024 03:26
Export record
Altmetrics
Contributors
Author:
George Mourgias-Alexandris
Author:
Miltiadis Moralis-Pegios
Author:
Apostolos Tsakyridis
Author:
Nikolaos Passalis
Author:
Manos Kirtas
Author:
Teerapat Rutirawut
Author:
Frederic Gardes
Author:
Nikos Pleros
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics