The University of Southampton
University of Southampton Institutional Repository

Ten years after ImageNet: a 360° perspective on artificial intelligence

Ten years after ImageNet: a 360° perspective on artificial intelligence
Ten years after ImageNet: a 360° perspective on artificial intelligence
It is 10 years since neural networks made their spectacular comeback. Prompted by this anniversary, we take a holistic perspective on artificial intelligence (AI). Supervised learning for cognitive tasks is effectively solved—provided we have enough high-quality labelled data. However, deep neural network models are not easily interpretable, and thus the debate between blackbox and whitebox modelling has come to the fore. The rise of attention networks, self-supervised learning, generative modelling and graph neural networks has widened the application space of AI. Deep learning has also propelled the return of reinforcement learning as a core building block of autonomous decision-making systems. The possible harms made possible by new AI technologies have raised socio-technical issues such as transparency, fairness and accountability. The dominance of AI by Big Tech who control talent, computing resources, and most importantly, data may lead to an extreme AI divide. Despite the recent dramatic and unexpected success in AI-driven conversational agents, progress in much-heralded flagship projects like self-driving vehicles remains elusive. Care must be taken to moderate the rhetoric surrounding the field and align engineering progress with scientific principles.
Artificial intelligence, Big Tech, ImageNet, supervised learning, transformers, winter, artificial intelligence winter
2054-5703
Chawla, Sanjay
75dcaaf8-580c-4db1-85c1-a567180f9a52
Nakov, Preslav
55717e4c-21b5-482d-a08a-d469780f9bbb
Ali, Ahmed
44fb6e18-101f-4fe2-963e-e3a26d041900
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c
Khalil, Issa
44512802-948f-4d8f-b3d6-037e171ba2dd
Ma, Xiaosong
07174276-0b33-4790-94bc-dc65d6033fec
Sencar, Husrev Taha
c26a3292-d4f9-45d6-b1e7-cef658d8ecec
Weber, Ingmar
b960f7d6-81ad-4aa3-a508-333f25842bee
Wooldridge, Michael
67c91c9a-a37d-480d-a915-609ab9a65e90
Yu, Ting
cbd90aa1-d595-4dc4-b95b-445338e5a3b8
Chawla, Sanjay
75dcaaf8-580c-4db1-85c1-a567180f9a52
Nakov, Preslav
55717e4c-21b5-482d-a08a-d469780f9bbb
Ali, Ahmed
44fb6e18-101f-4fe2-963e-e3a26d041900
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c
Khalil, Issa
44512802-948f-4d8f-b3d6-037e171ba2dd
Ma, Xiaosong
07174276-0b33-4790-94bc-dc65d6033fec
Sencar, Husrev Taha
c26a3292-d4f9-45d6-b1e7-cef658d8ecec
Weber, Ingmar
b960f7d6-81ad-4aa3-a508-333f25842bee
Wooldridge, Michael
67c91c9a-a37d-480d-a915-609ab9a65e90
Yu, Ting
cbd90aa1-d595-4dc4-b95b-445338e5a3b8

Chawla, Sanjay, Nakov, Preslav, Ali, Ahmed, Hall, Wendy, Khalil, Issa, Ma, Xiaosong, Sencar, Husrev Taha, Weber, Ingmar, Wooldridge, Michael and Yu, Ting (2023) Ten years after ImageNet: a 360° perspective on artificial intelligence. Royal Society Open Science, 10 (3), [221414]. (doi:10.1098/rsos.221414).

Record type: Article

Abstract

It is 10 years since neural networks made their spectacular comeback. Prompted by this anniversary, we take a holistic perspective on artificial intelligence (AI). Supervised learning for cognitive tasks is effectively solved—provided we have enough high-quality labelled data. However, deep neural network models are not easily interpretable, and thus the debate between blackbox and whitebox modelling has come to the fore. The rise of attention networks, self-supervised learning, generative modelling and graph neural networks has widened the application space of AI. Deep learning has also propelled the return of reinforcement learning as a core building block of autonomous decision-making systems. The possible harms made possible by new AI technologies have raised socio-technical issues such as transparency, fairness and accountability. The dominance of AI by Big Tech who control talent, computing resources, and most importantly, data may lead to an extreme AI divide. Despite the recent dramatic and unexpected success in AI-driven conversational agents, progress in much-heralded flagship projects like self-driving vehicles remains elusive. Care must be taken to moderate the rhetoric surrounding the field and align engineering progress with scientific principles.

Text
rsos.221414 - Version of Record
Available under License Creative Commons Attribution.
Download (1MB)

More information

Published date: 29 March 2023
Additional Information: Publisher Copyright: © 2023 The Authors.
Keywords: Artificial intelligence, Big Tech, ImageNet, supervised learning, transformers, winter, artificial intelligence winter

Identifiers

Local EPrints ID: 477716
URI: http://eprints.soton.ac.uk/id/eprint/477716
ISSN: 2054-5703
PURE UUID: 02fcf552-e5f3-45ad-99b5-43b90ef2d746
ORCID for Wendy Hall: ORCID iD orcid.org/0000-0003-4327-7811

Catalogue record

Date deposited: 13 Jun 2023 17:14
Last modified: 18 Mar 2024 02:31

Export record

Altmetrics

Contributors

Author: Sanjay Chawla
Author: Preslav Nakov
Author: Ahmed Ali
Author: Wendy Hall ORCID iD
Author: Issa Khalil
Author: Xiaosong Ma
Author: Husrev Taha Sencar
Author: Ingmar Weber
Author: Michael Wooldridge
Author: Ting Yu

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×