Ten years after ImageNet: a 360° perspective on artificial intelligence
Ten years after ImageNet: a 360° perspective on artificial intelligence
It is 10 years since neural networks made their spectacular comeback. Prompted by this anniversary, we take a holistic perspective on artificial intelligence (AI). Supervised learning for cognitive tasks is effectively solved—provided we have enough high-quality labelled data. However, deep neural network models are not easily interpretable, and thus the debate between blackbox and whitebox modelling has come to the fore. The rise of attention networks, self-supervised learning, generative modelling and graph neural networks has widened the application space of AI. Deep learning has also propelled the return of reinforcement learning as a core building block of autonomous decision-making systems. The possible harms made possible by new AI technologies have raised socio-technical issues such as transparency, fairness and accountability. The dominance of AI by Big Tech who control talent, computing resources, and most importantly, data may lead to an extreme AI divide. Despite the recent dramatic and unexpected success in AI-driven conversational agents, progress in much-heralded flagship projects like self-driving vehicles remains elusive. Care must be taken to moderate the rhetoric surrounding the field and align engineering progress with scientific principles.
Artificial intelligence, Big Tech, ImageNet, supervised learning, transformers, winter, artificial intelligence winter
Chawla, Sanjay
75dcaaf8-580c-4db1-85c1-a567180f9a52
Nakov, Preslav
55717e4c-21b5-482d-a08a-d469780f9bbb
Ali, Ahmed
44fb6e18-101f-4fe2-963e-e3a26d041900
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c
Khalil, Issa
44512802-948f-4d8f-b3d6-037e171ba2dd
Ma, Xiaosong
07174276-0b33-4790-94bc-dc65d6033fec
Sencar, Husrev Taha
c26a3292-d4f9-45d6-b1e7-cef658d8ecec
Weber, Ingmar
b960f7d6-81ad-4aa3-a508-333f25842bee
Wooldridge, Michael
67c91c9a-a37d-480d-a915-609ab9a65e90
Yu, Ting
cbd90aa1-d595-4dc4-b95b-445338e5a3b8
29 March 2023
Chawla, Sanjay
75dcaaf8-580c-4db1-85c1-a567180f9a52
Nakov, Preslav
55717e4c-21b5-482d-a08a-d469780f9bbb
Ali, Ahmed
44fb6e18-101f-4fe2-963e-e3a26d041900
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c
Khalil, Issa
44512802-948f-4d8f-b3d6-037e171ba2dd
Ma, Xiaosong
07174276-0b33-4790-94bc-dc65d6033fec
Sencar, Husrev Taha
c26a3292-d4f9-45d6-b1e7-cef658d8ecec
Weber, Ingmar
b960f7d6-81ad-4aa3-a508-333f25842bee
Wooldridge, Michael
67c91c9a-a37d-480d-a915-609ab9a65e90
Yu, Ting
cbd90aa1-d595-4dc4-b95b-445338e5a3b8
Chawla, Sanjay, Nakov, Preslav, Ali, Ahmed, Hall, Wendy, Khalil, Issa, Ma, Xiaosong, Sencar, Husrev Taha, Weber, Ingmar, Wooldridge, Michael and Yu, Ting
(2023)
Ten years after ImageNet: a 360° perspective on artificial intelligence.
Royal Society Open Science, 10 (3), [221414].
(doi:10.1098/rsos.221414).
Abstract
It is 10 years since neural networks made their spectacular comeback. Prompted by this anniversary, we take a holistic perspective on artificial intelligence (AI). Supervised learning for cognitive tasks is effectively solved—provided we have enough high-quality labelled data. However, deep neural network models are not easily interpretable, and thus the debate between blackbox and whitebox modelling has come to the fore. The rise of attention networks, self-supervised learning, generative modelling and graph neural networks has widened the application space of AI. Deep learning has also propelled the return of reinforcement learning as a core building block of autonomous decision-making systems. The possible harms made possible by new AI technologies have raised socio-technical issues such as transparency, fairness and accountability. The dominance of AI by Big Tech who control talent, computing resources, and most importantly, data may lead to an extreme AI divide. Despite the recent dramatic and unexpected success in AI-driven conversational agents, progress in much-heralded flagship projects like self-driving vehicles remains elusive. Care must be taken to moderate the rhetoric surrounding the field and align engineering progress with scientific principles.
Text
rsos.221414
- Version of Record
More information
Published date: 29 March 2023
Additional Information:
Publisher Copyright:
© 2023 The Authors.
Keywords:
Artificial intelligence, Big Tech, ImageNet, supervised learning, transformers, winter, artificial intelligence winter
Identifiers
Local EPrints ID: 477716
URI: http://eprints.soton.ac.uk/id/eprint/477716
ISSN: 2054-5703
PURE UUID: 02fcf552-e5f3-45ad-99b5-43b90ef2d746
Catalogue record
Date deposited: 13 Jun 2023 17:14
Last modified: 18 Mar 2024 02:31
Export record
Altmetrics
Contributors
Author:
Sanjay Chawla
Author:
Preslav Nakov
Author:
Ahmed Ali
Author:
Issa Khalil
Author:
Xiaosong Ma
Author:
Husrev Taha Sencar
Author:
Ingmar Weber
Author:
Michael Wooldridge
Author:
Ting Yu
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics