The University of Southampton
University of Southampton Institutional Repository

The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot

The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot
The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot
This paper describes a model of the multimodal speech and visual gesture (mSVG) control for aerobots operating at higher nCA autonomy levels, within the context of a patrol, search, and rescue application. The developed mSVG control architecture, its mathematical navigation model, and some high level command operation models were discussed. This was successfully tested using both MATLAB simulation and python based ROS Gazebo UAV simulations. Some limitations were identified, which formed the basis for the further works presented.
mSVG (multimodal speech and visual gesture), Aerobot (Aerial Robot), HCI (Human Computer Interaction), visual gesture, Speech, MCPU (Multimodal Control Processing Unit), nCA (Navigational Control Autonomy), SBC (Single Board Computer)
423-437
Springer
Abioye, Ayodeji, Opeyemi
dbab5a92-c958-442f-b102-8ca2e4cf874f
Prior, Stephen
9c753e49-092a-4dc5-b4cd-6d5ff77e9ced
Thomas, Trevor
bccfa8da-6c8b-4eec-b593-00587d3ce3cc
Saddington, Peter
76491369-712f-4da2-b3eb-e11751d19989
Ramchurn, Sarvapali
1d62ae2a-a498-444e-912d-a6082d3aaea3
Abioye, Ayodeji, Opeyemi
dbab5a92-c958-442f-b102-8ca2e4cf874f
Prior, Stephen
9c753e49-092a-4dc5-b4cd-6d5ff77e9ced
Thomas, Trevor
bccfa8da-6c8b-4eec-b593-00587d3ce3cc
Saddington, Peter
76491369-712f-4da2-b3eb-e11751d19989
Ramchurn, Sarvapali
1d62ae2a-a498-444e-912d-a6082d3aaea3

Abioye, Ayodeji, Opeyemi, Prior, Stephen, Thomas, Trevor, Saddington, Peter and Ramchurn, Sarvapali (2018) The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot. In 19th Towards Autonomous Robotic Systems (TAROS) Conference 2018. vol. 10965, Springer. pp. 423-437 . (doi:10.1007/978-3-319-96728-8_36).

Record type: Conference or Workshop Item (Paper)

Abstract

This paper describes a model of the multimodal speech and visual gesture (mSVG) control for aerobots operating at higher nCA autonomy levels, within the context of a patrol, search, and rescue application. The developed mSVG control architecture, its mathematical navigation model, and some high level command operation models were discussed. This was successfully tested using both MATLAB simulation and python based ROS Gazebo UAV simulations. Some limitations were identified, which formed the basis for the further works presented.

Text
taros_paper_draft10 - Author's Original
Restricted to Repository staff only
Request a copy
Text
taros_paper_draft12 - Accepted Manuscript
Download (2MB)
Text
Abioye2018_Chapter_TheMultimodalSpeechAndVisualGe - Version of Record
Restricted to Repository staff only
Request a copy

More information

Submitted date: 14 February 2018
Accepted/In Press date: 12 April 2018
e-pub ahead of print date: 21 July 2018
Keywords: mSVG (multimodal speech and visual gesture), Aerobot (Aerial Robot), HCI (Human Computer Interaction), visual gesture, Speech, MCPU (Multimodal Control Processing Unit), nCA (Navigational Control Autonomy), SBC (Single Board Computer)

Identifiers

Local EPrints ID: 418869
URI: http://eprints.soton.ac.uk/id/eprint/418869
PURE UUID: 7f742ea6-b3f4-44f1-8349-1890f2271d72
ORCID for Ayodeji, Opeyemi Abioye: ORCID iD orcid.org/0000-0003-4637-3278
ORCID for Stephen Prior: ORCID iD orcid.org/0000-0002-4993-4942
ORCID for Sarvapali Ramchurn: ORCID iD orcid.org/0000-0001-9686-4302

Catalogue record

Date deposited: 23 Mar 2018 17:30
Last modified: 23 Mar 2024 05:04

Export record

Altmetrics

Contributors

Author: Stephen Prior ORCID iD
Author: Trevor Thomas
Author: Peter Saddington
Author: Sarvapali Ramchurn ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×