The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot
The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot
This paper describes a model of the multimodal speech and visual gesture (mSVG) control for aerobots operating at higher nCA autonomy levels, within the context of a patrol, search, and rescue application. The developed mSVG control architecture, its mathematical navigation model, and some high level command operation models were discussed. This was successfully tested using both MATLAB simulation and python based ROS Gazebo UAV simulations. Some limitations were identified, which formed the basis for the further works presented.
mSVG (multimodal speech and visual gesture), Aerobot (Aerial Robot), HCI (Human Computer Interaction), visual gesture, Speech, MCPU (Multimodal Control Processing Unit), nCA (Navigational Control Autonomy), SBC (Single Board Computer)
423-437
Abioye, Ayodeji, Opeyemi
dbab5a92-c958-442f-b102-8ca2e4cf874f
Prior, Stephen
9c753e49-092a-4dc5-b4cd-6d5ff77e9ced
Thomas, Trevor
bccfa8da-6c8b-4eec-b593-00587d3ce3cc
Saddington, Peter
76491369-712f-4da2-b3eb-e11751d19989
Ramchurn, Sarvapali
1d62ae2a-a498-444e-912d-a6082d3aaea3
Abioye, Ayodeji, Opeyemi
dbab5a92-c958-442f-b102-8ca2e4cf874f
Prior, Stephen
9c753e49-092a-4dc5-b4cd-6d5ff77e9ced
Thomas, Trevor
bccfa8da-6c8b-4eec-b593-00587d3ce3cc
Saddington, Peter
76491369-712f-4da2-b3eb-e11751d19989
Ramchurn, Sarvapali
1d62ae2a-a498-444e-912d-a6082d3aaea3
Abioye, Ayodeji, Opeyemi, Prior, Stephen, Thomas, Trevor, Saddington, Peter and Ramchurn, Sarvapali
(2018)
The multimodal speech and visual gesture (mSVG) control model for a practical patrol, search, and rescue aerobot.
In 19th Towards Autonomous Robotic Systems (TAROS) Conference 2018.
vol. 10965,
Springer.
.
(doi:10.1007/978-3-319-96728-8_36).
Record type:
Conference or Workshop Item
(Paper)
Abstract
This paper describes a model of the multimodal speech and visual gesture (mSVG) control for aerobots operating at higher nCA autonomy levels, within the context of a patrol, search, and rescue application. The developed mSVG control architecture, its mathematical navigation model, and some high level command operation models were discussed. This was successfully tested using both MATLAB simulation and python based ROS Gazebo UAV simulations. Some limitations were identified, which formed the basis for the further works presented.
Text
taros_paper_draft10
- Author's Original
Restricted to Repository staff only
Request a copy
Text
taros_paper_draft12
- Accepted Manuscript
Text
Abioye2018_Chapter_TheMultimodalSpeechAndVisualGe
- Version of Record
Restricted to Repository staff only
Request a copy
More information
Submitted date: 14 February 2018
Accepted/In Press date: 12 April 2018
e-pub ahead of print date: 21 July 2018
Keywords:
mSVG (multimodal speech and visual gesture), Aerobot (Aerial Robot), HCI (Human Computer Interaction), visual gesture, Speech, MCPU (Multimodal Control Processing Unit), nCA (Navigational Control Autonomy), SBC (Single Board Computer)
Identifiers
Local EPrints ID: 418869
URI: http://eprints.soton.ac.uk/id/eprint/418869
PURE UUID: 7f742ea6-b3f4-44f1-8349-1890f2271d72
Catalogue record
Date deposited: 23 Mar 2018 17:30
Last modified: 09 Aug 2024 04:05
Export record
Altmetrics
Contributors
Author:
Trevor Thomas
Author:
Peter Saddington
Author:
Sarvapali Ramchurn
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics