A user study evaluation of predictive formal modelling at runtime in human-swarm interaction

Abstract

Formal modelling is often used as part of the design and testing process of software development to ensure that components operate within suitable bounds even in unexpected circumstances. We conducted a user study evaluation of predictive formal modelling (PFM) at runtime in a human-swarm mission to determine the benefit of predictive formal modelling on performance and human-swarm interaction. 180 participants were recruited to perform the role of aerial swarm operators delivering parcels to target locations in a simulation environment. The PFM model was integrated into the simulation software to inform the operator of the estimated mission completion time given the current number of drones deployed. The operator could increase the number of parcels delivered in any time step by adding drones, which also increased costs, thus requiring the use of the minimum number of drones necessary to complete the task in the given time. We collected user feedback using standard survey questionnaires and measured performance using data obtained from the Human And Robot Interactive Swarm (HARIS) simulator. Our results show that PFM increased the performance of the human swarm team without significantly increasing the operators’ workload or affecting the system's usability.

More information

Identifiers

ORCID for Ayodeji O. Abioye: orcid.org/0000-0003-4637-3278

ORCID for Eike Schneiders: orcid.org/0000-0002-8372-1684

ORCID for Mohammad Naiseh: orcid.org/0000-0002-4927-5086

ORCID for Sarvapali D. Ramchurn: orcid.org/0000-0001-9686-4302

ORCID for Mohammad D. Soorati: orcid.org/0000-0001-6954-1284

Catalogue record

Export record

Altmetrics