The University of Southampton
University of Southampton Institutional Repository

Smart speaker privacy control - acoustic tagging for personal voice assistants

Smart speaker privacy control - acoustic tagging for personal voice assistants
Smart speaker privacy control - acoustic tagging for personal voice assistants

Personal Voice Assistants (PVAs) such as the Siri, Amazon Echo and Google Home are now commonplace. PVAs continuously monitor conversations which may be transported to a cloud back end where they are stored, processed and maybe even passed on to other service providers. A user has little control over this process. She is unable to control the recording behaviour of surrounding PVAs, unable to signal her privacy requirements to back-end systems and unable to track conversation recordings. In this paper we explore techniques for embedding additional information into acoustic signals processed by PVAs. A user employs a tagging device which emits an acoustic signal when PVA activity is assumed. Any active PVA will embed this tag into their recorded audio stream. The tag may signal a cooperating PVA or back-end system that a user has not given a recording consent. The tag may also be used to trace when and where a recording was taken. We discuss different tagging techniques and application scenarios, and we describe the implementation of a prototype tagging device based on PocketSphinx. Using the popular PVA Google Home Mini we demonstrate that the device can tag conversations and that the tagging signal can be retrieved from conversations stored in the Google back-end system.

Acoustic Privacy, IoT Security and Privacy, Personal Voice Assistants, Signal Tagging, Smart Speakers, Virtual Assistants, Voice Controllable Systems, Wake Word Detection
144-149
IEEE
Cheng, Peng
1e49aef0-36ef-4cda-af2a-9753881419c9
Bagci, Ibrahim Ethem
e1bbc020-49d6-4201-b40b-b80a049b4c11
Yan, Jeff
a2c03187-3722-46c8-b73b-439eb9d1a10e
Roedig, Utz
83d5bb9d-0321-4e84-9dde-db7dc5f8c82b
Cheng, Peng
1e49aef0-36ef-4cda-af2a-9753881419c9
Bagci, Ibrahim Ethem
e1bbc020-49d6-4201-b40b-b80a049b4c11
Yan, Jeff
a2c03187-3722-46c8-b73b-439eb9d1a10e
Roedig, Utz
83d5bb9d-0321-4e84-9dde-db7dc5f8c82b

Cheng, Peng, Bagci, Ibrahim Ethem, Yan, Jeff and Roedig, Utz (2019) Smart speaker privacy control - acoustic tagging for personal voice assistants. In Proceedings - 2019 IEEE Symposium on Security and Privacy Workshops, SPW 2019. IEEE. pp. 144-149 . (doi:10.1109/SPW.2019.00035).

Record type: Conference or Workshop Item (Paper)

Abstract

Personal Voice Assistants (PVAs) such as the Siri, Amazon Echo and Google Home are now commonplace. PVAs continuously monitor conversations which may be transported to a cloud back end where they are stored, processed and maybe even passed on to other service providers. A user has little control over this process. She is unable to control the recording behaviour of surrounding PVAs, unable to signal her privacy requirements to back-end systems and unable to track conversation recordings. In this paper we explore techniques for embedding additional information into acoustic signals processed by PVAs. A user employs a tagging device which emits an acoustic signal when PVA activity is assumed. Any active PVA will embed this tag into their recorded audio stream. The tag may signal a cooperating PVA or back-end system that a user has not given a recording consent. The tag may also be used to trace when and where a recording was taken. We discuss different tagging techniques and application scenarios, and we describe the implementation of a prototype tagging device based on PocketSphinx. Using the popular PVA Google Home Mini we demonstrate that the device can tag conversations and that the tagging signal can be retrieved from conversations stored in the Google back-end system.

This record has no associated files available for download.

More information

Published date: May 2019
Additional Information: Publisher Copyright: © 2019 IEEE.
Venue - Dates: 2019 IEEE Symposium on Security and Privacy Workshops, SPW 2019, , San Francisco, United States, 2019-05-23
Keywords: Acoustic Privacy, IoT Security and Privacy, Personal Voice Assistants, Signal Tagging, Smart Speakers, Virtual Assistants, Voice Controllable Systems, Wake Word Detection

Identifiers

Local EPrints ID: 500869
URI: http://eprints.soton.ac.uk/id/eprint/500869
PURE UUID: 9a42d4b7-de05-4e69-824f-5d115522eb55

Catalogue record

Date deposited: 14 May 2025 16:51
Last modified: 14 May 2025 16:51

Export record

Altmetrics

Contributors

Author: Peng Cheng
Author: Ibrahim Ethem Bagci
Author: Jeff Yan
Author: Utz Roedig

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×