Smart speaker privacy control - acoustic tagging for personal voice assistants
Smart speaker privacy control - acoustic tagging for personal voice assistants
Personal Voice Assistants (PVAs) such as the Siri, Amazon Echo and Google Home are now commonplace. PVAs continuously monitor conversations which may be transported to a cloud back end where they are stored, processed and maybe even passed on to other service providers. A user has little control over this process. She is unable to control the recording behaviour of surrounding PVAs, unable to signal her privacy requirements to back-end systems and unable to track conversation recordings. In this paper we explore techniques for embedding additional information into acoustic signals processed by PVAs. A user employs a tagging device which emits an acoustic signal when PVA activity is assumed. Any active PVA will embed this tag into their recorded audio stream. The tag may signal a cooperating PVA or back-end system that a user has not given a recording consent. The tag may also be used to trace when and where a recording was taken. We discuss different tagging techniques and application scenarios, and we describe the implementation of a prototype tagging device based on PocketSphinx. Using the popular PVA Google Home Mini we demonstrate that the device can tag conversations and that the tagging signal can be retrieved from conversations stored in the Google back-end system.
Acoustic Privacy, IoT Security and Privacy, Personal Voice Assistants, Signal Tagging, Smart Speakers, Virtual Assistants, Voice Controllable Systems, Wake Word Detection
144-149
Cheng, Peng
1e49aef0-36ef-4cda-af2a-9753881419c9
Bagci, Ibrahim Ethem
e1bbc020-49d6-4201-b40b-b80a049b4c11
Yan, Jeff
a2c03187-3722-46c8-b73b-439eb9d1a10e
Roedig, Utz
83d5bb9d-0321-4e84-9dde-db7dc5f8c82b
May 2019
Cheng, Peng
1e49aef0-36ef-4cda-af2a-9753881419c9
Bagci, Ibrahim Ethem
e1bbc020-49d6-4201-b40b-b80a049b4c11
Yan, Jeff
a2c03187-3722-46c8-b73b-439eb9d1a10e
Roedig, Utz
83d5bb9d-0321-4e84-9dde-db7dc5f8c82b
Cheng, Peng, Bagci, Ibrahim Ethem, Yan, Jeff and Roedig, Utz
(2019)
Smart speaker privacy control - acoustic tagging for personal voice assistants.
In Proceedings - 2019 IEEE Symposium on Security and Privacy Workshops, SPW 2019.
IEEE.
.
(doi:10.1109/SPW.2019.00035).
Record type:
Conference or Workshop Item
(Paper)
Abstract
Personal Voice Assistants (PVAs) such as the Siri, Amazon Echo and Google Home are now commonplace. PVAs continuously monitor conversations which may be transported to a cloud back end where they are stored, processed and maybe even passed on to other service providers. A user has little control over this process. She is unable to control the recording behaviour of surrounding PVAs, unable to signal her privacy requirements to back-end systems and unable to track conversation recordings. In this paper we explore techniques for embedding additional information into acoustic signals processed by PVAs. A user employs a tagging device which emits an acoustic signal when PVA activity is assumed. Any active PVA will embed this tag into their recorded audio stream. The tag may signal a cooperating PVA or back-end system that a user has not given a recording consent. The tag may also be used to trace when and where a recording was taken. We discuss different tagging techniques and application scenarios, and we describe the implementation of a prototype tagging device based on PocketSphinx. Using the popular PVA Google Home Mini we demonstrate that the device can tag conversations and that the tagging signal can be retrieved from conversations stored in the Google back-end system.
This record has no associated files available for download.
More information
Published date: May 2019
Additional Information:
Publisher Copyright:
© 2019 IEEE.
Venue - Dates:
2019 IEEE Symposium on Security and Privacy Workshops, SPW 2019, , San Francisco, United States, 2019-05-23
Keywords:
Acoustic Privacy, IoT Security and Privacy, Personal Voice Assistants, Signal Tagging, Smart Speakers, Virtual Assistants, Voice Controllable Systems, Wake Word Detection
Identifiers
Local EPrints ID: 500869
URI: http://eprints.soton.ac.uk/id/eprint/500869
PURE UUID: 9a42d4b7-de05-4e69-824f-5d115522eb55
Catalogue record
Date deposited: 14 May 2025 16:51
Last modified: 14 May 2025 16:51
Export record
Altmetrics
Contributors
Author:
Peng Cheng
Author:
Ibrahim Ethem Bagci
Author:
Jeff Yan
Author:
Utz Roedig
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics