Enhancing spatial hearing in cochlear implant users using vibrations on the wrists
Enhancing spatial hearing in cochlear implant users using vibrations on the wrists
Aim: Many cochlear implant (CI) users struggle to locate and separate sounds that come from different locations, particularly the majority of CI users in the UK who are implanted in only one ear [1]. Recently, it has been shown that speech-in-noise performance in CI users can be improved by augmenting the electrical signal from the implant with a haptic signal that provides missing sound information (“electro-haptic stimulation” [2]). We aim to test whether haptic stimulation on the wrists can be used to improve spatial hearing in CI users.
Method: We measured localization ability in 12 unilaterally implanted CI users, either only with audio, or with combined audio and haptic stimulation. All conditions were measured before and after a short training regime (lasting around 50 minutes). We derived our haptic signal from the audio that would be received by CI or hearing aid microphones behind each ear. The signal from each ear was then remapped to a frequency range where the skin is most sensitive to vibration and delivered to each wrist. This meant that the intensity difference between the wrists corresponded to the intensity difference between the ears, which is a key spatial hearing cue.
Results: We found that auditory localisation accuracy improved substantially when audio and haptic stimulation were provided together (electro-haptic stimulation). After a short training regime, participants’ average RMS error with electro-haptic stimulation was reduced to just 22.7°, which is comparable to the performance of bilateral hearing aid users (~19°) [3,5]. Even with no training, adding haptic stimulation reduced the RMS error from 47.2° to 29.3° on average. This performance is similar to the average performance achieved by CI users with implants in both ears (~27°) [3,4], or users with a CI in one ear and healthy hearing in the other (~28°) [3].
Conclusions: Our approach was designed to be easily transferable to a real-world application. The haptic signal was processed using a computationally lightweight algorithm that could be applied in real-time and was delivered at a vibration intensity that could readily be achieved by a low-cost wearable device. This could have an important clinical impact, providing an inexpensive, non-invasive means to dramatically improve spatial hearing in CI users.
Fletcher, Mark
ac11588a-fafe-4dbb-8b3c-80a6ff030546
Cunningham, Robyn
a3adff43-40a0-4152-9488-66b92a602a88
Zgheib, Jana
3bdf6c36-e556-42b7-a329-a7532b1c727d
Verschuur, Carl
b24f8f26-2725-4a13-96ad-e50bfea42748
Perry, Samuel W
20d3988a-66fd-427c-b732-d686a67f4a8f
11 March 2020
Fletcher, Mark
ac11588a-fafe-4dbb-8b3c-80a6ff030546
Cunningham, Robyn
a3adff43-40a0-4152-9488-66b92a602a88
Zgheib, Jana
3bdf6c36-e556-42b7-a329-a7532b1c727d
Verschuur, Carl
b24f8f26-2725-4a13-96ad-e50bfea42748
Perry, Samuel W
20d3988a-66fd-427c-b732-d686a67f4a8f
Fletcher, Mark, Cunningham, Robyn, Zgheib, Jana, Verschuur, Carl and Perry, Samuel W
(2020)
Enhancing spatial hearing in cochlear implant users using vibrations on the wrists.
In British Cochlear Implant Group Meeting 2020: Improving Hearing Healthcare in the 21st Century.
Record type:
Conference or Workshop Item
(Paper)
Abstract
Aim: Many cochlear implant (CI) users struggle to locate and separate sounds that come from different locations, particularly the majority of CI users in the UK who are implanted in only one ear [1]. Recently, it has been shown that speech-in-noise performance in CI users can be improved by augmenting the electrical signal from the implant with a haptic signal that provides missing sound information (“electro-haptic stimulation” [2]). We aim to test whether haptic stimulation on the wrists can be used to improve spatial hearing in CI users.
Method: We measured localization ability in 12 unilaterally implanted CI users, either only with audio, or with combined audio and haptic stimulation. All conditions were measured before and after a short training regime (lasting around 50 minutes). We derived our haptic signal from the audio that would be received by CI or hearing aid microphones behind each ear. The signal from each ear was then remapped to a frequency range where the skin is most sensitive to vibration and delivered to each wrist. This meant that the intensity difference between the wrists corresponded to the intensity difference between the ears, which is a key spatial hearing cue.
Results: We found that auditory localisation accuracy improved substantially when audio and haptic stimulation were provided together (electro-haptic stimulation). After a short training regime, participants’ average RMS error with electro-haptic stimulation was reduced to just 22.7°, which is comparable to the performance of bilateral hearing aid users (~19°) [3,5]. Even with no training, adding haptic stimulation reduced the RMS error from 47.2° to 29.3° on average. This performance is similar to the average performance achieved by CI users with implants in both ears (~27°) [3,4], or users with a CI in one ear and healthy hearing in the other (~28°) [3].
Conclusions: Our approach was designed to be easily transferable to a real-world application. The haptic signal was processed using a computationally lightweight algorithm that could be applied in real-time and was delivered at a vibration intensity that could readily be achieved by a low-cost wearable device. This could have an important clinical impact, providing an inexpensive, non-invasive means to dramatically improve spatial hearing in CI users.
This record has no associated files available for download.
More information
Published date: 11 March 2020
Additional Information:
References
[1] Peters, B. R. et al. Worldwide trends in bilateral cochlear implantation. The Laryngoscope 120, 17–44 (2010).
[2] Fletcher, M. D. et al. Electro-haptic hearing: Speech-in-noise performance in cochlear implant users is enhanced by tactile stimulation of the wrists. Nat. Sci. Reps. 9, 11428 (2019).
[3] Dorman, M. F. et al. Sound Source Localization by Normal-Hearing Listeners, Hearing-Impaired Listeners and Cochlear Implant Listeners. Audiol Neurootol. 21, 127–131 (2016).
[4] Aronoff, J. M. et al. The use of interaural time and level difference cues by bilateral cochlear implant users. J Acoust Soc Am 127, 87–92 (2010).
[5] Dunn, C. C. et al. Benefits of Localization and Speech Perception with Multiple Noise Sources in Listeners with a Short-Electrode Cochlear Implant. J Am Acad Audiol. 21, 44-51 (2010).
Venue - Dates:
British Cochlear Implant Group Meeting 2020<br/>: Improving Hearing Healthcare in the 21st Century, De Vere East Midlands Conference Centre, Nottingham, United Kingdom, 2020-03-10 - 2020-03-11
Identifiers
Local EPrints ID: 438840
URI: http://eprints.soton.ac.uk/id/eprint/438840
PURE UUID: 8b18dea7-fe26-4431-bf35-356106ea01b8
Catalogue record
Date deposited: 25 Mar 2020 17:31
Last modified: 12 Dec 2021 09:03
Export record
Contributors
Author:
Robyn Cunningham
Author:
Jana Zgheib
Author:
Carl Verschuur
Author:
Samuel W Perry
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics