The University of Southampton
University of Southampton Institutional Repository

DejaView: Help with memory, when you need it

DejaView: Help with memory, when you need it
DejaView: Help with memory, when you need it
Promising findings in the use of wearable memory aids such as SenseCam have been widely reported. However, to date, there has been relatively little consideration of the potential for offering memory help in real-time during daily living. Such assistance, in the form of proactive visual prompts comprising the four reported types of cue (people, places, objects, and actions), could help people with memory problems to immediately orientate themselves in a situation -- supplying details of where they are, or who they are with. This paper reports on the three-tier DejaView system, designed to provide such help.

DejaView works across a wearable device, a smartphone, and a remote computer, simultaneously recording a lifelog, finding appropriate cues from past experiences, and feeding relevant information back to the user. The real-time nature of this system required the design of a new wearable device, similar to SenseCam but more customisable and additionally capable of transmitting data over Bluetooth. Fitting this into the three-tier architecture allows for complex processing in the system without limiting the battery lifetime of the portable and wearable parts.

In the currently-implemented example, photos captured by the wearable device are compared against a database of faces stored on the remote computer. The user subsequently receives information about people around them via their smartphone. More generally, the architecture permits a wide range of intelligent methods for selecting useful cues, based on the user's environment, to be integrated into the system, facilitating the provision of real-time help for memory problems.
Wood, Alex L.
0e658cee-1b98-45d7-b77f-b91470c764d8
Merrett, Geoff V.
89b3a696-41de-44c3-89aa-b0aa29f54020
de Jager, Dirk
b8ffaecd-3398-4220-9f8a-df0634a4d9a7
Al-Hashimi, Bashir M.
0b29c671-a6d2-459c-af68-c4614dce3b5d
O'Hara, Kieron
0a64a4b1-efb5-45d1-a4c2-77783f18f0c4
Shadbolt, Nigel R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c
Wood, Alex L.
0e658cee-1b98-45d7-b77f-b91470c764d8
Merrett, Geoff V.
89b3a696-41de-44c3-89aa-b0aa29f54020
de Jager, Dirk
b8ffaecd-3398-4220-9f8a-df0634a4d9a7
Al-Hashimi, Bashir M.
0b29c671-a6d2-459c-af68-c4614dce3b5d
O'Hara, Kieron
0a64a4b1-efb5-45d1-a4c2-77783f18f0c4
Shadbolt, Nigel R.
5c5acdf4-ad42-49b6-81fe-e9db58c2caf7
Hall, Wendy
11f7f8db-854c-4481-b1ae-721a51d8790c

Wood, Alex L., Merrett, Geoff V., de Jager, Dirk, Al-Hashimi, Bashir M., O'Hara, Kieron, Shadbolt, Nigel R. and Hall, Wendy (2012) DejaView: Help with memory, when you need it. SenseCam 2012: Third Annual Symposium, Oxford, United Kingdom. 03 - 04 Apr 2012. 20 pp .

Record type: Conference or Workshop Item (Other)

Abstract

Promising findings in the use of wearable memory aids such as SenseCam have been widely reported. However, to date, there has been relatively little consideration of the potential for offering memory help in real-time during daily living. Such assistance, in the form of proactive visual prompts comprising the four reported types of cue (people, places, objects, and actions), could help people with memory problems to immediately orientate themselves in a situation -- supplying details of where they are, or who they are with. This paper reports on the three-tier DejaView system, designed to provide such help.

DejaView works across a wearable device, a smartphone, and a remote computer, simultaneously recording a lifelog, finding appropriate cues from past experiences, and feeding relevant information back to the user. The real-time nature of this system required the design of a new wearable device, similar to SenseCam but more customisable and additionally capable of transmitting data over Bluetooth. Fitting this into the three-tier architecture allows for complex processing in the system without limiting the battery lifetime of the portable and wearable parts.

In the currently-implemented example, photos captured by the wearable device are compared against a database of faces stored on the remote computer. The user subsequently receives information about people around them via their smartphone. More generally, the architecture permits a wide range of intelligent methods for selecting useful cues, based on the user's environment, to be integrated into the system, facilitating the provision of real-time help for memory problems.

Text
SenseCam2012.pdf - Other
Download (1MB)

More information

Published date: 3 April 2012
Additional Information: This work received the 'Best Oral Presentation' award at the symposium.
Venue - Dates: SenseCam 2012: Third Annual Symposium, Oxford, United Kingdom, 2012-04-03 - 2012-04-04
Organisations: Web & Internet Science, Electronic & Software Systems

Identifiers

Local EPrints ID: 336931
URI: http://eprints.soton.ac.uk/id/eprint/336931
PURE UUID: c959dda0-bf9d-4dd9-b854-9ccae7c21bec
ORCID for Geoff V. Merrett: ORCID iD orcid.org/0000-0003-4980-3894
ORCID for Kieron O'Hara: ORCID iD orcid.org/0000-0002-9051-4456
ORCID for Wendy Hall: ORCID iD orcid.org/0000-0003-4327-7811

Catalogue record

Date deposited: 11 Apr 2012 10:12
Last modified: 15 Mar 2024 03:23

Export record

Contributors

Author: Alex L. Wood
Author: Geoff V. Merrett ORCID iD
Author: Dirk de Jager
Author: Bashir M. Al-Hashimi
Author: Kieron O'Hara ORCID iD
Author: Nigel R. Shadbolt
Author: Wendy Hall ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×