The University of Southampton
University of Southampton Institutional Repository

Non-acted text and keystrokes database and learning methods to recognize emotions

Non-acted text and keystrokes database and learning methods to recognize emotions
Non-acted text and keystrokes database and learning methods to recognize emotions
The modern computing applications are presently adapting to the convenient availability of huge and diverse data for making their pattern recognition methods smarter. Identification of dominant emotion solely based on the text data generated by the humans is essential for the modern human-computer interaction. This work presents a multimodal text-keystrokes dataset and associated learning methods for the identification of human emotions hidden in small text. For this, a text-keystrokes data of 69 participants is collected in multiple scenarios. Stimuli are induced through videos in a controlled environment. After the stimuli induction, participants write their reviews about the given scenario in an unguided manner. Afterward, keystroke and in-text features are extracted from the dataset. These are used with an assortment of learning methods to identify emotion hidden in the short text. An accuracy of 86.95% is achieved by fusing text and keystroke features. Whereas, 100% accuracy is obtained for pleasure-displeasure classes of emotions using the fusion of keystroke/text features, tree-based feature selection method, and support vector machine classifier. The present work is also compared with four state-of-the-art techniques for the same task, where the results suggest that the present proposal performs better in terms of accuracy.
1551-6857
1-24
Tahir, Madiha
9e351fce-fbac-41ca-920f-e4916f79d99b
Halim, Zahid
4c6555ce-bf70-48d1-9b0c-2172ba5f22d3
Rahman, Atta Ur
6bddc014-3e3b-4e3a-ba6e-ee129250c1cc
Waqas, Muhammad
b487e458-27ab-44dd-be5d-f785ba9e50fd
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Han, Zhu
28e29deb-d470-4165-b198-0923aeac3689
Tahir, Madiha
9e351fce-fbac-41ca-920f-e4916f79d99b
Halim, Zahid
4c6555ce-bf70-48d1-9b0c-2172ba5f22d3
Rahman, Atta Ur
6bddc014-3e3b-4e3a-ba6e-ee129250c1cc
Waqas, Muhammad
b487e458-27ab-44dd-be5d-f785ba9e50fd
Tu, Shanshan
ef946f84-9863-4438-a847-0171915b0651
Chen, Sheng
9310a111-f79a-48b8-98c7-383ca93cbb80
Han, Zhu
28e29deb-d470-4165-b198-0923aeac3689

Tahir, Madiha, Halim, Zahid, Rahman, Atta Ur, Waqas, Muhammad, Tu, Shanshan, Chen, Sheng and Han, Zhu (2022) Non-acted text and keystrokes database and learning methods to recognize emotions. ACM Transactions on Multimedia Computing, Communications, and Applications, 18 (2), 1-24.

Record type: Article

Abstract

The modern computing applications are presently adapting to the convenient availability of huge and diverse data for making their pattern recognition methods smarter. Identification of dominant emotion solely based on the text data generated by the humans is essential for the modern human-computer interaction. This work presents a multimodal text-keystrokes dataset and associated learning methods for the identification of human emotions hidden in small text. For this, a text-keystrokes data of 69 participants is collected in multiple scenarios. Stimuli are induced through videos in a controlled environment. After the stimuli induction, participants write their reviews about the given scenario in an unguided manner. Afterward, keystroke and in-text features are extracted from the dataset. These are used with an assortment of learning methods to identify emotion hidden in the short text. An accuracy of 86.95% is achieved by fusing text and keystroke features. Whereas, 100% accuracy is obtained for pleasure-displeasure classes of emotions using the fusion of keystroke/text features, tree-based feature selection method, and support vector machine classifier. The present work is also compared with four state-of-the-art techniques for the same task, where the results suggest that the present proposal performs better in terms of accuracy.

Text
TOMM2022-May - Author's Original
Restricted to Repository staff only
Request a copy
Text
4. MTP 1.14-ACM-R1.3-Final file - Accepted Manuscript
Download (1MB)

More information

Accepted/In Press date: 10 August 2021
Published date: 17 February 2022

Identifiers

Local EPrints ID: 451318
URI: http://eprints.soton.ac.uk/id/eprint/451318
ISSN: 1551-6857
PURE UUID: 681079f1-747f-4f78-a69f-e28637fd3b9c

Catalogue record

Date deposited: 21 Sep 2021 16:30
Last modified: 16 Mar 2024 13:53

Export record

Contributors

Author: Madiha Tahir
Author: Zahid Halim
Author: Atta Ur Rahman
Author: Muhammad Waqas
Author: Shanshan Tu
Author: Sheng Chen
Author: Zhu Han

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×