Developing and evaluating a novel gamified virtual learning environment for ASL

Wang, Jindi, Ivrissimtzis, Ioannis, Li, Zhaoxing, Zhou, Yunzhan and Shi, Lei (2023) Developing and evaluating a novel gamified virtual learning environment for ASL. Nocera, José Abdelnour, Lárusdóttir, Marta Kristín, Petrie, Helen, Piccinno, Antonio and Winckler, Marco (eds.) In Human-Computer Interaction – INTERACT 2023: 19th IFIP TC13 International Conference, York, UK, August 28 – September 1, 2023, Proceedings, Part I. vol. 14142, Springer Cham. pp. 459-468 . (doi:10.1007/978-3-031-42280-5_29).

Abstract

The use of sign language is a highly effective way of communicating with individuals who experience hearing loss. Despite extensive research, many learners find traditional methods of learning sign language, such as web-based question-answer methods, to be unengaging. This has led to the development of new techniques, such as the use of virtual reality (VR) and gamification, which have shown promising results. In this paper, we describe a gamified immersive American Sign Language (ASL) learning environment that uses the latest VR technology to gradually guide learners from numeric to alphabetic ASL. Our hypothesis is that such an environment would be more engaging than traditional web-based methods. An initial user study showed that our system scored highly in some aspects, especially the hedonic factor of novelty. However, there is room for improvement, particularly in the pragmatic factor of dependability. Overall, our findings suggest that the use of VR and gamification can significantly improve engagement in ASL learning.

This record has no associated files available for download.

Contributors

Author: Zhaoxing Li

Download statistics