Measuring situation awareness in complex systems: comparison of measures study

Salmon, Paul M., Stanton, Neville A., Walker, Guy H., Jenkins, Daniel, Ladva, Darshna, Rafferty, Laura and Young, Mark (2009) Measuring situation awareness in complex systems: comparison of measures study. International Journal of Industrial Ergonomics, 39 (3), 490-500. (doi:10.1016/j.ergon.2008.10.010).

Abstract

Assessing operator situation awareness is a key component of sociotechnical system design and evaluation. This article describes a study that was undertaken in order to compare two different situation awareness measures (a freeze probe recall approach and a post trial subjective rating approach) when used to assess participant situation awareness during a military planning task. The results indicate that only the participant situation awareness scores derived via the freeze probe recall method produced a statistically significant correlation with performance on the planning task and also that there was no significant correlation between the two methods, which suggests that they were measuring different aspects of participant situation awareness during the trials. In conclusion, the findings, whilst raising doubts over the validity of the post trial subjective rating approach, offer validation evidence for the use of freeze probe recall approaches to measure situation awareness during simulated tasks. The findings are subsequently discussed with regard to their wider implications for the future measurement of situation awareness in complex collaborative systems

This record has no associated files available for download.

Contributors

Author: Neville A. Stanton

Author: Mark Young

Download statistics