The University of Southampton
University of Southampton Institutional Repository

Validating the strategies analysis diagram: assessing the reliability and validity of a formative method

Validating the strategies analysis diagram: assessing the reliability and validity of a formative method
Validating the strategies analysis diagram: assessing the reliability and validity of a formative method
The Strategies Analysis Diagram (SAD) is a recently developed method to model the range of possible strategies available for activities in complex sociotechnical systems. Previous applications of the new method have shown that it can effectively identify a comprehensive range of strategies available to humans performing activity within a particular system. A recurring criticism of Ergonomics methods is however, that substantive evidence regarding their performance is lacking. For a method to be widely used by other practitioners such evaluations are necessary. This article presents an evaluation of criterion-referenced validity and test-retest reliability of the SAD method when used by novice analysts. The findings show that individual analyst performance was average. However, pooling the individual analyst outputs into a group model increased the reliability and validity of the method. It is concluded that the SAD method's reliability and validity can be assured through the use of a structured process in which analysts first construct an individual model, followed by either another analyst pooling the individual results or a group process pooling individual models into an agreed group model.
strategies analysis diagram, cognitive work analysis, validation
0003-6870
1484-1494
Cornelissen, M
84c38191-d973-48b3-8ac5-b721ff976154
Salmon, P.
0eabd707-d8e2-4317-8955-152ef0a83764
McClure, R
19e8257f-ebbb-448d-8380-040645df6e0f
Stanton, N.A.
351a44ab-09a0-422a-a738-01df1fe0fadd
Cornelissen, M
84c38191-d973-48b3-8ac5-b721ff976154
Salmon, P.
0eabd707-d8e2-4317-8955-152ef0a83764
McClure, R
19e8257f-ebbb-448d-8380-040645df6e0f
Stanton, N.A.
351a44ab-09a0-422a-a738-01df1fe0fadd

Cornelissen, M, Salmon, P., McClure, R and Stanton, N.A. (2014) Validating the strategies analysis diagram: assessing the reliability and validity of a formative method. Applied Ergonomics, 45 (6), 1484-1494. (doi:10.1016/j.apergo.2014.04.010).

Record type: Article

Abstract

The Strategies Analysis Diagram (SAD) is a recently developed method to model the range of possible strategies available for activities in complex sociotechnical systems. Previous applications of the new method have shown that it can effectively identify a comprehensive range of strategies available to humans performing activity within a particular system. A recurring criticism of Ergonomics methods is however, that substantive evidence regarding their performance is lacking. For a method to be widely used by other practitioners such evaluations are necessary. This article presents an evaluation of criterion-referenced validity and test-retest reliability of the SAD method when used by novice analysts. The findings show that individual analyst performance was average. However, pooling the individual analyst outputs into a group model increased the reliability and validity of the method. It is concluded that the SAD method's reliability and validity can be assured through the use of a structured process in which analysts first construct an individual model, followed by either another analyst pooling the individual results or a group process pooling individual models into an agreed group model.

This record has no associated files available for download.

More information

Accepted/In Press date: 7 April 2014
e-pub ahead of print date: 2 May 2014
Published date: November 2014
Keywords: strategies analysis diagram, cognitive work analysis, validation
Organisations: Transportation Group

Identifiers

Local EPrints ID: 383333
URI: http://eprints.soton.ac.uk/id/eprint/383333
ISSN: 0003-6870
PURE UUID: f796f082-46c7-436a-a9f3-2347842f1964
ORCID for N.A. Stanton: ORCID iD orcid.org/0000-0002-8562-3279

Catalogue record

Date deposited: 16 Nov 2015 10:41
Last modified: 15 Mar 2024 03:33

Export record

Altmetrics

Contributors

Author: M Cornelissen
Author: P. Salmon
Author: R McClure
Author: N.A. Stanton ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×