Validating the strategies analysis diagram: assessing the reliability and validity of a formative method
Validating the strategies analysis diagram: assessing the reliability and validity of a formative method
The Strategies Analysis Diagram (SAD) is a recently developed method to model the range of possible strategies available for activities in complex sociotechnical systems. Previous applications of the new method have shown that it can effectively identify a comprehensive range of strategies available to humans performing activity within a particular system. A recurring criticism of Ergonomics methods is however, that substantive evidence regarding their performance is lacking. For a method to be widely used by other practitioners such evaluations are necessary. This article presents an evaluation of criterion-referenced validity and test-retest reliability of the SAD method when used by novice analysts. The findings show that individual analyst performance was average. However, pooling the individual analyst outputs into a group model increased the reliability and validity of the method. It is concluded that the SAD method's reliability and validity can be assured through the use of a structured process in which analysts first construct an individual model, followed by either another analyst pooling the individual results or a group process pooling individual models into an agreed group model.
strategies analysis diagram, cognitive work analysis, validation
1484-1494
Cornelissen, M
84c38191-d973-48b3-8ac5-b721ff976154
Salmon, P.
0eabd707-d8e2-4317-8955-152ef0a83764
McClure, R
19e8257f-ebbb-448d-8380-040645df6e0f
Stanton, N.A.
351a44ab-09a0-422a-a738-01df1fe0fadd
November 2014
Cornelissen, M
84c38191-d973-48b3-8ac5-b721ff976154
Salmon, P.
0eabd707-d8e2-4317-8955-152ef0a83764
McClure, R
19e8257f-ebbb-448d-8380-040645df6e0f
Stanton, N.A.
351a44ab-09a0-422a-a738-01df1fe0fadd
Cornelissen, M, Salmon, P., McClure, R and Stanton, N.A.
(2014)
Validating the strategies analysis diagram: assessing the reliability and validity of a formative method.
Applied Ergonomics, 45 (6), .
(doi:10.1016/j.apergo.2014.04.010).
Abstract
The Strategies Analysis Diagram (SAD) is a recently developed method to model the range of possible strategies available for activities in complex sociotechnical systems. Previous applications of the new method have shown that it can effectively identify a comprehensive range of strategies available to humans performing activity within a particular system. A recurring criticism of Ergonomics methods is however, that substantive evidence regarding their performance is lacking. For a method to be widely used by other practitioners such evaluations are necessary. This article presents an evaluation of criterion-referenced validity and test-retest reliability of the SAD method when used by novice analysts. The findings show that individual analyst performance was average. However, pooling the individual analyst outputs into a group model increased the reliability and validity of the method. It is concluded that the SAD method's reliability and validity can be assured through the use of a structured process in which analysts first construct an individual model, followed by either another analyst pooling the individual results or a group process pooling individual models into an agreed group model.
This record has no associated files available for download.
More information
Accepted/In Press date: 7 April 2014
e-pub ahead of print date: 2 May 2014
Published date: November 2014
Keywords:
strategies analysis diagram, cognitive work analysis, validation
Organisations:
Transportation Group
Identifiers
Local EPrints ID: 383333
URI: http://eprints.soton.ac.uk/id/eprint/383333
ISSN: 0003-6870
PURE UUID: f796f082-46c7-436a-a9f3-2347842f1964
Catalogue record
Date deposited: 16 Nov 2015 10:41
Last modified: 15 Mar 2024 03:33
Export record
Altmetrics
Contributors
Author:
M Cornelissen
Author:
P. Salmon
Author:
R McClure
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics