Exploring the degree of delegated authority for the peer review of societal impact
Exploring the degree of delegated authority for the peer review of societal impact
This article explores how panel expert reviewers’ evaluative practice was influenced by external, political considerations during the assessment of a societal impact criterion. The results showed that prior to the evaluation process, participants demonstrated a strong preconceived, political belief that the results of the evaluation process must ‘showcase’ the value of British research to the public and policymakers as part of a rationale designed to ensure continued public-based research funding. Post-evaluation interviews revealed how, during the societal impact assessment, evaluators drew on these strong beliefs which informed a group-based strategy of ‘generous marking’ of submissions. We discuss the implications of external motivations that influence the direction of research audit exercises where the definition of the criteria is untested, unclear, and unfamiliar to evaluators, as well as discuss the suitability of peer review as an evaluation tool. Both have implications for the future legitimacy of impact assessment as a formalized criterion.
673-682
Derrick, G E
39d7c8c3-f952-4705-af4b-902a27a42a3b
Samuel, G S
66af6213-08de-4c0e-92c1-12083ec456e3
1 October 2018
Derrick, G E
39d7c8c3-f952-4705-af4b-902a27a42a3b
Samuel, G S
66af6213-08de-4c0e-92c1-12083ec456e3
Derrick, G E and Samuel, G S
(2018)
Exploring the degree of delegated authority for the peer review of societal impact.
Science and Public Policy, 45 (5), .
(doi:10.1093/scipol/scx091).
Abstract
This article explores how panel expert reviewers’ evaluative practice was influenced by external, political considerations during the assessment of a societal impact criterion. The results showed that prior to the evaluation process, participants demonstrated a strong preconceived, political belief that the results of the evaluation process must ‘showcase’ the value of British research to the public and policymakers as part of a rationale designed to ensure continued public-based research funding. Post-evaluation interviews revealed how, during the societal impact assessment, evaluators drew on these strong beliefs which informed a group-based strategy of ‘generous marking’ of submissions. We discuss the implications of external motivations that influence the direction of research audit exercises where the definition of the criteria is untested, unclear, and unfamiliar to evaluators, as well as discuss the suitability of peer review as an evaluation tool. Both have implications for the future legitimacy of impact assessment as a formalized criterion.
This record has no associated files available for download.
More information
e-pub ahead of print date: 22 January 2018
Published date: 1 October 2018
Identifiers
Local EPrints ID: 447580
URI: http://eprints.soton.ac.uk/id/eprint/447580
ISSN: 0302-3427
PURE UUID: 37517474-05d8-4980-b204-9ba81e7b457b
Catalogue record
Date deposited: 16 Mar 2021 17:44
Last modified: 16 Mar 2024 10:28
Export record
Altmetrics
Contributors
Author:
G E Derrick
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics