The University of Southampton
University of Southampton Institutional Repository

Paper trials: a qualitative study exploring the place of portfolios in making revalidation recommendations for Responsible Officers

Paper trials: a qualitative study exploring the place of portfolios in making revalidation recommendations for Responsible Officers
Paper trials: a qualitative study exploring the place of portfolios in making revalidation recommendations for Responsible Officers

BACKGROUND: A portfolio of supporting information (SI) reflecting a doctor's entire medical practice is now a central aspect of UK appraisal for revalidation. Medical revalidation, introduced in 2012, is an assessment of a doctor's competence and passing results in a five yearly license to practice medicine. It assesses of a doctor's professional development, workplace performance and reflection and aims to provide assurance that doctors are up-to-date and fit to practice. The dominant assessment mechanism is a portfolio. The content of the revalidation portfolio has been increasingly prescribed and the assessment of the SI is a fundamental aspect of the appraisal process which ultimately allows Responsible Officers (ROs) to make recommendations on revalidation. ROs, themselves doctors, were the first to undergo UK revalidation. This qualitative study explored the perceptions of ROs and their appraisers about the use of this portfolio of evidence in a summative revalidation appraisal.

METHODS: 28 purposefully sampled London ROs were interviewed following their revalidation appraisal and 17 of their appraisers participated in focus groups and interviews. Thematic analysis was used to identify commonalities and differences of experience.

RESULTS: SI was mostly easy to provide but there were challenges in gathering certain aspects. ROs did not understand in what quantities they should supply SI or what it should look like. Appraisers were concerned about making robust judgements based on the evidence supplied. A lack of reflection from the process of collating SI and preparing for appraisal was noted and learning came more from the appraisal interview itself.

CONCLUSIONS: More explicit guidance must be available to both appraisee and appraiser about what SI is required, how much, how it should be used and, how it will be assessed. The role of SI in professional learning and revalidation must be clarified and further empirical research is required to examine how best to use this evidence to make judgments as part of this type of appraisal.

Clinical Competence/standards, Employee Performance Appraisal/methods, England, Focus Groups, Humans, Interviews as Topic, Licensure, Medical/standards, London, Physicians/standards, Qualitative Research, Quality Assurance, Health Care/methods, Self-Assessment, State Medicine/standards
1472-6920
66
Furmedge, Daniel S
0ac9a55c-bdae-4c20-b04b-22bf0b157f14
Griffin, Ann
f8792909-d467-40c1-8dec-b86ebe750b05
O'Keeffe, Catherine
f8d29b19-1430-4384-baeb-9ddc10cea400
Verma, Anju
5a2d0658-ad11-40ab-bbe8-f1e83726eb55
Smith, Laura-Jane
719d303d-4279-4c8a-b38a-adbbbf33bb44
Gill, Deborah
7efe669f-45e8-45d3-ab30-8717653353ca
Furmedge, Daniel S
0ac9a55c-bdae-4c20-b04b-22bf0b157f14
Griffin, Ann
f8792909-d467-40c1-8dec-b86ebe750b05
O'Keeffe, Catherine
f8d29b19-1430-4384-baeb-9ddc10cea400
Verma, Anju
5a2d0658-ad11-40ab-bbe8-f1e83726eb55
Smith, Laura-Jane
719d303d-4279-4c8a-b38a-adbbbf33bb44
Gill, Deborah
7efe669f-45e8-45d3-ab30-8717653353ca

Furmedge, Daniel S, Griffin, Ann, O'Keeffe, Catherine, Verma, Anju, Smith, Laura-Jane and Gill, Deborah (2016) Paper trials: a qualitative study exploring the place of portfolios in making revalidation recommendations for Responsible Officers. BMC Medical Education, 16, 66. (doi:10.1186/s12909-016-0592-6).

Record type: Article

Abstract

BACKGROUND: A portfolio of supporting information (SI) reflecting a doctor's entire medical practice is now a central aspect of UK appraisal for revalidation. Medical revalidation, introduced in 2012, is an assessment of a doctor's competence and passing results in a five yearly license to practice medicine. It assesses of a doctor's professional development, workplace performance and reflection and aims to provide assurance that doctors are up-to-date and fit to practice. The dominant assessment mechanism is a portfolio. The content of the revalidation portfolio has been increasingly prescribed and the assessment of the SI is a fundamental aspect of the appraisal process which ultimately allows Responsible Officers (ROs) to make recommendations on revalidation. ROs, themselves doctors, were the first to undergo UK revalidation. This qualitative study explored the perceptions of ROs and their appraisers about the use of this portfolio of evidence in a summative revalidation appraisal.

METHODS: 28 purposefully sampled London ROs were interviewed following their revalidation appraisal and 17 of their appraisers participated in focus groups and interviews. Thematic analysis was used to identify commonalities and differences of experience.

RESULTS: SI was mostly easy to provide but there were challenges in gathering certain aspects. ROs did not understand in what quantities they should supply SI or what it should look like. Appraisers were concerned about making robust judgements based on the evidence supplied. A lack of reflection from the process of collating SI and preparing for appraisal was noted and learning came more from the appraisal interview itself.

CONCLUSIONS: More explicit guidance must be available to both appraisee and appraiser about what SI is required, how much, how it should be used and, how it will be assessed. The role of SI in professional learning and revalidation must be clarified and further empirical research is required to examine how best to use this evidence to make judgments as part of this type of appraisal.

This record has no associated files available for download.

More information

Published date: 17 February 2016
Keywords: Clinical Competence/standards, Employee Performance Appraisal/methods, England, Focus Groups, Humans, Interviews as Topic, Licensure, Medical/standards, London, Physicians/standards, Qualitative Research, Quality Assurance, Health Care/methods, Self-Assessment, State Medicine/standards

Identifiers

Local EPrints ID: 502807
URI: http://eprints.soton.ac.uk/id/eprint/502807
ISSN: 1472-6920
PURE UUID: b6daf7c2-dfd3-40df-b448-9618f7827b38
ORCID for Deborah Gill: ORCID iD orcid.org/0009-0005-8371-2496

Catalogue record

Date deposited: 08 Jul 2025 16:55
Last modified: 09 Jul 2025 02:04

Export record

Altmetrics

Contributors

Author: Daniel S Furmedge
Author: Ann Griffin
Author: Catherine O'Keeffe
Author: Anju Verma
Author: Laura-Jane Smith
Author: Deborah Gill ORCID iD

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×