The University of Southampton
University of Southampton Institutional Repository

The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students

The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students
The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students
This paper reports findings from a study funded by the National Board for Nursing, Midwifery and Health Visiting for Scotland to test selected nursing and midwifery clinical competence assessment tools for reliability and validity.

The study, which took place over two years from July 1997, involved comparing items in the selected tools with statutory competencies for nurses and midwives, collecting assessment data from a sample of 257 nursing and 43 midwifery students in four educational institutions and administering additional assessment measures (the Nursing Competencies Questionnaire (NCQ) (Bartlett et al., An evaluation of pre-registration nursing education: a literature review and comparative study of graduate outcomes, Oxford Centre for Health Care Research & Development, Oxford Brookes University, Oxford, 1998) and the Key Areas Assessment Instrument—KAAI) to the total student sample (and to their lecturers and practice assessors) at two time points which were six months apart. Our focus was the programme-specific clinical competence assessment tools but by testing these tools we also provide evidence on the validity of other methods of competence assessment.

Validity of the methods was assessed, primarily, by calculating multivariate and univariate correlation coefficients between them. The NCQ and KAAI were analysed for internal consistency.

The NCQ and the versions of KAAI for lecturers and practice assessors were found to have good internal consistency. The version of the KAAI tool developed for students showed reasonable internal consistency for nursing students, but less consistency for midwifery students. Correlational analysis of data collected on students showed that there is little or no relationship between most of the clinical competence assessment methods in current use, or between these methods and those introduced by the research team. This finding supports previous research, particularly in medical education and confirms that the different methods address different abilities.

A clear finding from this study is that no single method is appropriate for assessing clinical competence. A multi-method UK-wide strategy for clinical competence assessment for nursing and midwifery is needed if we are to be sure that assessment reveals whether or not students have achieved the complex repertoire of knowledge, skills and attitudes required for competent practice
0020-7489
133-145
Norman, Ian J.
7842286f-d953-48f7-9d11-bfe1b492086c
Watson, Roger
ff53a1bb-ccc6-45f7-ad2c-ecc777e8c623
Murrells, Trevor
9a57589a-d893-415c-8c3d-8b25d052f42c
Calman, Lynn
9ae254eb-74a7-4906-9eb4-62ad99f058c1
Redfern, Sally
9811502f-1e81-4252-bc64-3e6175815b1c
Norman, Ian J.
7842286f-d953-48f7-9d11-bfe1b492086c
Watson, Roger
ff53a1bb-ccc6-45f7-ad2c-ecc777e8c623
Murrells, Trevor
9a57589a-d893-415c-8c3d-8b25d052f42c
Calman, Lynn
9ae254eb-74a7-4906-9eb4-62ad99f058c1
Redfern, Sally
9811502f-1e81-4252-bc64-3e6175815b1c

Norman, Ian J., Watson, Roger, Murrells, Trevor, Calman, Lynn and Redfern, Sally (2002) The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students. International Journal of Nursing Studies, 39 (2), 133-145. (doi:10.1016/S0020-7489(01)00028-1). (PMID:11755444)

Record type: Article

Abstract

This paper reports findings from a study funded by the National Board for Nursing, Midwifery and Health Visiting for Scotland to test selected nursing and midwifery clinical competence assessment tools for reliability and validity.

The study, which took place over two years from July 1997, involved comparing items in the selected tools with statutory competencies for nurses and midwives, collecting assessment data from a sample of 257 nursing and 43 midwifery students in four educational institutions and administering additional assessment measures (the Nursing Competencies Questionnaire (NCQ) (Bartlett et al., An evaluation of pre-registration nursing education: a literature review and comparative study of graduate outcomes, Oxford Centre for Health Care Research & Development, Oxford Brookes University, Oxford, 1998) and the Key Areas Assessment Instrument—KAAI) to the total student sample (and to their lecturers and practice assessors) at two time points which were six months apart. Our focus was the programme-specific clinical competence assessment tools but by testing these tools we also provide evidence on the validity of other methods of competence assessment.

Validity of the methods was assessed, primarily, by calculating multivariate and univariate correlation coefficients between them. The NCQ and KAAI were analysed for internal consistency.

The NCQ and the versions of KAAI for lecturers and practice assessors were found to have good internal consistency. The version of the KAAI tool developed for students showed reasonable internal consistency for nursing students, but less consistency for midwifery students. Correlational analysis of data collected on students showed that there is little or no relationship between most of the clinical competence assessment methods in current use, or between these methods and those introduced by the research team. This finding supports previous research, particularly in medical education and confirms that the different methods address different abilities.

A clear finding from this study is that no single method is appropriate for assessing clinical competence. A multi-method UK-wide strategy for clinical competence assessment for nursing and midwifery is needed if we are to be sure that assessment reveals whether or not students have achieved the complex repertoire of knowledge, skills and attitudes required for competent practice

This record has no associated files available for download.

More information

Published date: February 2002
Organisations: Faculty of Health Sciences

Identifiers

Local EPrints ID: 366319
URI: http://eprints.soton.ac.uk/id/eprint/366319
ISSN: 0020-7489
PURE UUID: 2182bfce-fcc6-4e0d-9847-fa0942365c48
ORCID for Lynn Calman: ORCID iD orcid.org/0000-0002-9964-6017

Catalogue record

Date deposited: 30 Jun 2014 10:33
Last modified: 15 Mar 2024 03:41

Export record

Altmetrics

Contributors

Author: Ian J. Norman
Author: Roger Watson
Author: Trevor Murrells
Author: Lynn Calman ORCID iD
Author: Sally Redfern

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×