The University of Southampton
University of Southampton Institutional Repository

Transforming a competency model to parameterised questions in assessment

Transforming a competency model to parameterised questions in assessment
Transforming a competency model to parameterised questions in assessment
The problem of comparing and matching different learners’ knowledge arises when assessment systems use a one-dimensional numerical value to represent “knowledge level”. Such assessment systems may measure inconsistently because they estimate this level differently and inadequately. The multidimensional competency model called COMpetence-Based learner knowledge for personalized Assessment (COMBA) is being developed to represent a learner’s knowledge in a multi-dimensional vector space. The heart of this model is to treat knowledge, not as possession, but as a contextualized space of capability either actual or potential. The paper discusses a system for automatically generating questions from the COMBA competency model as a “guide-on-the-side”. The system’s novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge.
Competency, Assessment, Knowledge level, Ontology
392-405
Springer
Sitthisak, Onjira
8aec992e-9fcc-47d1-947f-78aa271db3c6
Gilbert, Lester
a593729a-9941-4b0a-bb10-1be61673b741
Davis, Hugh
1608a3c8-0920-4a0c-82b3-ee29a52e7c1b
Cordeiro, J.
Hammoudi, S.
Filipe, J.
Sitthisak, Onjira
8aec992e-9fcc-47d1-947f-78aa271db3c6
Gilbert, Lester
a593729a-9941-4b0a-bb10-1be61673b741
Davis, Hugh
1608a3c8-0920-4a0c-82b3-ee29a52e7c1b
Cordeiro, J.
Hammoudi, S.
Filipe, J.

Sitthisak, Onjira, Gilbert, Lester and Davis, Hugh (2009) Transforming a competency model to parameterised questions in assessment. Cordeiro, J., Hammoudi, S. and Filipe, J. (eds.) In Web Information Systems and Technologies: WEBIST 2008. vol. 18, Springer. pp. 392-405 . (doi:10.1007/978-3-642-01344-7_29).

Record type: Conference or Workshop Item (Paper)

Abstract

The problem of comparing and matching different learners’ knowledge arises when assessment systems use a one-dimensional numerical value to represent “knowledge level”. Such assessment systems may measure inconsistently because they estimate this level differently and inadequately. The multidimensional competency model called COMpetence-Based learner knowledge for personalized Assessment (COMBA) is being developed to represent a learner’s knowledge in a multi-dimensional vector space. The heart of this model is to treat knowledge, not as possession, but as a contextualized space of capability either actual or potential. The paper discusses a system for automatically generating questions from the COMBA competency model as a “guide-on-the-side”. The system’s novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge.

Text
Transforming_a_competency_model_to_parameterised_questions_in_assessment.pdf - Other
Download (1MB)

More information

Published date: 21 April 2009
Keywords: Competency, Assessment, Knowledge level, Ontology
Organisations: Web & Internet Science, Electronic & Software Systems

Identifiers

Local EPrints ID: 267379
URI: http://eprints.soton.ac.uk/id/eprint/267379
PURE UUID: 147c4a7d-5718-4d32-981f-79ade099d18e
ORCID for Hugh Davis: ORCID iD orcid.org/0000-0002-1182-1459

Catalogue record

Date deposited: 18 May 2009 17:15
Last modified: 16 Mar 2024 02:36

Export record

Altmetrics

Contributors

Author: Onjira Sitthisak
Author: Lester Gilbert
Author: Hugh Davis ORCID iD
Editor: J. Cordeiro
Editor: S. Hammoudi
Editor: J. Filipe

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×