Recalibration effects in judgments of learning: a signal detection analysis
Recalibration effects in judgments of learning: a signal detection analysis
In this study we investigated the influence of list composition on judgments of learning (JOLs). To this end, we compared JOLs assigned in a multi-cycle procedure to a set of mod- erately difficult word pairs. Experiment 1 revealed that when difficult new pairs were added to the study list, the mean of JOLs assigned to the moderate pairs increased as compared to the baseline. In Experiment 2, we reversed this pattern by including easy new pairs in the study list. By analyzing metacognitive ROCs (MROCs), we demonstrate that these results were caused by criterion shifts, by which participants adjusted the level of evidence needed to assign particular JOL ratings. Changes in the study list composition led to a recalibration of the JOL scale – i.e. resetting of the criteria – in order to accommodate the addition of new items. We discuss the usefulness of MROCs for detecting criterion shifts in rating tasks.
161-176
Zawadzka, K.
b30f4b52-cfbc-4596-9069-0aa193bf7d77
Higham, P.A.
4093b28f-7d58-4d18-89d4-021792e418e7
October 2016
Zawadzka, K.
b30f4b52-cfbc-4596-9069-0aa193bf7d77
Higham, P.A.
4093b28f-7d58-4d18-89d4-021792e418e7
Zawadzka, K. and Higham, P.A.
(2016)
Recalibration effects in judgments of learning: a signal detection analysis.
Journal of Memory and Language, 90, .
(doi:10.1016/j.jml.2016.04.005).
Abstract
In this study we investigated the influence of list composition on judgments of learning (JOLs). To this end, we compared JOLs assigned in a multi-cycle procedure to a set of mod- erately difficult word pairs. Experiment 1 revealed that when difficult new pairs were added to the study list, the mean of JOLs assigned to the moderate pairs increased as compared to the baseline. In Experiment 2, we reversed this pattern by including easy new pairs in the study list. By analyzing metacognitive ROCs (MROCs), we demonstrate that these results were caused by criterion shifts, by which participants adjusted the level of evidence needed to assign particular JOL ratings. Changes in the study list composition led to a recalibration of the JOL scale – i.e. resetting of the criteria – in order to accommodate the addition of new items. We discuss the usefulness of MROCs for detecting criterion shifts in rating tasks.
Text
Zawadzka&Higham_2016_JML.pdf
- Version of Record
More information
Accepted/In Press date: 20 April 2016
e-pub ahead of print date: 14 May 2016
Published date: October 2016
Identifiers
Local EPrints ID: 396606
URI: http://eprints.soton.ac.uk/id/eprint/396606
ISSN: 0749-596X
PURE UUID: ec8337c0-0d63-4707-8ae9-421f24909485
Catalogue record
Date deposited: 10 Jun 2016 15:47
Last modified: 15 Mar 2024 03:08
Export record
Altmetrics
Contributors
Author:
K. Zawadzka
Download statistics
Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.
View more statistics
