The University of Southampton
University of Southampton Institutional Repository

Skill assessment via cross-validation and Monte Carlo simulation: an application to Georges Bank plankton models

Wallhead, Philip, Martin, Adrian P., Srokosz, Meric A. and Franks, Peter J.S. (2009) Skill assessment via cross-validation and Monte Carlo simulation: an application to Georges Bank plankton models Journal of Marine Systems, 76, (1-2), pp. 134-150. (doi:10.1016/j.jmarsys.2008.03.010).

Record type: Article


Better methods are required to assess the skill or uncertainty of plankton model predictions. A method is presented which combines cross-validation with simulated repeat samplings of the data (Monte Carlo simulation), in order to robustly estimate uncertainty in predictions beyond the calibration data (‘extra-sample’). The method is applied to compare two bulk models of chlorophyll on Georges Bank using the GLOBEC data set, accounting for data and forcing errors as well as prior uncertainty in all model parameters and initial conditions. The first model is a simple interpolation of chlorophyll data (‘inductive’ model), and serves as a baseline of predictive skill. The second is a simple process model forced by interannually-variable nutrient and mesozooplankton mean fields. Uncertainty in the process model forcings severely increases the extra-sample prediction variance (over repeat experiments). Although the process model can reproduce some of the interannual chlorophyll variability via top-down control by mesozooplankton, other predictions are strongly biased, possibly due to neglected boundary fluxes of chlorophyll. As a result, the new skill metrics generally favour the inductive model. By contrast, a standard skill metric based on calibration data misfit incorrectly favours the process model, mainly due to the neglect of extra-sample prediction variance.

PDF 2009JMS.pdf - Accepted Manuscript
Restricted to Registered users only
Download (754kB)

More information

Published date: 23 February 2009


Local EPrints ID: 65895
ISSN: 0924-7963
PURE UUID: 4a322702-e0c5-4b3e-ba84-9a90dc36a1ac

Catalogue record

Date deposited: 26 Mar 2009
Last modified: 19 Jul 2017 00:29

Export record



Author: Philip Wallhead
Author: Adrian P. Martin
Author: Meric A. Srokosz
Author: Peter J.S. Franks

University divisions

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton:

ePrints Soton supports OAI 2.0 with a base URL of

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.