The University of Southampton
University of Southampton Institutional Repository

Exploiting the Grid for collaborative ensemble studies using GENIE Earth System Models

Exploiting the Grid for collaborative ensemble studies using GENIE Earth System Models
Exploiting the Grid for collaborative ensemble studies using GENIE Earth System Models
GENIE is a Grid-enabled framework for composing an extensive range of Earth System Models (ESMs) and simulating multi-millennial timescales, primarily for the study of ice age cycles and long-term human induced global change. Grid computing technology enables the flexible coupling of constituent models, execution of the resulting ESMs and the management of the data that they generate. We demonstrate how the Grid software deployed for the project is being used to execute large-scale simulations of an ESM that would not be feasible on a single computational resource.
Within the spectrum of GENIE models a simulation over multi-millennial timescales can require anything from 2 hours to ~1,500 hours of sequential compute time. To perform ensemble runs of the more computationally demanding models therefore requires a significant amount of resource. Whilst an individual project member may own sufficient resource on an exclusive basis, this may not be cost-effective if the resource is then only used in intermittent bursts with time in between idle as the experimental results are analysed, reported, and the next experiment designed. However it is very cost-effective if a multi-disciplinary, multi-site team such as GENIE, each of whom has similarly intermittent need for bursts of compute power, pool their resources.
The GENIE data management system provides programmatic access to a dedicated database and file repository from within the Matlab problem solving environment. Exploiting the database system we demonstrate how large scale simulations can be performed by staging intermediate results in the repository and using a number of distributed “worker” clients to autonomously progress the model states. Through the common system interface and integration into the scientists’ familiar tools / environments we enable the project team as a whole to cost-effectively undertake much larger studies than could have been contemplated individually.
1029-7006
8643
Price, A.R.
15a6667c-60da-42e9-b6dd-4c0e56c33c52
Jiao, Z.
6d4dd027-f745-4b35-b701-e10b45b50be1
Lenton, T.M.
f2b4fe3d-ef5e-4c85-9677-bfc20c266b65
Williams, G.
7e38985a-981b-4f64-8c33-9c0854a199e3
Valdes, P.J.
7b271d19-a4cb-4fc3-af4e-6745239c01d8
Cox, S.J.
0e62aaed-24ad-4a74-b996-f606e40e5c55
GENIE team
Price, A.R.
15a6667c-60da-42e9-b6dd-4c0e56c33c52
Jiao, Z.
6d4dd027-f745-4b35-b701-e10b45b50be1
Lenton, T.M.
f2b4fe3d-ef5e-4c85-9677-bfc20c266b65
Williams, G.
7e38985a-981b-4f64-8c33-9c0854a199e3
Valdes, P.J.
7b271d19-a4cb-4fc3-af4e-6745239c01d8
Cox, S.J.
0e62aaed-24ad-4a74-b996-f606e40e5c55

Price, A.R., Jiao, Z., Lenton, T.M., Williams, G., Valdes, P.J. and Cox, S.J. , GENIE team (2006) Exploiting the Grid for collaborative ensemble studies using GENIE Earth System Models. Geophysical Research Abstracts, 8, 8643.

Record type: Article

Abstract

GENIE is a Grid-enabled framework for composing an extensive range of Earth System Models (ESMs) and simulating multi-millennial timescales, primarily for the study of ice age cycles and long-term human induced global change. Grid computing technology enables the flexible coupling of constituent models, execution of the resulting ESMs and the management of the data that they generate. We demonstrate how the Grid software deployed for the project is being used to execute large-scale simulations of an ESM that would not be feasible on a single computational resource.
Within the spectrum of GENIE models a simulation over multi-millennial timescales can require anything from 2 hours to ~1,500 hours of sequential compute time. To perform ensemble runs of the more computationally demanding models therefore requires a significant amount of resource. Whilst an individual project member may own sufficient resource on an exclusive basis, this may not be cost-effective if the resource is then only used in intermittent bursts with time in between idle as the experimental results are analysed, reported, and the next experiment designed. However it is very cost-effective if a multi-disciplinary, multi-site team such as GENIE, each of whom has similarly intermittent need for bursts of compute power, pool their resources.
The GENIE data management system provides programmatic access to a dedicated database and file repository from within the Matlab problem solving environment. Exploiting the database system we demonstrate how large scale simulations can be performed by staging intermediate results in the repository and using a number of distributed “worker” clients to autonomously progress the model states. Through the common system interface and integration into the scientists’ familiar tools / environments we enable the project team as a whole to cost-effectively undertake much larger studies than could have been contemplated individually.

This record has no associated files available for download.

More information

Published date: 2006

Identifiers

Local EPrints ID: 28975
URI: http://eprints.soton.ac.uk/id/eprint/28975
ISSN: 1029-7006
PURE UUID: 3828e4ae-e891-4271-a0c4-66a4bfefde31

Catalogue record

Date deposited: 11 May 2006
Last modified: 11 Dec 2021 15:11

Export record

Contributors

Author: A.R. Price
Author: Z. Jiao
Author: T.M. Lenton
Author: G. Williams
Author: P.J. Valdes
Author: S.J. Cox
Corporate Author: GENIE team

Download statistics

Downloads from ePrints over the past year. Other digital versions may also be available to download e.g. from the publisher's website.

View more statistics

Atom RSS 1.0 RSS 2.0

Contact ePrints Soton: eprints@soton.ac.uk

ePrints Soton supports OAI 2.0 with a base URL of http://eprints.soton.ac.uk/cgi/oai2

This repository has been built using EPrints software, developed at the University of Southampton, but available to everyone to use.

We use cookies to ensure that we give you the best experience on our website. If you continue without changing your settings, we will assume that you are happy to receive cookies on the University of Southampton website.

×