A data parallel approach for large-scale Gaussian process modelling


Choudhury, A., Nair, P.B. and Keane, A.J. (2002) A data parallel approach for large-scale Gaussian process modelling In Proceedings of the Second SIAM International Conference on Data Mining. SIAM., pp. 95-111.

Download

[img] PDF chou_02.pdf - Accepted Manuscript
Download (1MB)

Description/Abstract

This paper proposes an enabling data parallel local learning methodology for handling large data regression through the Gaussian Process (GP) modeling paradigm. The proposed model achieves parallelism by employing a specialized compactly supported covariance function defined over spatially localized clusters. The associated load balancing constraints arising from data parallelism are satisfied using a novel greedy clustering algorithm, GeoClust producing balanced clusters localized in space. Further, the use of the proposed covariance function as a building block for GP models is shown to decompose the maximum likelihood estimation problem into smaller decoupled subproblems. The attendant benefits which include a significant reduction in training complexity, as well as sparse predictive models for the posterior mean and variance make the present scheme extremely attractive. Experimental investigations on real and synthetic data demonstrate that the current approach can consistently outperform the state-of-the-art Bayesian Committee Machine (BCM) which employs a random data partitioning strategy. Finally, extensive evaluations over a grid-based computational infrastructure using the NetSolve distributed computing system show that the present approach scales well with data and could potentially be used in large-scale data mining applications.

Item Type: Conference or Workshop Item (Paper)
Venue - Dates: Second SIAM International Conference on Data Mining, 2002-04-01 - 2002-04-01
Related URLs:
Subjects:
ePrint ID: 21993
Date :
Date Event
2002Published
Date Deposited: 29 Mar 2006
Last Modified: 16 Apr 2017 22:53
Further Information:Google Scholar
URI: http://eprints.soton.ac.uk/id/eprint/21993

Actions (login required)

View Item View Item