On the Generalisation of Soft Margin Algorithms
Shawe-Taylor, J. and Cristianini, N. (2002) On the Generalisation of Soft Margin Algorithms. IEEE Transactions on Information Theory, 48, (10), 2721-2735.
Download
Full text not available from this repository.
Description/Abstract
Generalization bounds depending on the margin of a classifier are a relatively recent development. They provide an explanation of the performance of state-of-the-art learning systems such as support vector machines (SVMs) [1] and Adaboost [2]. The difficulty with these bounds has been either their lack of robustness or their looseness. The question of whether the generalization of a classifier can be more tightly bounded in terms of a robust measure of the distribution of margin values has remained open for some time. The paper answers this open question in the affirmative and, furthermore, the analysis leads to bounds that motivate the previously heuristic soft margin SVM algorithms as well as justifying the use of the quadratic loss in neural network training algorithms. The results are extended to give bounds for the probability of failing to achieve a target accuracy in regression prediction, with a statistical analysis of ridge regression and Gaussian processes as a special case. The analysis presented in the paper has also lead to new boosting algorithms described elsewhere.
| Item Type: | Article |
|---|---|
| ISSNs: | 1059-2362 |
| Related URLs: | |
| Divisions: | Faculty of Physical and Applied Science > Electronics and Computer Science |
| Item ID: | 259786 |
| Date Deposited: | 17 Aug 2004 |
| Last Modified: | 02 Mar 2012 14:04 |
| Contributors: | Shawe-Taylor, J. (Author) Cristianini, N. (Author) |
| Date: | October 2002 |
| Status: | Published |
| Publisher: | IEEE |
| Further Information: | Google Scholar |
| URI: | http://eprints.soton.ac.uk/id/eprint/259786 |
Actions (login required)
 |
View Item |
