Probability estimation for multiclass problems combining SVMs and neural networks

Bravo, Cristian, L'Huillier, G., Luis Lobato, J. and Weber, R. (2010) Probability estimation for multiclass problems combining SVMs and neural networks. Neural Network World, 4, 475-489.

Record type: Article

Abstract

This paper addresses the problem of probability estimation in Multiclass classification tasks combining two well-known data mining techniques: Support Vector Machines and Neural Networks. We present an algorithm which uses both techniques in a two-step procedure. The first step employs Support Vector Machines within a One-vs-All reduction from multiclass to binary approach to obtain the distances between each observation and the Support Vectors representing the classes. The second step uses these distances as inputs for a Neural Network, built with an entropy cost function and softmax transfer function for the output layer where class membership is used for training. Consequently, this network estimates probabilities of class membership for new observations. A benchmark using different databases demonstrates that the proposed algorithm is highly competitive with the most recent techniques for multiclass probability estimation

This record has no associated files available for download.