Support vector machine learning from heterogeneous data: an empirical analysis using protein sequence and structure
Darrin P. Lewis, Tony Jebara and William Stafford Noble
Bioinformatics. 22(22):2753-2760, 2006.
Abstract
Drawing inferences from large, heterogeneous sets of biological data requires a theoretical framework that is capable of representing, for example, DNA and protein sequences, protein structures, microarray expression data, various types of interaction networks, etc. Recently, a class of algorithms known as kernel methods has emerged as a powerful framework for combining diverse types of data. The support vector machine (SVM) algorithm is the most popular kernel method, due to its theoretical underpinnings and strong empirical performance on a wide variety of classification tasks. Furthermore, several recently described extensions allow the SVM to assign relative weights to various data sets, depending upon their utilities in performing a given classification task.
In this work, we empirically investigate the performance of the SVM on the task of inferring gene functional annotations from a combination of protein sequence and structure data. Our results suggest that the SVM is quite robust to noise in the input data sets. Consequently, in the presence of only two types of data, an SVM trained from an unweighted combination of data sets performs as well or better than a more sophisticated algorithm that assigns weights to individual data types. Indeed, for this simple case, we can demonstrate empirically that no solution is significantly better than the naive, unweighted average of the two data sets. On the other hand, when multiple noisy data sets are included in the experiment, then the naive approach fares worse than the weighted approach. Our results suggest that for many applications, a naive unweighted sum of kernels may be sufficient.
Supplementary data
Home