INTRODUCTION
With the rapid development of sequencing technology, more and more single nucleotide polymorphisms (SNPs) have been discovered (
Sherry et al., 2001) and about 90% of the human genetic changes are caused by the SNPs (
Burke et al., 2007). If SNPs occur in coding region and change the amino acid of encoded protein, they are called non-synonymous SNPs (nsSNPs), also known as single amino acid polymorphisms (SAPs). Since nsSNPs change the sequence of encoded protein, they may affect the function of protein and cause human genetic diseases (
Stenson et al., 2003;
Hamosh et al., 2005). Besides those disease-associated nsSNPs, there are also functionally neutral ones which do not cause any diseases. Maybe the neutral ones do not occur in functional important proteins or they do not cause severe structural change of the protein. Distinguishing disease-associated nsSNPs from neutral ones is important for the investigation of human genetic diseases. There are already a lot of tools to predict the deleterious SAPs, such as SIFT (
Ng and Henikoff, 2003), PolyPhen (
Ramensky et al., 2002), and sapred (
Ye et al., 2007). Most of them are based on either the sequence features or structure features. It is difficult to improve the prediction performance anymore if only sequence and structure features are used. In fact, it is hard to believe that the effect of SAP can be accurately predicted only based on the sequence and structure features.
In our previous work, a method of deleterious SAP prediction at system level was established (
Huang et al., 2010b). The rationale of our method is simple and easy-to-understand: If a SAP occurs in the protein with important functions and it can severely change the sequence and structure of the protein, it has a high possibility of causing disease (
Huang et al., 2010b). Unlike most existing methods, our method not only considers the sequence and structure information, but also the network information which represents the importance of the protein. The integration of network information can improve the performance of deleterious SAP prediction. In fact, our method has higher accuracy than most other methods. To make our method public available, we developed SySAP (a System-level predictor of deleterious Single Amino acid Polymorphisms), an easy-to-use and highly accurate web server. SySAP is freely available at http://www.biosino.org/SySAP/ and http://lifecenter.sgst.cn/SySAP/.
RESULTS
We tested SySAP with Leave-One-Out Cross-Validation (LOOCV) based on data from UniProt Release 2010_12 and the prediction result is shown in Table 1. The sensitivity (Sn), specificity (Sp), accuracy (ACC) and Matthews’s correlation coefficient (MCC) were 0.668, 0.907, 0.823 and 0.602, respectively.
The prediction accuracy of SySAP is higher than the most widely used deleterious SAP predictor—SIFT (Sorting Tolerant from Intolerant) (
Ng and Henikoff, 2003). The reported accuracies of SIFT were often around 70% (
Ng and Henikoff, 2002;
Huang et al., 2010b;
Li et al., 2011), much lower than us. This indicates that the integration of network information can improve the performance of deleterious SAP prediction. To our knowledge, SySAP is the first deleterious SAP prediction tool that includes both amino acid level features (PSSM conservation scores, disorder score, AAFactors, GRANTHAM score) and protein network level features (betweenness, KEGG enrichment scores). The network features can not only improve the prediction performance but also illustrate the functional association of SAP better.
DISCUSSION
In our previous work (
Huang et al., 2010b), we used mRMR (Maximum Relevance Minimum Redundancy) and IFS (Incremental Feature Selection) to reduce the number of features and then applied NNA (Nearest Neighbor Algorithm) to do the prediction. In SySAP, we used more sophisticated machine learning method LiblineaR (
Fan et al., 2008) to predict the effect of query SAP with all features. LiblineaR (
Fan et al., 2008) can make prediction very fast, even when the numbers of both samples and features are extremely large.
As an easy-to-use highly accurate tool for deleterious SAP identification, SySAP could be useful for medical geneticists and facilitate the post genome-wide association studies.
METHODS
According to a recent comprehensive review (
Chou, 2011), to develop a useful predictor for biological systems, the following points were usually needed to consider: (1) benchmark dataset construction or selection, (2) mathematical formulation for biological sequence samples, (3) operating algorithm (or engine), (4) anticipated accuracy, and (5) web-server establishment. Below, we will elaborate these procedures one by one.
Dataset
Care et al. (2007) compared several widely used SAP datasets and thought the UniProt (Universal Protein Resource) dataset is the best training data for deleterious SAP prediction. In this study, SAP data from UniProt (http://www.uniprot.org/docs/humsavar, Release 2010_12) were downloaded to train and test the deleterious SAP prediction model. Each SAP in UniProt is annotated as either ‘disease’ (SAP with disease associated), ‘polymorphism’ (SAP with no known disease associated) or ‘unclassified’ (SAP which has too little information to be classified into former two classes). After excluding ‘unclassified’ SAPs and removing the redundancy, there were 36,199 unique polymorphism SAPs and 19,686 unique disease SAPs.
To avoid homology bias and remove the redundant sequences from the benchmark dataset, a cutoff threshold of 25% was imposed in (
Chou and Shen, 2007;
Chou, 2011;
Chou et al., 2011;
Wu et al., 2011) to exclude those proteins from the benchmark datasets that have 25% or greater sequence identity to any other in the same subset. However, in this study we did not use such a stringent criterion because even at the same site of the same protein, there could be several different single amino acid mutations with different effects.
Workflow of SySAP
Figure 1 shows the framework of SySAP server to predict whether the query SAP is deleterious. First, the query SAP is encoded into a 455-dimension vector which includes network, structure and sequence features. Then the query SAP is compared with the training vector with known effects, i.e. deleterious or not. Finally the LiblieaR (
Fan et al., 2008) model makes its prediction: whether the query SAP is deleterious.
Feature space of SAP
To represent the SAP, we used 455 network, structure and sequence features. In the following, each kind of features will be briefly described.
The network features
As mentioned above, one major difference between our method and others is the integration of network information. We added two kinds of network information into our model. The first kind of network feature is betweenness (
Freeman, 1979). It measures the information flow of the network. High betweenness indicates that there are multiple paths going through the node, while low betweenness means there are only few paths. In protein-protein interaction network, betweenness measures the ways in which signals pass through. We used R package tnet (http://opsahl.co.uk/tnet) to calculate the betweenness. The protein-protein interaction network was downloaded from STRING v8.3 (http://string-db.org/) (
Jensen et al., 2009). The second kind of network feature is KEGG enrichment score. The function of one protein can be represented by its immediate neighbors on protein interaction network (
Sharan et al., 2007). We defined the KEGG enrichment score of one protein by its neighbors on STRING network (
Jensen et al., 2009). The value of KEGG enrichment score equals −log
10 of the hypergeometric test
p value of its neighbors. The larger the KEGG pathway enrichment score is, the more this KEGG pathway is overrepresented. Both the KEGG enrichment scores and betweenness were network level features. In total, there were 215 network features including 214 KEGG enrichment score features and one feature of betweenness.
The PSSM conservation scores
If the amino acid at certain site of a protein is evolutionarily conserved, it often means that this amino acid is in an important functional region of the protein and mutation of it could cause a significant structural and functional change of the protein. In this study, we calculated the Position Specific Scoring Matrix (PSSM) (
Ahmad and Sarai, 2005) conservation score with Position Specific Iterative BLAST (PSI BLAST) Release 2.2.24 (
Altschul et al., 1997) to quantify the conservation status of each amino acid site in the protein sequence. PSSM conservation score has been successfully used in the studies of post translational modifications (
Niu et al., 2010;
Cai et al., 2011) and effects of mutations (
Huang et al., 2011b).
The disorder score
Disordered regions of protein do not have fixed three dimensional structures, but they play important roles in signaling transduction and gene regulation. In this study, we used the disorder score, calculated by VSL2 (
Peng et al., 2006), to quantify the disorder status of each amino acid site in the protein sequence.
The AAFactors
AAindex (http://www.genome.ad.jp/aaindex/) is a database of more than five hundred numerical indices representing different physicochemical and biochemical properties of amino acids (
Kawashima et al., 1999). Based on the factor analysis,
Atchley et al. (2005) summarized and transformed the AAindex attributes of amino acids into five multidimensional patterns of attribute covariation that reflected polarity, secondary structure, molecular volume, codon diversity, and electrostatic charge. We called these five transformed scores “AAFactors” and used them to encode the amino acid in our research.
GRANTHAM score
GRANTHAM score measures the differences of physicochemical properties between amino acids (
Grantham, 1974). Using it, we defined the feature of GRANTHAM score for each SAP that reflected the physicochemical difference between the original amino acid and changed amino acid.
One SAP includes 10 amino acids to encode: the original and changed amino acids of the SAP, the upstream 4 amino acids of the SAP and the downstream 4 amino acids of the SAP. Hence, each SAP has 1 betweenness, 214 KEGG enrichment scores, 5 × 10 = 50 AAFactors, 20 × 9 = 180 PSSM conservation scores, 9 disorder scores and 1 GRANTHAM score. In total, there were 455 features. By utilizing the concept of pseudo amino acid composition (PseAAC) (
Chou, 2001), a SAP
P can be generally formulated as vector with 455 components; i.e.,
where ψ1 represents the 1st feature of the SAP, ψ2 the 2nd feature, and so forth.
Predictor construction and evaluation
In this study, we used LiblieaR (
Fan et al., 2008) to classify the query SAP into disease SAP or polymorphism. LiblieaR is an R interface to LIBLINEAR, a C/C++ library for large linear classification (
Fan et al., 2008). LIBLINEAR not only has good theoretical properties, but also shows promising performance in practice (
Fan et al., 2008;
Hsieh et al., 2008;
Keerthi et al., 2008;
Lin et al., 2008). L2-regularized L2-loss support vector classification model (
Fan et al., 2008) in LiblieaR was applied to construct the predictor.
In statistical prediction, the following three cross-validation methods are often used to examine a predictor for its effectiveness in practical application: independent dataset test, subsampling test, and jackknife test (
Chou and Zhang, 1995). However, as elucidated in
Chou and Shen (2008) and demonstrated by Eqs.28-32 of
Chou (2011), among the three cross-validation methods, the jackknife test is deemed the least arbitrary (most objective) that can always yield a unique result for a given benchmark dataset, and hence has been increasingly used and widely recognized by investigators to examine the accuracy of various predictors (
Georgiou et al., 2009;
Zeng et al., 2009;
Esmaeili et al., 2010;
Mohabatkar, 2010;
Qiu et al., 2010;
Hu et al., 2011a,
2011b;
Huang et al., 2011a,
2011b;
Lin et al., 2011;
Wang et al., 2011;
Xiao et al., 2011). Accordingly, the jackknife test, also known as Leave-One-Out Cross-Validation (LOOCV) (
Huang et al., 2008;
Cai et al., 2010;
Huang et al., 2009,
2010a,
2010b) was adopted here to examine the quality of the present predictor. During LOOCV, each sample in the data set is used as test sample in turn and predicted by the model trained by the other samples. The sensitivity (Sn), specificity (Sp), accuracy (ACC) and Matthews’s correlation coefficient (MCC) (
Baldi et al., 2000) were calculated to measure the prediction performance:
where TP, TN, FP and FN stand for the number of true positive, true negative, false positive and false negative samples, respectively.
Web server implementation
To facilitate the disease associated SAPs prediction, we implemented an automated pipeline of our method and developed a web server interface. Tomcat/Apache served as a J2EE container for JSP. The prediction model was implemented with LiblineaR (http://cran.r-project.org/package=LiblineaR)—a package of R programming language (http://www.r-project.org/). The web server runs on Linux system, and works with both the Microsoft Internet Explorer and Mozilla Firefox browsers.
For the users who have a large number of SAPs to predict or want to set up the mirror website of SySAP, the code of SySAP can be downloaded and easily run in command line. They only need to install R programming environment and R package LiblineaR first. All the data needed for prediction were pre-computed and can be directly downloaded from our website to speed up the computation efficiency.
To use SySAP, only the basic information that defines the SAP was needed: the protein name, mutation position, old amino acid and new amino acid at the mutation position. The protein name should be UniProt accession number of human protein, such as P04637. The mutation position should be the position where the SAP occurs and should not exceed the length of protein sequence. The old amino acid is the original amino acid at the mutation position. The new amino acid is the changed amino acid after mutation. Both the old and new amino acids should be one of the 20 standard amino acids.
Based on the input information, SySAP can predict the query whether SAP is disease SAP or polymorphism. If the protein name is not UniProt accession number or the mutation position exceeds the length of protein sequence, or the old and new amino acid is not one of the 20 standard amino acids, the corresponding error information will be printed. So the user can correct their improper input and try again.
Higher Education Press and Springer-Verlag Berlin Heidelberg 2011