<title>Introduction</title> <p>Proteins existing in living organisms have been selected through the process of evolution. However, much of the amino acid variation between orthologues appears to be selectively neutral ##REF##5637732##[1]## as far as the whole organism is concerned and accepted amino acid substitutions result in equal fitness. It has been long understood that the rate and nature of accepted mutation or substitution is different for the 20 amino acids in a protein ##UREF##0##[2]##–##REF##11319253##[5]##. Indeed the different substitution rates and patterns for the 20 amino acids were first quantified by Margaret Dayhoff as the PAM (Percentile Accepted Mutation) matrix in 1970s ##UREF##0##[2]##, which measures the point mutation for every 100 amino acids. The methodology was further developed by Henikoff <italic>et al.</italic>
##REF##1438297##[3]## to reflect more divergent relationships of protein sequences. The BLOSUM62 is now recognized as a standard measure of substitution rate for the 20 amino acids in the sequence comparisons. Jones <italic>et al.</italic>
##REF##1633570##[4]## introduced a fast and automated approach based on a maximum parsimony counting method and Whelan <italic>et al.</italic>
##REF##11319253##[5]## applied a maximum-likelihood method to estimate the rate for amino acid replacement. All these substitution models are based on the sequence alignments of closely related protein families.</p> <p>Orthologous protein families (or superfamilies) are assumed to be diverged from a common ancestor by accepting mutations that are selectively neutral. The rate of evolution ##REF##5637732##[1]## is assumed to be constant over evolutionary time ##REF##5876245##[6]##,##UREF##1##[7]## and so evolutionary distances can be measured by analysing the substitutions of amino acids. The degree of conservation and the nature of substitutions of amino acids will be under many evolutionary restraints. One of those is dependent on the need to retain the protein tertiary structure and usually expressed as a tendency to maintain the local structural environments of individual amino acids ##REF##15364576##[8]##.</p> <p>The Environment Specific Substitution Table (ESST) is a substitution table that considers structural restraints in the calculation of substitution patterns. Overington <italic>et al.</italic>
##REF##1304904##[9]##,##REF##1978340##[10]## first calculated ESSTs from a set of homologous protein families whose three-dimensional structures were available. The rationale behind ESSTs is that the acceptance of substitution of an amino acid in an orthologous family is subject to its local tertiary environment. The local structural environments of amino acids include (1) main-chain conformation and secondary structure, (2) solvent accessibility, and (3) hydrogen bonding between side-chain and main-chain. 64 ESSTs can be derived from a combination of structural features; four from secondary structures (α-helix, β-strand, coil and residue with positive ϕ main-chain torsion angle), two from solvent accessibility (accessible and inaccessible), and eight (2<sup>3</sup>) from hydrogen bonds to main-chain carbonyl or amide or to another side-chain. These combinations of structural features restrict possible substitutions of an amino acid and give rise to distinct patterns of substitution.</p> <p>The ESST was improved and updated by Shi <italic>et al.</italic>
##REF##11419950##[11]## in 2001 by the use of the following features: (1) a clustering scheme to correct sampling bias, (2) a smoothing procedure to correct data sparsity, (3) using only high resolution structures in the alignments as a source of substitution matrices and (4) reduction of the bias caused by non-structural restraints. The last feature was designed to separate functional restraints from structural restraints when generating ESSTs. Because ESSTs take into account only structural environments, substitutions where the amino acids are conserved for functional reasons should not be counted in the calculation of matrices. Shi <italic>et al.</italic> took two kinds of functional residues into account to eliminate non-structural restraints which may cause a bias in the ESST. They were (1) residues involved in domain-domain interactions and (2) those interacting with ligand. Such residues were masked in the alignment files and were not taken into account in the substitution counts. However, the masking appeared to have very little impact on the performance of FUGUE ##REF##11419950##[11]##. Chelliah <italic>et al</italic>. ##REF##16193489##[12]## further developed ESSTs by introducing functional restraints, particularly in enzymes, on amino acid substitutions as a new environment in addition to 64 structural environments. They measured the Euclidean distance between every amino acid and the known functional residues and compared the degree of conservation in terms of the proximity with the functional residues. Their ESST, known as the function-dependent ESST, showed improvements in sequence to structure homology recognition.</p> <p>Compared with traditional substitution tables (PAM, BLOSUM) derived from sequence information only, ESSTs were shown to give more precise and discriminating measures of substitution probabilities ##REF##8182744##[13]##. ESSTs have been shown to be useful in applications to secondary structure prediction ##REF##8182744##[13]## and sequence-structure homology recognition ##REF##8515448##[14]##,##REF##9135128##[15]##. Recently, CRESCENDO ##REF##15364576##[8]## has been successful in prediction of functional residues by comparing the observed substitution patterns for amino acids which are under both functional and structural constrains with those that are predicted on the basis of structure alone.</p> <p>Here we investigate the impacts of various functional restraints on the conservation of amino acids in three-dimensional structures. The functional residues are divided into four categories. They are residues involved in (1) protein–protein interaction, (2) protein–nucleic acid interaction, (3) protein–ligand interaction, and (4) catalytic reaction at enzyme active sites. Such residues will be under greater pressure to be conserved throughout the evolution process where they remain critically important to the activity of protein and thus the selective advantage of the organism. We measure the degree of functional residue conservation by masking the locations in the alignment file and then discarding them in the calculation of substitution probabilities. The substitution models are compared with the non-masking model which counts those functional residues in the calculation of substitution probabilities. We measure relative contributions of four categories of functional residues by making several masking tables in combinatorial fashion. We test our substitution models by performing computational experiments using CRESCENDO ##REF##15364576##[8]## which is a program predicting functional residues from known three-dimensional structures of proteins and which should be more sensitive to the accuracy of the predicted substitution tables than FUGUE ##REF##11419950##[11]##. We show that our new ESST can find 16% more functional residues compared with the ESST of Shi <italic>et al.</italic>
##REF##11419950##[11]## for the same test-set. The new ESST is different from previous ones in that we cover a broader range of protein families, we take into account more three-dimensional structures and we consider a wider variety of functional residues which may bias amino acid substitution patterns.</p>
<title>Materials and Methods</title> <title>Structure Alignments</title> <p>New ESSTs were derived from the structure alignments of SCOP families ##REF##7723011##[19]##. Baton (D.F. Burke, unpublished, ##SUPPL##3##Table S4##), which is a successor of COMPARER ##REF##2200167##[26]##, was used as a structure alignment program. The domain boundary and classification scheme of protein families were adopted from SCOP 1.71 as of this writing. PDB ##REF##10592235##[27]## was used as a source for protein three-dimensional structures. SCOP class F, which contains membrane and cell surface proteins, was not included in the alignment process as their amino acids can be in environments which differ from those in the cytoplasm. Also, non-canonical SCOP classes, H, I, J, and K, which are coiled-coil proteins, low resolution protein structures, peptides, and designed proteins, respectively, were removed from the alignment sources.</p> <p>To guarantee the best alignment quality, the following three filtering conditions were applied. (1) Filtering by resolution: NMR structures and structures having resolution worse than 2.5 Å were not included in the alignment procedures. (2) Filtering by sequence identity: For each SCOP family, protein domains were clustered by running CD-HIT ##REF##16731699##[28]## with sequence identity of 80% or more. Within a cluster, a protein structure having the best resolution was selected as the representative. This is to remove any bias arising from the majority sequences of proteins in a SCOP family. (3) Filtering by sequence length: Within a SCOP family, the average sequence length is maintained by removing any domains having sequence below (1−0.3)*mean-length and above (1+0.3)*mean-length. Single member SCOP families were removed as they can not provide multiple alignments for the substitution calculation.</p> <title>Mapping UniProt and PDB at Residue Level</title> <p>To take advantage of UniProt annotations in terms of three-dimensional structures, we developed a mapping protocol, “double-map”, which aligns a sequence of UniProt with that of PDB at residue level. Three sequences are required for every PDB chain; 1) one from SEQRES record of a PDB file, 2) another from the residue (SEQ) in ATOM record of a PDB file, and 3) the third (SP) from the corresponding UniProt entry of a PDB chain. Double-map makes two alignments from the three sequences (so the name “double-map”). The first is an alignment between SEQ and SEQRES and the second is between SEQRES and SP. Using SEQRES as a reference, SP can be aligned with SEQ and the locations of UniProt residues can be mapped onto three-dimensional structures. Ideally, the alignment between SEQ and SP is enough to locate UniProt residues in PDB. However, residues in the sequence (SEQRES) can be absent and sometimes different from the coordinate section (SEQ) for various reasons (e.g., the position in space is undetermined) and this makes the direct alignment between SEQ and SP incomplete. Double-map uses two sequence alignment programs; EXONERATE ##REF##15713233##[29]## and BL2SEQ of NCBI blast package ##REF##9254694##[30]##. If EXONERATE fails to run for a short sequence around 10–15 amino acids, BL2SEQ succeeds to complete the alignment.</p> <title>Calculation of Substitutions and Distance of Substitution Table</title> <p>The program SUBST (<ext-link ext-link-type="uri" xlink:href="http://www-cryst.bioc.cam.ac.uk/kenji/subst">http://www-cryst.bioc.cam.ac.uk/kenji/subst</ext-link>), written by Dr Kenji Mizuguchi (unpublished software, ##SUPPL##3##Table S4##), was used in the calculation of substitution table. SUBST takes structural templates as inputs which can be generated by JOY ##REF##9730927##[31]##, a program to identify the local structural environments of amino acids in the structure alignment files. The Euclidean distance between two ESSTs, X and Y, (DIST(X·Y)) was calculated as; , where  and  is the probability of amino acid <italic>j</italic> to be substituted by <italic>k</italic> from the ESST of X and Y under the structure environment of <italic>i</italic>. Note that there are 64 structure environments (4*2*8 from the secondary structures, solvent accessibility and H-bonds, respectively) and 21 amino acids (Cysteine and half-cysteine using one-letter code J and C, respectively).</p> <title>Benchmarking</title> <p>CRESCENDO ##REF##15364576##[8]## was used to benchmark new ESSTs based on the predictions of four categories of functional residues: (1) catalytic residues of enzyme active sites, (2) residues involved in protein–protein interactions, (3) protein–nucleic acid interactions, and (4) protein–ligand interactions (see ##TAB##0##Table 1## for the source). The divergent score was used as it is more sensitive to the environments and it better discriminates functionally conserved residues from structurally conserved residues. The CRESCENDO scores (Z-score) were smoothed and contoured using Kin3Dcont ##UREF##2##[32]##. CRESCENDO returns several clusters of predicted residues based on the size of grid points contoured using the Z-score. Residues only in the first cluster were used as the predicted residues of functional residues in the analysis. The details of the equation can be found in the original paper ##REF##15364576##[8]##. The P-value of the predicted residues is calculated using a one-tailed test under the standard normal distribution.</p> <p>The performance ESSTs were assessed by measuring sensitivity (SENS), coverage (COV) and F-measure. These measurements were calculated based on the ratios derived from TP (true positives), FP (false positives), FN (false negatives), and TN (true negatives), which are defined as follow.
</p> <p>TP is the number of residues correctly predicted by CRESCENDO. If the residues predicted by CRESCENDO are the same as those annotated by the reference database, they are counted as being correct. FN is the number of real functional residues where CRESCENDO failed to predicted. FP is the number of false hits that CRESCENDO predicted as functional residues but not actually annotated by the references. TP, FP, FN, and TN are exclusively determined by the ESST used in CRESCENDO.</p> <p>The Spearman's rank correlation (<italic>ρ</italic>) was calculated as follows; , where <italic>d<sub>i</sub></italic> is the difference between each rank of corresponding values and <italic>n</italic> is the number of pairs of values.</p>
<title>Results/Discussion</title> <title>Locating Functional Residues in Three-Dimensional Structures</title> <p>Four categories of functional residues are considered in this study (##TAB##0##Table 1##). The first category of functional residues comprises catalytic residues of enzyme active sites, which are strongly conserved in orthologous families and often across superfamilies. CSA ##REF##14681376##[16]## and “ACT_SITE” records in UniProt ##REF##14681372##[17]## were used. The Catalytic Site Atlas (CSA) is a database of enzyme active sites and catalytic residues of enzymes whose 3D structures are available. It provides two types of entries: (1) original hand-annotated entries derived from the primary literature and (2) entries homologous to one of the original entries by sequence similarity. We took into account only the hand curated entries for reasons of reliability. The second category comprised amino acids involved in protein–protein interactions. Data concerning protein interactions were retrieved from InterPare ##REF##16122378##[18]## which is a database for interacting interfaces between protein domains. InterPare uses SCOP ##REF##7723011##[19]## as a domain definition and detects interacting domain pairs if there are at least five pairs of residues which fall within 5 Å distance between two adjacent domains. Residues interacting with nucleic acids comprise the third category. BIPA (S. Lee, unpublished) and “DNA_BIND” records in UniProt were used for this category. BIPA is a database for protein–nucleic acid interactions, which defines the atomic interactions using a distance threshold of 5 Å for van der Waals contacts, and HBPLUS ##REF##8182748##[20]## default options for hydrogen bonds and water mediated hydrogen bonds. The final category comprises the ligand-binding residues. For this information, the following UniProt feature annotations were used: “BINDING”, “METAL”, “NP_BIND”, and “CA_BIND” (see ##TAB##0##Table 1## for details).</p> <p>The data from InterPare, CSA and BIPA are based on three-dimensional structures of proteins. Hence, those functional residues can be easily identified and mapped into PDB entries using chain and residue numbers as unique identifiers. However, as the functional feature annotations from UniProt are based on sequence information, they are required to be mapped into their corresponding PDB entries. For this purpose, we developed a mapping protocol named “double-map” to align a sequence from UniProt with that of PDB at the residue level. This mapping protocol is critically important as we should find and mask the exact functional residues from the structural alignment. The detailed algorithm of double-map is described in <xref ref-type="sec" rid="s3">Material and Methods</xref>.</p> <title>Structure Alignments and New Environment Specific Substitution Table</title> <p>The new Environment Specific Substitution Table (ESST) was built based on the alignments of three-dimensional structures of proteins which belong to the same protein family. We used PDB as a source for the three-dimensional structures of proteins and SCOP as the definition of protein families and domains. SCOP version 1.71, which was used in this study, classifies 3004 families and 75930 domains from 27599 PDB entries. For each SCOP family, domains were clustered with sequence identity of 80% or more, after pre-processing the structure data (see <xref ref-type="sec" rid="s3">Materials and Methods</xref> for details). Within a cluster defined in this way, a structure having the best resolution was selected as a representative for the structure alignments. This process yielded 1187 SCOP families having 5833 domains from 4309 PDB entries. These final alignments, which are shown as “ALL” in the matrix type of ##TAB##1##Table 2##, were used as a source for the calculation of substitution tables.</p> <p>
##TAB##1##Table 2## shows 17 ESSTs and compares the numbers of structures and the functional residues masked from the alignments. There are four matrix types which differ in the alignment source; OLD, ENZ, NOENZ and ALL. “OLD” is based on the 177 HOMSTRAD families, from which the ESST of Shi <italic>et al.</italic>
##REF##11419950##[11]## was derived. “ENZ” is for the 221 enzyme-specific SCOP families whose members contain at least one “ACT_SITE” residue or CSA hand-curated entry. “NOENZ”, the opposite of “ENZ”, does not contain any “ACT_SITE” annotations or CSA entries at all. These two matrix types are prepared in order to assess the effect of alignment sources in the substitution patterns of amino acids. “ALL” is based on 1187 SCOP families described above. SCOP families that belong to ENZ and NOENZ are subsets of ALL type and do not overlap as they include different SCOP families. Each matrix type is further divided into several subtypes (A, B, C, and D) which differ in the masking sources of functional residues (see ##TAB##0##Table 1##). This is to investigate the effect of a specific category of functional residues by comparing the differences in the substitution patterns. For example, the effect of masking enzyme active sites can be measured by calculating the difference between two matrices D and X, because X does not mask any functional residues whereas D masks only active site residues. We made random-masking models (R), in order to assess the value of masking models in benchmarking the new ESSTs. Our new ESSTs mask more functional residues than the ESST (J) of Shi <italic>et al.</italic>, because our models take into account a broad range of structural families and functional residues. ESSTs and structure alignments in ##TAB##1##Table 2## are available from <ext-link ext-link-type="uri" xlink:href="http://www-cryst.bioc.cam.ac.uk/ESST">http://www-cryst.bioc.cam.ac.uk/ESST</ext-link>.</p> <title>Differences between Substitution Tables: The Effects of Alignment Source and Masking</title> <p>Our new ESSTs differ from those of Shi et al. ##REF##11419950##[11]## in the source of structure alignments and the categories (and the number) of functional residues removed from the alignments. The differences between 17 substitution tables were measured and investigated in terms of 1) the conservation probability of amino acids (P<sub>CONS</sub>) and 2) the distance (DIST) between ESSTs (see <xref ref-type="sec" rid="s3">Materials and Methods</xref>). We first looked at the different sources of structure alignments to assess their effects on the amino acid conservation in the substitution table. For this purpose, the non-masking models (X) from four alignment sources (OLD, ENZ, NOENZ and ALL) were compared. ##FIG##0##Figure 1A## plots the P<sub>CONS</sub> of 21 amino acids (P<sub>CONS</sub> in ##SUPPL##0##Table S1##). The conservation probability in the figure is averaged over the diagonal entries (i.e. those amino acids which are not substituted) from 64 ESSTs for each model. The overall degree of conservation is 28.93, 29.10, 32.08, and 36.73% for NOENZ, ALL, ENZ and OLD respectively (see ##SUPPL##0##Table S1## for details). All the amino acids in OLD-type are more conserved than those of ALL-type. We are aware that the number of structures and families in the alignment may affect the P<sub>CONS</sub>. In addition, the definition of protein families and domains of HOMSTRAD is more stringent than those of SCOP. This will make the sequences less divergent and the alignments more conserved. The distance of substitution tables (##SUPPL##1##Table S2##) shows that NOENZ and ENZ are the most distant (507) among four tables and NOENZ and ALL are the closest. This is clear as NOENZ and ENZ do not share nay families but all the families in NOENZ belong to ALL. ##FIG##0##Figure 1A## shows that amino acids R, K, H and S of ENZ-type are more conserved than those from NOENZ by 17, 14.2, 8.5 and 7%, respectively. However, C and W from ENZ are less conserved than those of NOENZ by 24% and 9%.</p> <p>
##FIG##0##Figure 1B## shows P<sub>CONS</sub> of amino acids from the same source of alignment (ENZ) but having different masking types (A, B, C and D), being compared with non-masking (X), random-masking (R) and ESST of Shi <italic>et al.</italic> (OLD-J). Overall, the differences of P<sub>CONS</sub> among the tables are less clear than the differences shown in ##FIG##0##Figure 1A##. In addition, ##SUPPL##1##Table S2## shows that the distances (DIST) between tables of different masking types, but having the same alignment source, are smaller than the distances of tables from the different alignment sources. This explains why the variations of P<sub>CONS</sub> and DIST between tables are more affected by the source of alignments than the masking sources. However, the relationship between P<sub>CONS</sub> (or DIST) and the number of masking residues (%Mask) could be clearly understood by the Spearman's rank correlation between two (see ##TAB##2##Table 3##). The more we mask functional residues (%Mask) from the alignments, the smaller P<sub>CONS</sub> gets and the greater the difference as measured by DIST between the substitution tables. We found that the correlation between P<sub>CONS</sub> and %Mask (−0.3) was not made more distinctive by removing residues involved in protein–protein interactions. A-type masks 13.4% and 16.9% many more residues than B-type in ENZ and ALL, respectively, where the discrepancies lie in the protein–protein interactions as B does not include InterPare as masking sources. However, the average P<sub>CONS</sub> of A is bigger than B, although A masks much more residues than B. This becomes much clearer on looking at the P<sub>CONS</sub> of A and D where the difference is in residues annotated as CSA and ACT_SITE. The P<sub>CONS</sub> of D is bigger than A, although D masks many fewer residues than A. The result shows that the residues involved in protein–protein (or domain-domain) interactions are not as conserved as residues responsible for the catalytic activity of enzymes. From P<sub>CONS</sub> of ENZ-D and ENZ-X (##SUPPL##0##Table S1##), which differ in active sites as masking source, we observe that active site residues J, D, H and E are most conserved throughout enzyme families, where H is the most abundant amino acid annotated as ACT_SITE or CSA followed by D, E, and J.</p> <title>Benchmarking Design</title> <p>The performance of the new ESSTs was benchmarked by using CRESCENDO ##REF##15364576##[8]##, which is a program for predicting functional residues given a three-dimensional structure. The rationale behind CRESCENDO is to distinguish functional restraints from structural restraints, both of which give rise to the conservation of amino acids in the evolutionary process. For example, amino acids in the core region of a protein are conserved or conservatively varied in order to maintain an appropriate structure (and ultimately function) whereas the catalytic triad of a protease, such as CYS-HIS-ASP, is conserved to maintain the functional properties of the enzyme family. CRESCENDO quantifies the degree of amino acid conservation by measuring (1) the observed value based on the alignment to which a queried protein sequence belongs and (2) the expected value calculated by using ESST. Note that the first value reflects both structural and functional restraints, whereas the latter only reflects the structural restraints because ESST, by definition, only takes structural environments into account. The overall difference between the two is converted into Z-score (or CRESCENDO score) which can represent extra restraints—probably functional—on the process of evolution. Hence, the more accurate the ESST, the less good the agreement between the probabilities of conservation observed and that predicted on the basis of the structure of the protein alone. CRESCENDO can be a good benchmarking tool for the evaluation of new ESSTs, because more functional residues are masked than the old ESST. In addition, we can identify relative contributions of four masking resources on the performance of ESSTs. The benchmarking was designed to investigate the following two questions. (1) How well can a new ESST identify functional residues compared with the ESST of Shi <italic>et al.</italic> which is used currently as the default by CRESCENDO? (2) If there is any improvement, what makes the improvement?</p> <p>From 221 enzyme-specific SCOP families for ENZ in ##TAB##1##Table 2##, one third (73 SCOP families) was selected as a test-set and the rest were used to make benchmarking-ESSTs for ENZ. The test-set consists of 339 SCOP domains having 81,410 residues in total. Out of 81,410 residues, 602 residues are active sites (ACT_SITE or CSA), 11,917 residues are annotated by InterPare, 194 residues for nucleic-acid interactions and 1,348 residues are involved with ligand interactions. They are the true functional residues that we are trying to predict using CRESCENDO in order to evaluate the performance of our new ESST. In our analysis we took only the first cluster as the predicted residues. The performance of our new ESST was compared with that of the old in terms of detecting functional residues. Note that, for both ENZ and ALL types, the 73 SCOP families in the test-set were removed from the original ESST. The benchmarking ESSTs were renamed as At, Bt, Ct, Dt, Rt, and Xt to distinguish them from the original new ESSTs which are A, B, C, D, R, and X, respectively. This is in order to make our benchmarking an unbiased blind test by removing sequences in the test-set which might affect the benchmarking results. In the case of OLD and NOENZ, the original masking types were used in the benchmarking process as they do not contain SCOP families in the test-sets. The test-sets and benchmark results are accessible from <ext-link ext-link-type="uri" xlink:href="http://www-cryst.bioc.cam.ac.uk/ESST">http://www-cryst.bioc.cam.ac.uk/ESST</ext-link>.</p> <title>Performance of New ESSTs in Detecting Functional Residues</title> <p>
##TAB##3##Table 4## shows the average Z-score of CRESCENDO for 602 active sites, 11,917 PPI residues, 194 residues for protein–nucleic acid interactions (PNI) and 1348 residues responsible for interaction with ligands (PLI) along with the P-values for the predicted residues. The P-value demonstrates that the Z-score of the predicted residues is different from the randomly selected residues with a 0.09 level of significance. In other words, we can say that the predicted residues of CRESCENDO are far from the random within 0.09 error rate. The Z-scores for all the residues (81,410) in the test-sets are compared with those of functional residues predicted by CRESCENDO. The average Z-score of all the residues is near zero, regardless of masking types, which means there are no differences between the probabilities of residue conservations observed in the alignments and those predicted by ESST. However, the Z-scores for 602 active sites range between 0.48 and 0.93 depending on the matrix types and the masking sources. This observation suggests there are extra restraints which make the active sites more conserved in families of homologous proteins. The Z-scores of 1,348 PLI (Protein–Ligand Interaction, see ##TAB##3##Table 4##) residues also imply that they are under extra restraints other than structural reasons. On the other hand, the average Z-scores for PPI and PNI residues are much smaller than that of 602 active sites. This may suggest that residues at protein–protein interfaces are under less strong restraints than residues responsible for the catalytic activity. However, there is strong evidence that sub-regions in protein interfaces—so called hot spots—are energetically more important and may be under stronger restraints in evolution ##REF##9653027##[21]##,##REF##16221766##[22]##.</p> <p>In ##TAB##4##Table 5##, the performance of 17 ESSTs is compared in terms of recognizing 602 active-site residues. SENS, SPEC and COV were measured using the ratios of TP (true positive), FP (false positive), FN (false negative) and TN (true negative) (see <xref ref-type="sec" rid="s3">Material and Methods</xref> for the definitions). The Z-score and SENS are plotted together in ##FIG##1##Figure 2##; they are highly correlated having 0.95 Spearman's rank correlation score (##TAB##2##Table 3##). As shown in ##FIG##1##Figure 2##, the average Z-scores and SENS of non-masking (X) and random-masking (R) models are always less than those from masking-models (A, B, C, and D) within the same matrix type. This clearly shows that the position of masking is significant and discarding the substitution counts of functional residues from the substitution table can increase the performance of CRESCENDO by making ESST less dependent on the substitution patterns of the residues under functional restraints. This result is clearer from the rank correlation (0.45) between %Mask and SENS in ##TAB##2##Table 3##. In addition, our new masking models (A, B, C and D) outperform the ESST of Shi <italic>et al.</italic> (J) and even the non-masking model (ENZ-X, NOENZ-X and ALL-X) outperform J (see ##FIG##1##Figure 2## and ##TAB##4##Table 5##). This can be explained in terms of P<sub>CONS</sub> and SENS; the average P<sub>CONS</sub> is highest in the order of J, followed by ENZ-X, ALL-X and NOENZ-X, but the performance (SENS) is exactly the reverse order of P<sub>CONS</sub>. ##FIG##2##Figure 3A## shows an example of predicting active sites of a SCOP domain d1evua4 (a domain in the A chain of PDB 1evu, ##REF##9988734##[23]##) which is a cysteine proteinase containing three active site residues annotated by UniProt. Three active site residues (CYS-314, HIS-373 and ASP-396) could be identified only by ALL-type ESSTs (ALL-B and ALL-C) which are highly ranked in ##FIG##1##Figure 2##. This is probably because P<sub>CONS</sub> of ALL is lower than that of ENZ and OLD for the local environments of the three catalytic residues.</p> <p>
##TAB##5##Table 6## shows the recognition performance for 11,917 PPI residues with the same measurements (TP, FP, FN, and TN) in ##TAB##4##Table 5##. Four masking substitution tables of ALL-matrix could detect more PPI residues than that of Shi <italic>et al.</italic> (J), but not all tables in ENZ-matrix outperform J. Regardless of matrix types and masking types, the sensitivity (SENS) of detecting PPI residues is much lower than those for detecting active site residues. We think that this arises from the average Z-score for PPI residues (see ##TAB##3##Table 4##) which is close to zero, suggesting less strong evidence for extra restraints. ##FIG##2##Figure 3B## shows an example of predicting PPI residues of a SCOP domain d1i7kb_ (B chain of PDB 1i7k, ##REF##11927573##[24]##) which is a ubiquitin conjugating (UBC) enzyme containing 14 residues interfacing with the A chain. Using ALL-A, CRESCENDO predicted 12 residues of which five were correct PPI residues (true positive, coloured in pink in ##FIG##2##Figure 3B##). Among the nine missing residues (orange), PRO-30, SER-87, TYR-91, GLU-120 and LYS-121 were highly accessible (more than 50 Å<sup>2</sup>) to solvent in the complex whereas five true positives had relatively small solvent accessible area (see ##FIG##2##Figure 3B## for details). Thus, as expected, residues within the protein–protein interaction interface which are partially accessible are less conserved and more difficult to identify by CRESCENDO. ##SUPPL##2##Table S3## contains benchmark results for detecting residues interacting with nucleic acids and ligands. The sensitivity is better than the benchmarking results of recognizing PPI residues but still less than that of detecting active site residues. ##FIG##2##Figure 3C and 3D## show examples of predicting residues interacting with nucleic-acids and ligands, respectively (see ##FIG##2##Figure 3## for details).</p> <title>The Effect of Discarding Residues Involved in the Protein–Protein Interactions</title> <p>We found that the number of functional residues masked and discarded (%Mask) from the substitution table does not always guarantee the best performance (SENS) of ESST in detecting functional sites using CRESCENDO. The rank correlation between %Mask and SENS is 0.45 (see ##TAB##2##Table 3##). Hence, it is very evident that masking-models outperform non-masking and the ESST of Shi <italic>et al.</italic> as described above. However the category of functional residues does matter and affects the performance. ##FIG##1##Figure 2## shows the performance of 17 ESSTs on the predictions of 602 active sites of the test-sets. Regardless of the alignment source, the performance (Z-score and SENS) of table B (no-PPI mask) is always better than table A (all mask), which means discarding PPI residues is not effective in the recognition performance of enzyme's active sites. In addition, OLD-B also outperforms OLD-J by 5% in the sensitivity, where the difference lies in the PPI residues as well. However, in the case of recognizing PPI residues, table A of ALL-matrix outperforms table B by 5.2% in terms of TP (##TAB##5##Table 6##). Interestingly, table C, which does not mask active sites, ranked as second highest and the performance of table D, which masks only active sites, is worse than the random-masking (R) substitution table (see ##TAB##5##Table 6##). This result indicates that discarding PPI residues can increase the recognition performance of PPI residues but does not improve predictions of active sites of enzymes. This observation probably arises from the fact that the interfacial interactions differ in nature from those residues in catalytic sites and therefore masking of catalytic residues has little impact on those in interfaces.</p> <title>Concluding Remarks</title> <p>We have shown that discarding functional residues from the calculation of the substitution table improves the detection of functional residues when the new substitution table is used with CRESCENDO. We considered four categories of functional residues in this study (##TAB##0##Table 1##) and found that functional residues can be best predicted when the relevant category is discarded from the calculation of the substitution table. Our new masking models outperformed non-masking, random masking and the old ESST (Shi <italic>et al.</italic>, ##REF##11419950##[11]##) not only in terms of true positives but also sensitivity. However, as shown in ##TAB##4##Tables 5## and ##TAB##5##6##, false positives (FPs) and false negatives (FNs) are relatively high compared with the number of true positives (TPs). The reason for high FPs is expected to arise from the restricted definition of functional residues. As shown in ##FIG##2##Figure 3A##, FPs, coloured in green, are clustered around the catalytic triad (CYS-HIS-ASP) of the cysteine protease shown here. Some of these residues will be important for the local architecture of the active site and may even be buried; the substitutions accepted at these positions will therefore be restrained. Others will be directly involved in binding and positioning the substrate for catalysis. We have previously shown that CRESCENDO identifies such residues in predicting the active site ##REF##15364576##[8]##. Furthermore we have shown that the degree of residue conservation is significantly higher the closer the residues are to the active site and that geometrical proximity to the known active sites can be considered to constitute a new environment of ESST ##REF##16193489##[12]##. A reason for some high FNs is that we took only the first cluster predicted by CRESCENDO into account as positive results in the benchmark analysis; however CRESCENDO is expected to predict all regions under functional restraints and occasionally those critical for protein interactions, allostery, metal binding, post-translational modification and so on will be as conserved and score as high or higher than the active site residues. In addition, the annotations of functional residues might not be complete, which makes both FPs and FNs relatively high.</p> <p>Other than CRESCENDO, there are several computational approaches to detecting possible functional regions of a protein in a fast and low-cost manner. Among them, the Evolutionary Trace method (ET), introduced by Lichtarge <italic>et al.</italic>
##REF##8609628##[25]## in 1996, is widely used and very successful in identifying functional regions, for example of SH2, SH3, and DNA binding domains. ET differs from CRESCENDO in that it identifies conserved residues only on the protein surface and exploits the use of a phylogenetic tree to identify local patterns of conservation unique but distinct amongst different branches which constitute protein subfamilies. Hence, the performance of ET highly depends on the quality of a phylogenetic tree which is determined by a set of sequences to which a query protein belongs. If the set of sequences were recently diverged, the branch-specific conservation could not be detected because the substitutions were not accumulated enough to construct a reasonable phylogenetic tree. CRESCENDO does not explicitly use the phylogenetic tree (although it could well do so), but will also not work well if the degree of divergence is low. It will, however, gain from local conservation of buried residues in the active site, for example the threonine of the aspartic proteinase catalytic triad. It also gains from a careful definition of the expected substitution patterns in any local environment and for this the proper treatment of functional residues when deriving substitution tables is of critical importance.</p>
<title>Results/Discussion</title> <title>Locating Functional Residues in Three-Dimensional Structures</title> <p>Four categories of functional residues are considered in this study (##TAB##0##Table 1##). The first category of functional residues comprises catalytic residues of enzyme active sites, which are strongly conserved in orthologous families and often across superfamilies. CSA ##REF##14681376##[16]## and “ACT_SITE” records in UniProt ##REF##14681372##[17]## were used. The Catalytic Site Atlas (CSA) is a database of enzyme active sites and catalytic residues of enzymes whose 3D structures are available. It provides two types of entries: (1) original hand-annotated entries derived from the primary literature and (2) entries homologous to one of the original entries by sequence similarity. We took into account only the hand curated entries for reasons of reliability. The second category comprised amino acids involved in protein–protein interactions. Data concerning protein interactions were retrieved from InterPare ##REF##16122378##[18]## which is a database for interacting interfaces between protein domains. InterPare uses SCOP ##REF##7723011##[19]## as a domain definition and detects interacting domain pairs if there are at least five pairs of residues which fall within 5 Å distance between two adjacent domains. Residues interacting with nucleic acids comprise the third category. BIPA (S. Lee, unpublished) and “DNA_BIND” records in UniProt were used for this category. BIPA is a database for protein–nucleic acid interactions, which defines the atomic interactions using a distance threshold of 5 Å for van der Waals contacts, and HBPLUS ##REF##8182748##[20]## default options for hydrogen bonds and water mediated hydrogen bonds. The final category comprises the ligand-binding residues. For this information, the following UniProt feature annotations were used: “BINDING”, “METAL”, “NP_BIND”, and “CA_BIND” (see ##TAB##0##Table 1## for details).</p> <p>The data from InterPare, CSA and BIPA are based on three-dimensional structures of proteins. Hence, those functional residues can be easily identified and mapped into PDB entries using chain and residue numbers as unique identifiers. However, as the functional feature annotations from UniProt are based on sequence information, they are required to be mapped into their corresponding PDB entries. For this purpose, we developed a mapping protocol named “double-map” to align a sequence from UniProt with that of PDB at the residue level. This mapping protocol is critically important as we should find and mask the exact functional residues from the structural alignment. The detailed algorithm of double-map is described in <xref ref-type="sec" rid="s3">Material and Methods</xref>.</p> <title>Structure Alignments and New Environment Specific Substitution Table</title> <p>The new Environment Specific Substitution Table (ESST) was built based on the alignments of three-dimensional structures of proteins which belong to the same protein family. We used PDB as a source for the three-dimensional structures of proteins and SCOP as the definition of protein families and domains. SCOP version 1.71, which was used in this study, classifies 3004 families and 75930 domains from 27599 PDB entries. For each SCOP family, domains were clustered with sequence identity of 80% or more, after pre-processing the structure data (see <xref ref-type="sec" rid="s3">Materials and Methods</xref> for details). Within a cluster defined in this way, a structure having the best resolution was selected as a representative for the structure alignments. This process yielded 1187 SCOP families having 5833 domains from 4309 PDB entries. These final alignments, which are shown as “ALL” in the matrix type of ##TAB##1##Table 2##, were used as a source for the calculation of substitution tables.</p> <p>
##TAB##1##Table 2## shows 17 ESSTs and compares the numbers of structures and the functional residues masked from the alignments. There are four matrix types which differ in the alignment source; OLD, ENZ, NOENZ and ALL. “OLD” is based on the 177 HOMSTRAD families, from which the ESST of Shi <italic>et al.</italic>
##REF##11419950##[11]## was derived. “ENZ” is for the 221 enzyme-specific SCOP families whose members contain at least one “ACT_SITE” residue or CSA hand-curated entry. “NOENZ”, the opposite of “ENZ”, does not contain any “ACT_SITE” annotations or CSA entries at all. These two matrix types are prepared in order to assess the effect of alignment sources in the substitution patterns of amino acids. “ALL” is based on 1187 SCOP families described above. SCOP families that belong to ENZ and NOENZ are subsets of ALL type and do not overlap as they include different SCOP families. Each matrix type is further divided into several subtypes (A, B, C, and D) which differ in the masking sources of functional residues (see ##TAB##0##Table 1##). This is to investigate the effect of a specific category of functional residues by comparing the differences in the substitution patterns. For example, the effect of masking enzyme active sites can be measured by calculating the difference between two matrices D and X, because X does not mask any functional residues whereas D masks only active site residues. We made random-masking models (R), in order to assess the value of masking models in benchmarking the new ESSTs. Our new ESSTs mask more functional residues than the ESST (J) of Shi <italic>et al.</italic>, because our models take into account a broad range of structural families and functional residues. ESSTs and structure alignments in ##TAB##1##Table 2## are available from <ext-link ext-link-type="uri" xlink:href="http://www-cryst.bioc.cam.ac.uk/ESST">http://www-cryst.bioc.cam.ac.uk/ESST</ext-link>.</p> <title>Differences between Substitution Tables: The Effects of Alignment Source and Masking</title> <p>Our new ESSTs differ from those of Shi et al. ##REF##11419950##[11]## in the source of structure alignments and the categories (and the number) of functional residues removed from the alignments. The differences between 17 substitution tables were measured and investigated in terms of 1) the conservation probability of amino acids (P<sub>CONS</sub>) and 2) the distance (DIST) between ESSTs (see <xref ref-type="sec" rid="s3">Materials and Methods</xref>). We first looked at the different sources of structure alignments to assess their effects on the amino acid conservation in the substitution table. For this purpose, the non-masking models (X) from four alignment sources (OLD, ENZ, NOENZ and ALL) were compared. ##FIG##0##Figure 1A## plots the P<sub>CONS</sub> of 21 amino acids (P<sub>CONS</sub> in ##SUPPL##0##Table S1##). The conservation probability in the figure is averaged over the diagonal entries (i.e. those amino acids which are not substituted) from 64 ESSTs for each model. The overall degree of conservation is 28.93, 29.10, 32.08, and 36.73% for NOENZ, ALL, ENZ and OLD respectively (see ##SUPPL##0##Table S1## for details). All the amino acids in OLD-type are more conserved than those of ALL-type. We are aware that the number of structures and families in the alignment may affect the P<sub>CONS</sub>. In addition, the definition of protein families and domains of HOMSTRAD is more stringent than those of SCOP. This will make the sequences less divergent and the alignments more conserved. The distance of substitution tables (##SUPPL##1##Table S2##) shows that NOENZ and ENZ are the most distant (507) among four tables and NOENZ and ALL are the closest. This is clear as NOENZ and ENZ do not share nay families but all the families in NOENZ belong to ALL. ##FIG##0##Figure 1A## shows that amino acids R, K, H and S of ENZ-type are more conserved than those from NOENZ by 17, 14.2, 8.5 and 7%, respectively. However, C and W from ENZ are less conserved than those of NOENZ by 24% and 9%.</p> <p>
##FIG##0##Figure 1B## shows P<sub>CONS</sub> of amino acids from the same source of alignment (ENZ) but having different masking types (A, B, C and D), being compared with non-masking (X), random-masking (R) and ESST of Shi <italic>et al.</italic> (OLD-J). Overall, the differences of P<sub>CONS</sub> among the tables are less clear than the differences shown in ##FIG##0##Figure 1A##. In addition, ##SUPPL##1##Table S2## shows that the distances (DIST) between tables of different masking types, but having the same alignment source, are smaller than the distances of tables from the different alignment sources. This explains why the variations of P<sub>CONS</sub> and DIST between tables are more affected by the source of alignments than the masking sources. However, the relationship between P<sub>CONS</sub> (or DIST) and the number of masking residues (%Mask) could be clearly understood by the Spearman's rank correlation between two (see ##TAB##2##Table 3##). The more we mask functional residues (%Mask) from the alignments, the smaller P<sub>CONS</sub> gets and the greater the difference as measured by DIST between the substitution tables. We found that the correlation between P<sub>CONS</sub> and %Mask (−0.3) was not made more distinctive by removing residues involved in protein–protein interactions. A-type masks 13.4% and 16.9% many more residues than B-type in ENZ and ALL, respectively, where the discrepancies lie in the protein–protein interactions as B does not include InterPare as masking sources. However, the average P<sub>CONS</sub> of A is bigger than B, although A masks much more residues than B. This becomes much clearer on looking at the P<sub>CONS</sub> of A and D where the difference is in residues annotated as CSA and ACT_SITE. The P<sub>CONS</sub> of D is bigger than A, although D masks many fewer residues than A. The result shows that the residues involved in protein–protein (or domain-domain) interactions are not as conserved as residues responsible for the catalytic activity of enzymes. From P<sub>CONS</sub> of ENZ-D and ENZ-X (##SUPPL##0##Table S1##), which differ in active sites as masking source, we observe that active site residues J, D, H and E are most conserved throughout enzyme families, where H is the most abundant amino acid annotated as ACT_SITE or CSA followed by D, E, and J.</p> <title>Benchmarking Design</title> <p>The performance of the new ESSTs was benchmarked by using CRESCENDO ##REF##15364576##[8]##, which is a program for predicting functional residues given a three-dimensional structure. The rationale behind CRESCENDO is to distinguish functional restraints from structural restraints, both of which give rise to the conservation of amino acids in the evolutionary process. For example, amino acids in the core region of a protein are conserved or conservatively varied in order to maintain an appropriate structure (and ultimately function) whereas the catalytic triad of a protease, such as CYS-HIS-ASP, is conserved to maintain the functional properties of the enzyme family. CRESCENDO quantifies the degree of amino acid conservation by measuring (1) the observed value based on the alignment to which a queried protein sequence belongs and (2) the expected value calculated by using ESST. Note that the first value reflects both structural and functional restraints, whereas the latter only reflects the structural restraints because ESST, by definition, only takes structural environments into account. The overall difference between the two is converted into Z-score (or CRESCENDO score) which can represent extra restraints—probably functional—on the process of evolution. Hence, the more accurate the ESST, the less good the agreement between the probabilities of conservation observed and that predicted on the basis of the structure of the protein alone. CRESCENDO can be a good benchmarking tool for the evaluation of new ESSTs, because more functional residues are masked than the old ESST. In addition, we can identify relative contributions of four masking resources on the performance of ESSTs. The benchmarking was designed to investigate the following two questions. (1) How well can a new ESST identify functional residues compared with the ESST of Shi <italic>et al.</italic> which is used currently as the default by CRESCENDO? (2) If there is any improvement, what makes the improvement?</p> <p>From 221 enzyme-specific SCOP families for ENZ in ##TAB##1##Table 2##, one third (73 SCOP families) was selected as a test-set and the rest were used to make benchmarking-ESSTs for ENZ. The test-set consists of 339 SCOP domains having 81,410 residues in total. Out of 81,410 residues, 602 residues are active sites (ACT_SITE or CSA), 11,917 residues are annotated by InterPare, 194 residues for nucleic-acid interactions and 1,348 residues are involved with ligand interactions. They are the true functional residues that we are trying to predict using CRESCENDO in order to evaluate the performance of our new ESST. In our analysis we took only the first cluster as the predicted residues. The performance of our new ESST was compared with that of the old in terms of detecting functional residues. Note that, for both ENZ and ALL types, the 73 SCOP families in the test-set were removed from the original ESST. The benchmarking ESSTs were renamed as At, Bt, Ct, Dt, Rt, and Xt to distinguish them from the original new ESSTs which are A, B, C, D, R, and X, respectively. This is in order to make our benchmarking an unbiased blind test by removing sequences in the test-set which might affect the benchmarking results. In the case of OLD and NOENZ, the original masking types were used in the benchmarking process as they do not contain SCOP families in the test-sets. The test-sets and benchmark results are accessible from <ext-link ext-link-type="uri" xlink:href="http://www-cryst.bioc.cam.ac.uk/ESST">http://www-cryst.bioc.cam.ac.uk/ESST</ext-link>.</p> <title>Performance of New ESSTs in Detecting Functional Residues</title> <p>
##TAB##3##Table 4## shows the average Z-score of CRESCENDO for 602 active sites, 11,917 PPI residues, 194 residues for protein–nucleic acid interactions (PNI) and 1348 residues responsible for interaction with ligands (PLI) along with the P-values for the predicted residues. The P-value demonstrates that the Z-score of the predicted residues is different from the randomly selected residues with a 0.09 level of significance. In other words, we can say that the predicted residues of CRESCENDO are far from the random within 0.09 error rate. The Z-scores for all the residues (81,410) in the test-sets are compared with those of functional residues predicted by CRESCENDO. The average Z-score of all the residues is near zero, regardless of masking types, which means there are no differences between the probabilities of residue conservations observed in the alignments and those predicted by ESST. However, the Z-scores for 602 active sites range between 0.48 and 0.93 depending on the matrix types and the masking sources. This observation suggests there are extra restraints which make the active sites more conserved in families of homologous proteins. The Z-scores of 1,348 PLI (Protein–Ligand Interaction, see ##TAB##3##Table 4##) residues also imply that they are under extra restraints other than structural reasons. On the other hand, the average Z-scores for PPI and PNI residues are much smaller than that of 602 active sites. This may suggest that residues at protein–protein interfaces are under less strong restraints than residues responsible for the catalytic activity. However, there is strong evidence that sub-regions in protein interfaces—so called hot spots—are energetically more important and may be under stronger restraints in evolution ##REF##9653027##[21]##,##REF##16221766##[22]##.</p> <p>In ##TAB##4##Table 5##, the performance of 17 ESSTs is compared in terms of recognizing 602 active-site residues. SENS, SPEC and COV were measured using the ratios of TP (true positive), FP (false positive), FN (false negative) and TN (true negative) (see <xref ref-type="sec" rid="s3">Material and Methods</xref> for the definitions). The Z-score and SENS are plotted together in ##FIG##1##Figure 2##; they are highly correlated having 0.95 Spearman's rank correlation score (##TAB##2##Table 3##). As shown in ##FIG##1##Figure 2##, the average Z-scores and SENS of non-masking (X) and random-masking (R) models are always less than those from masking-models (A, B, C, and D) within the same matrix type. This clearly shows that the position of masking is significant and discarding the substitution counts of functional residues from the substitution table can increase the performance of CRESCENDO by making ESST less dependent on the substitution patterns of the residues under functional restraints. This result is clearer from the rank correlation (0.45) between %Mask and SENS in ##TAB##2##Table 3##. In addition, our new masking models (A, B, C and D) outperform the ESST of Shi <italic>et al.</italic> (J) and even the non-masking model (ENZ-X, NOENZ-X and ALL-X) outperform J (see ##FIG##1##Figure 2## and ##TAB##4##Table 5##). This can be explained in terms of P<sub>CONS</sub> and SENS; the average P<sub>CONS</sub> is highest in the order of J, followed by ENZ-X, ALL-X and NOENZ-X, but the performance (SENS) is exactly the reverse order of P<sub>CONS</sub>. ##FIG##2##Figure 3A## shows an example of predicting active sites of a SCOP domain d1evua4 (a domain in the A chain of PDB 1evu, ##REF##9988734##[23]##) which is a cysteine proteinase containing three active site residues annotated by UniProt. Three active site residues (CYS-314, HIS-373 and ASP-396) could be identified only by ALL-type ESSTs (ALL-B and ALL-C) which are highly ranked in ##FIG##1##Figure 2##. This is probably because P<sub>CONS</sub> of ALL is lower than that of ENZ and OLD for the local environments of the three catalytic residues.</p> <p>
##TAB##5##Table 6## shows the recognition performance for 11,917 PPI residues with the same measurements (TP, FP, FN, and TN) in ##TAB##4##Table 5##. Four masking substitution tables of ALL-matrix could detect more PPI residues than that of Shi <italic>et al.</italic> (J), but not all tables in ENZ-matrix outperform J. Regardless of matrix types and masking types, the sensitivity (SENS) of detecting PPI residues is much lower than those for detecting active site residues. We think that this arises from the average Z-score for PPI residues (see ##TAB##3##Table 4##) which is close to zero, suggesting less strong evidence for extra restraints. ##FIG##2##Figure 3B## shows an example of predicting PPI residues of a SCOP domain d1i7kb_ (B chain of PDB 1i7k, ##REF##11927573##[24]##) which is a ubiquitin conjugating (UBC) enzyme containing 14 residues interfacing with the A chain. Using ALL-A, CRESCENDO predicted 12 residues of which five were correct PPI residues (true positive, coloured in pink in ##FIG##2##Figure 3B##). Among the nine missing residues (orange), PRO-30, SER-87, TYR-91, GLU-120 and LYS-121 were highly accessible (more than 50 Å<sup>2</sup>) to solvent in the complex whereas five true positives had relatively small solvent accessible area (see ##FIG##2##Figure 3B## for details). Thus, as expected, residues within the protein–protein interaction interface which are partially accessible are less conserved and more difficult to identify by CRESCENDO. ##SUPPL##2##Table S3## contains benchmark results for detecting residues interacting with nucleic acids and ligands. The sensitivity is better than the benchmarking results of recognizing PPI residues but still less than that of detecting active site residues. ##FIG##2##Figure 3C and 3D## show examples of predicting residues interacting with nucleic-acids and ligands, respectively (see ##FIG##2##Figure 3## for details).</p> <title>The Effect of Discarding Residues Involved in the Protein–Protein Interactions</title> <p>We found that the number of functional residues masked and discarded (%Mask) from the substitution table does not always guarantee the best performance (SENS) of ESST in detecting functional sites using CRESCENDO. The rank correlation between %Mask and SENS is 0.45 (see ##TAB##2##Table 3##). Hence, it is very evident that masking-models outperform non-masking and the ESST of Shi <italic>et al.</italic> as described above. However the category of functional residues does matter and affects the performance. ##FIG##1##Figure 2## shows the performance of 17 ESSTs on the predictions of 602 active sites of the test-sets. Regardless of the alignment source, the performance (Z-score and SENS) of table B (no-PPI mask) is always better than table A (all mask), which means discarding PPI residues is not effective in the recognition performance of enzyme's active sites. In addition, OLD-B also outperforms OLD-J by 5% in the sensitivity, where the difference lies in the PPI residues as well. However, in the case of recognizing PPI residues, table A of ALL-matrix outperforms table B by 5.2% in terms of TP (##TAB##5##Table 6##). Interestingly, table C, which does not mask active sites, ranked as second highest and the performance of table D, which masks only active sites, is worse than the random-masking (R) substitution table (see ##TAB##5##Table 6##). This result indicates that discarding PPI residues can increase the recognition performance of PPI residues but does not improve predictions of active sites of enzymes. This observation probably arises from the fact that the interfacial interactions differ in nature from those residues in catalytic sites and therefore masking of catalytic residues has little impact on those in interfaces.</p> <title>Concluding Remarks</title> <p>We have shown that discarding functional residues from the calculation of the substitution table improves the detection of functional residues when the new substitution table is used with CRESCENDO. We considered four categories of functional residues in this study (##TAB##0##Table 1##) and found that functional residues can be best predicted when the relevant category is discarded from the calculation of the substitution table. Our new masking models outperformed non-masking, random masking and the old ESST (Shi <italic>et al.</italic>, ##REF##11419950##[11]##) not only in terms of true positives but also sensitivity. However, as shown in ##TAB##4##Tables 5## and ##TAB##5##6##, false positives (FPs) and false negatives (FNs) are relatively high compared with the number of true positives (TPs). The reason for high FPs is expected to arise from the restricted definition of functional residues. As shown in ##FIG##2##Figure 3A##, FPs, coloured in green, are clustered around the catalytic triad (CYS-HIS-ASP) of the cysteine protease shown here. Some of these residues will be important for the local architecture of the active site and may even be buried; the substitutions accepted at these positions will therefore be restrained. Others will be directly involved in binding and positioning the substrate for catalysis. We have previously shown that CRESCENDO identifies such residues in predicting the active site ##REF##15364576##[8]##. Furthermore we have shown that the degree of residue conservation is significantly higher the closer the residues are to the active site and that geometrical proximity to the known active sites can be considered to constitute a new environment of ESST ##REF##16193489##[12]##. A reason for some high FNs is that we took only the first cluster predicted by CRESCENDO into account as positive results in the benchmark analysis; however CRESCENDO is expected to predict all regions under functional restraints and occasionally those critical for protein interactions, allostery, metal binding, post-translational modification and so on will be as conserved and score as high or higher than the active site residues. In addition, the annotations of functional residues might not be complete, which makes both FPs and FNs relatively high.</p> <p>Other than CRESCENDO, there are several computational approaches to detecting possible functional regions of a protein in a fast and low-cost manner. Among them, the Evolutionary Trace method (ET), introduced by Lichtarge <italic>et al.</italic>
##REF##8609628##[25]## in 1996, is widely used and very successful in identifying functional regions, for example of SH2, SH3, and DNA binding domains. ET differs from CRESCENDO in that it identifies conserved residues only on the protein surface and exploits the use of a phylogenetic tree to identify local patterns of conservation unique but distinct amongst different branches which constitute protein subfamilies. Hence, the performance of ET highly depends on the quality of a phylogenetic tree which is determined by a set of sequences to which a query protein belongs. If the set of sequences were recently diverged, the branch-specific conservation could not be detected because the substitutions were not accumulated enough to construct a reasonable phylogenetic tree. CRESCENDO does not explicitly use the phylogenetic tree (although it could well do so), but will also not work well if the degree of divergence is low. It will, however, gain from local conservation of buried residues in the active site, for example the threonine of the aspartic proteinase catalytic triad. It also gains from a careful definition of the expected substitution patterns in any local environment and for this the proper treatment of functional residues when deriving substitution tables is of critical importance.</p>
<p>Conceived and designed the experiments: SG TLB. Performed the experiments: SG. Analyzed the data: SG TLB. Wrote the paper: SG TLB.</p> <p>Substitutions of individual amino acids in proteins may be under very different evolutionary restraints depending on their structural and functional roles. The Environment Specific Substitution Table (ESST) describes the pattern of substitutions in terms of amino acid location within elements of secondary structure, solvent accessibility, and the existence of hydrogen bonds between side chains and neighbouring amino acid residues. Clearly amino acids that have very different local environments in their functional state compared to those in the protein analysed will give rise to inconsistencies in the calculation of amino acid substitution tables. Here, we describe how the calculation of ESSTs can be improved by discarding the functional residues from the calculation of substitution tables. Four categories of functions are examined in this study: protein–protein interactions, protein–nucleic acid interactions, protein–ligand interactions, and catalytic activity of enzymes. Their contributions to residue conservation are measured and investigated. We test our new ESSTs using the program CRESCENDO, designed to predict functional residues by exploiting knowledge of amino acid substitutions, and compare the benchmark results with proteins whose functions have been defined experimentally. The new methodology increases the Z-score by 98% at the active site residues and finds 16% more active sites compared with the old ESST. We also find that discarding amino acids responsible for protein–protein interactions helps in the prediction of those residues although they are not as conserved as the residues of active sites. Our methodology can make the substitution tables better reflect and describe the substitution patterns of amino acids that are under structural restraints only.</p> <title>Author Summary</title> <p>Identification of residues responsible for a specific function of a protein can provide clues about the mechanism of action. Computational approaches to identifying functional residues have emerged as low-cost alternatives to experimental methods by providing fast and large-scale analyses. Moreover, the demand for such approaches is increasing as more sequences become available from genome sequencing projects. Here, we focus on the use of CRESCENDO to identify functional residues in proteins of known structure by comparing the amino acid substitutions observed in a family of proteins with those predicted on the basis of the protein structure. CRESCENDO uses Environment Specific Substitution Tables, or ESSTs, which define the way that accepted amino acid substitutions are influenced by the local structural environment. We describe how the calculation of ESSTs can be improved by using only amino acids that are not involved in catalytic activity, metal or ligand binding, nucleic acid or protein interactions, and other molecular functions. Our new substitution table can better describe the degree of amino acids substitutions that are under structural restraints. It should be of value in all applications of ESSTs, including their use in sequence–structure homology recognition, structure validation, and structure prediction in addition to their use in the identification of functional residues. These approaches should enhance the understanding of protein structure and function, which is critically important in the postgenomic era.</p>
<title>Supporting Information</title>
<p>We would like to thank Kenji Mizuguchi for SUBST program, and Vijayalakshmi Chelliah and Simon Lovell for help with CRESCENDO. We are grateful to all who are developing and maintaining biological databases, scientists submitting their invaluable data, and people who support open source programs and operating systems. We especially thank Semin Lee, Adrian Schreyer, and Richard Bickerton for their collaboration on developing databases.</p>
<fig id="pcbi-1000179-g001" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.g001</object-id><label>Figure 1</label><caption><title>Probabilities of Residue Conservation for 21 Amino Acids.</title><p>The probability of residue conservation (P<sub>CONS</sub>) was averaged for the diagonal axis of substitution tables. (A) P<sub>CONS</sub> of three matrix-types (ENZ, NOENZ and ALL) are compared with the OLD. Non-masking models (X) were used for three matrix-types and OLD to see the effect of alignment source. (ENZ: enzyme-specific 221 SCOP families, NONENZ: non-enzymes, ALL: all the alignments, OLD: non-masking ESST of Shi <italic>et al.</italic>
##REF##11419950##[11]##. See ##TAB##1##Table 2## for details.) (B) Five masking tables and one non-masking table are compared with the ESST of Shi <italic>et al.</italic>
##REF##11419950##[11]##. Masking and non-masking tables are from the 221 enzyme-specific alignments (ENZ). Masking sources of A, B, C, and D are listed in ##TAB##0##Table 1##. (R: random-masking, X: non-masking.)</p></caption></fig> <fig id="pcbi-1000179-g002" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.g002</object-id><label>Figure 2</label><caption><title>Performance of 17 ESSTs on Detecting Active Site Residues.</title><p>Z-score (blue) and sensitivity (red) are plotted against 17 ESSTs. Z-score is averaged for 602 active-site residues in the test-sets (see text). Z-score and sensitivity (SENS) are highly correlated (0.95 in Spearman's rank correlation, ##TAB##2##Table 3##). If any SCOP families in the test-sets are included in 17 ESSTs, they are removed from the ESSTs to avoid any bias. Those benchmarking ESSTs are marked by ‘t’ (e.g., At, Bt, Ct and Dt) to distinguish from the original. Z-score and SENS of non-masking (X) and random-masking (R) tables are always lower than those of masking models (At, Bt, Ct, and Dt) within the same matrix type (OLD, ENZ, ALL). All the masking-tables outperform the ESST of Shi <italic>et al.</italic> (J) ##REF##11419950##[11]##.</p></caption></fig> <fig id="pcbi-1000179-g003" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.g003</object-id><label>Figure 3</label><caption><title>Predicting Four Categories of Functional Residues by CRESCENDO.</title><p>Four case-studies of predicting functional residues are shown; (A) active-sites, (B) PPI (protein–protein interaction), (C) PNI (protein–nucleic acid interaction, (D) PLI (protein–ligand interaction). SCOP domains d1evua4 ##REF##9988734##[23]##, d1i7kb_ ##REF##11927573##[24]##, d1k8wa5 ##REF##11779468##[33]## and d1ed9a_ ##REF##10873454##[34]## were used for A, B, C, and D, respectively. True positives (TP) are coloured in pink, false negatives (FN, missing residues) in orange and false positives (FP) in green. TP and FN are shown as sticks (bold-frame). (A) Cysteine protease. CRESCENDO predicted 27 residues as functional residues. All three (CYS-314, HIS-373 and ASP-396) catalytic residues were correctly identified. ALL-B type ESST (see ##TAB##1##Table 2##) was used in this figure. FP (green) are clustered around the three real active sites (pink). (B) Ubiquitin conjugating (UBC) enzyme. 12 residues were predicted by CRESCENDO using ALL-A ESST. Five (coloured in pink) were correctly identified among 14 residues annotated as PPI residues. Interacting partner (A chain of 1i7k) is placed at the bottom and coloured in gray. The solvent accessible surface areas (SASA) for five TP are as follow; ARG-34 (35.64), PRO-90 (4.12), SER-123 (4.74), ALA-124 (0.55), LEU-125 (72.39). SASA for 9 FN are as follow; PRO-30 (77.26), VAL-31 (24.02), SER-87 (110.40), GLY-88 (16.05), TYR-89 (0.01), TYR-91 (58.29), GLU-120 (108.68), LYS-121 (113.96), TRP-122 (7.20). The SASA is from InterPare ##REF##16122378##[18]##. (C) Pseudouridine synthase. BIPA (S. Lee, unpublished) annotates 43 residues as PNI. 14 residues were TP (coloured in pink) among 20 residues predicted by CRESCENDO. ALL-D was used as ESST. DNA is coloured in blue. (D) Alkaline phosphatase. UniProt annotates 9 residues as metal-binding (METAL), which were all correctly identified by CRESCENDO among 30 predicted residues. ALL-B was used as ESST. ZN (zinc) and MG (magnesium) are coloured in cyan and blue, respectively.</p></caption></fig>
<table-wrap id="pcbi-1000179-t001" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t001</object-id><label>Table 1</label><caption><title>Four Categories of Functional Residues Considered in this Study.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1">Functional Category</td><td align="left" rowspan="1" colspan="1">Database</td><td align="left" rowspan="1" colspan="1">Feature Identifier</td><td align="left" rowspan="1" colspan="1">Description</td><td colspan="4" align="left" rowspan="1">Masking Type</td><td align="left" rowspan="1" colspan="1">URL</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">A</td><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">C</td><td align="left" rowspan="1" colspan="1">D</td><td align="left" rowspan="1" colspan="1"/></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>Protein–protein Interaction</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>InterPare</bold>
</td><td align="left" rowspan="1" colspan="1">N/A</td><td align="left" rowspan="1" colspan="1">Database of domain–domain interaction interface</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<ext-link ext-link-type="uri" xlink:href="http://interpare.net">http://interpare.net</ext-link>
</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>Catalytic activity</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>CSA</bold>
</td><td align="left" rowspan="1" colspan="1">N/A</td><td align="left" rowspan="1" colspan="1">Database documenting enzyme active sites and catalytic residues in enzymes of 3D structure</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">
<ext-link ext-link-type="uri" xlink:href="http://www.ebi.ac.uk/thornton-srv/databases/CSA/">http://www.ebi.ac.uk/thornton-srv/databases/CSA/</ext-link>
</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<bold>UNIPROT</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>ACT_SITE</bold>
</td><td align="left" rowspan="1" colspan="1">Amino acid(s) involved in the activity of an enzyme</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">
<ext-link ext-link-type="uri" xlink:href="http://www.uniprot.org">http://www.uniprot.org</ext-link>
</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>Protein–nucleic acid interaction</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>BIPA</bold>
</td><td align="left" rowspan="1" colspan="1">N/A</td><td align="left" rowspan="1" colspan="1">Database of protein–nucleic acid interactions</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">N/A</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<bold>UNIPROT</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>DNA_BIND</bold>
</td><td align="left" rowspan="1" colspan="1">Extent of a DNA-binding region</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<ext-link ext-link-type="uri" xlink:href="http://www.uniprot.org">http://www.uniprot.org</ext-link>
</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>Protein–ligand interaction</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>UNIPROT</bold>
</td><td align="left" rowspan="1" colspan="1">
<bold>BINDING</bold>
</td><td align="left" rowspan="1" colspan="1">Binding site for any chemical group (co-enzyme, prosthetic group, etc.)</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<ext-link ext-link-type="uri" xlink:href="http://www.uniprot.org">http://www.uniprot.org</ext-link>
</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<bold>CA_BIND</bold>
</td><td align="left" rowspan="1" colspan="1">Extent of a calcium-binding region</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<bold>NP_BIND</bold>
</td><td align="left" rowspan="1" colspan="1">Extent of a nucleotide phosphate-binding region</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<bold>METAL</bold>
</td><td align="left" rowspan="1" colspan="1">Binding site for a metal ion</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1">√</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr></tbody></table></alternatives></table-wrap> <table-wrap id="pcbi-1000179-t002" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t002</object-id><label>Table 2</label><caption><title>17 ESSTs and the Number of Functional Residues Masked from the Alignments.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1">Alignment Source</td><td colspan="3" align="left" rowspan="1">Number</td><td align="left" rowspan="1" colspan="1">Matrix Type</td><td align="left" rowspan="1" colspan="1">Masking Type</td><td align="left" rowspan="1" colspan="1">Masking Residues<xref ref-type="table-fn" rid="nt104">b</xref>
</td><td align="left" rowspan="1" colspan="1">%Mask<xref ref-type="table-fn" rid="nt105">c</xref>
</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Family</td><td align="left" rowspan="1" colspan="1">Structure</td><td align="left" rowspan="1" colspan="1">Residue<xref ref-type="table-fn" rid="nt103">a</xref>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>HOMSTRAD</bold>
</td><td align="left" rowspan="1" colspan="1">177</td><td align="left" rowspan="1" colspan="1">706</td><td align="left" rowspan="1" colspan="1">146,437</td><td align="left" rowspan="1" colspan="1">
<bold>OLD</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.00</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">J</td><td align="left" rowspan="1" colspan="1">2,048</td><td align="left" rowspan="1" colspan="1">1.40</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">4,601</td><td align="left" rowspan="1" colspan="1">3.14</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">4,601</td><td align="left" rowspan="1" colspan="1">3.14</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>SCOP</bold>
</td><td align="left" rowspan="1" colspan="1">221</td><td align="left" rowspan="1" colspan="1">902</td><td align="left" rowspan="1" colspan="1">235,588</td><td align="left" rowspan="1" colspan="1">
<bold>ENZ</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.00</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">A</td><td align="left" rowspan="1" colspan="1">37,808</td><td align="left" rowspan="1" colspan="1">16.05</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">6,195</td><td align="left" rowspan="1" colspan="1">2.63</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">C</td><td align="left" rowspan="1" colspan="1">36,265</td><td align="left" rowspan="1" colspan="1">15.39</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">D</td><td align="left" rowspan="1" colspan="1">1,615</td><td align="left" rowspan="1" colspan="1">0.69</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">37,808</td><td align="left" rowspan="1" colspan="1">16.05</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">566</td><td align="left" rowspan="1" colspan="1">2,556</td><td align="left" rowspan="1" colspan="1">384,618</td><td align="left" rowspan="1" colspan="1">
<bold>NOENZ</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.00</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1,187</td><td align="left" rowspan="1" colspan="1">5,833</td><td align="left" rowspan="1" colspan="1">1,096,027</td><td align="left" rowspan="1" colspan="1">
<bold>ALL</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0</td><td align="left" rowspan="1" colspan="1">0.00</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">A</td><td align="left" rowspan="1" colspan="1">198,411</td><td align="left" rowspan="1" colspan="1">18.10</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">21,830</td><td align="left" rowspan="1" colspan="1">1.99</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">C</td><td align="left" rowspan="1" colspan="1">191,377</td><td align="left" rowspan="1" colspan="1">17.46</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">D</td><td align="left" rowspan="1" colspan="1">1,840</td><td align="left" rowspan="1" colspan="1">0.17</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">198,411</td><td align="left" rowspan="1" colspan="1">18.10</td></tr></tbody></table></alternatives></table-wrap> <table-wrap id="pcbi-1000179-t003" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t003</object-id><label>Table 3</label><caption><title>Rank Correlation.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">P<sub>CONS</sub>
</td><td align="left" rowspan="1" colspan="1">Z-Score</td><td align="left" rowspan="1" colspan="1">SENS</td><td align="left" rowspan="1" colspan="1">DIST</td><td align="left" rowspan="1" colspan="1">%Mask</td></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>P<sub>CONS</sub></bold>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">−0.85</td><td align="left" rowspan="1" colspan="1">−0.93</td><td align="left" rowspan="1" colspan="1">−0.38</td><td align="left" rowspan="1" colspan="1">−0.30</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>Z-score</bold>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">0.95</td><td align="left" rowspan="1" colspan="1">0.54</td><td align="left" rowspan="1" colspan="1">0.45</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>SENS</bold>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">0.48</td><td align="left" rowspan="1" colspan="1">0.45</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>DIST</bold>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">0.29</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>%Mask</bold>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td></tr></tbody></table></alternatives></table-wrap> <table-wrap id="pcbi-1000179-t004" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t004</object-id><label>Table 4</label><caption><title>Z-Score of CRESCENDO for Functional Residues.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1">Matrix Type</td><td align="left" rowspan="1" colspan="1">Masking Type</td><td colspan="6" align="left" rowspan="1">Average Z-Score</td><td align="left" rowspan="1" colspan="1">Ratio<xref ref-type="table-fn" rid="nt114">g</xref>
</td><td align="left" rowspan="1" colspan="1">P-Value<xref ref-type="table-fn" rid="nt115">h</xref>
</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">All<xref ref-type="table-fn" rid="nt108">a</xref>
</td><td align="left" rowspan="1" colspan="1">Predicted<xref ref-type="table-fn" rid="nt109">b</xref>
</td><td align="left" rowspan="1" colspan="1">Active Site<xref ref-type="table-fn" rid="nt110">c</xref>
</td><td align="left" rowspan="1" colspan="1">PPI<xref ref-type="table-fn" rid="nt111">d</xref>
</td><td align="left" rowspan="1" colspan="1">PNI<xref ref-type="table-fn" rid="nt112">e</xref>
</td><td align="left" rowspan="1" colspan="1">PLI<xref ref-type="table-fn" rid="nt113">f</xref>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>OLD</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0.00063</td><td align="left" rowspan="1" colspan="1">1.396</td><td align="left" rowspan="1" colspan="1">0.480</td><td align="left" rowspan="1" colspan="1">0.0250</td><td align="left" rowspan="1" colspan="1">0.055</td><td align="left" rowspan="1" colspan="1">0.449</td><td align="left" rowspan="1" colspan="1">0.78</td><td align="left" rowspan="1" colspan="1">0.081</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">0.00067</td><td align="left" rowspan="1" colspan="1">1.402</td><td align="left" rowspan="1" colspan="1">0.483</td><td align="left" rowspan="1" colspan="1">0.0249</td><td align="left" rowspan="1" colspan="1">0.052</td><td align="left" rowspan="1" colspan="1">0.450</td><td align="left" rowspan="1" colspan="1">0.79</td><td align="left" rowspan="1" colspan="1">0.080</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">J</td><td align="left" rowspan="1" colspan="1">0.00062</td><td align="left" rowspan="1" colspan="1">1.410</td><td align="left" rowspan="1" colspan="1">0.612</td><td align="left" rowspan="1" colspan="1">0.0284</td><td align="left" rowspan="1" colspan="1">0.055</td><td align="left" rowspan="1" colspan="1">0.461</td><td align="left" rowspan="1" colspan="1">1.00</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">0.00065</td><td align="left" rowspan="1" colspan="1">1.420</td><td align="left" rowspan="1" colspan="1">0.734</td><td align="left" rowspan="1" colspan="1">0.0274</td><td align="left" rowspan="1" colspan="1">0.059</td><td align="left" rowspan="1" colspan="1">0.490</td><td align="left" rowspan="1" colspan="1">1.20</td><td align="left" rowspan="1" colspan="1">0.078</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ENZ</bold>
</td><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">0.00060</td><td align="left" rowspan="1" colspan="1">1.387</td><td align="left" rowspan="1" colspan="1">0.635</td><td align="left" rowspan="1" colspan="1">0.0042</td><td align="left" rowspan="1" colspan="1">0.024</td><td align="left" rowspan="1" colspan="1">0.426</td><td align="left" rowspan="1" colspan="1">1.04</td><td align="left" rowspan="1" colspan="1">0.083</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">0.00060</td><td align="left" rowspan="1" colspan="1">1.387</td><td align="left" rowspan="1" colspan="1">0.652</td><td align="left" rowspan="1" colspan="1">0.0067</td><td align="left" rowspan="1" colspan="1">0.025</td><td align="left" rowspan="1" colspan="1">0.431</td><td align="left" rowspan="1" colspan="1">1.06</td><td align="left" rowspan="1" colspan="1">0.083</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">0.00063</td><td align="left" rowspan="1" colspan="1">1.413</td><td align="left" rowspan="1" colspan="1">0.734</td><td align="left" rowspan="1" colspan="1">0.0100</td><td align="left" rowspan="1" colspan="1">0.025</td><td align="left" rowspan="1" colspan="1">0.427</td><td align="left" rowspan="1" colspan="1">1.20</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">0.00062</td><td align="left" rowspan="1" colspan="1">1.399</td><td align="left" rowspan="1" colspan="1">0.772</td><td align="left" rowspan="1" colspan="1">0.0078</td><td align="left" rowspan="1" colspan="1">0.051</td><td align="left" rowspan="1" colspan="1">0.428</td><td align="left" rowspan="1" colspan="1">1.26</td><td align="left" rowspan="1" colspan="1">0.081</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">0.00063</td><td align="left" rowspan="1" colspan="1">1.423</td><td align="left" rowspan="1" colspan="1">0.858</td><td align="left" rowspan="1" colspan="1">0.0143</td><td align="left" rowspan="1" colspan="1">0.056</td><td align="left" rowspan="1" colspan="1">0.433</td><td align="left" rowspan="1" colspan="1">1.40</td><td align="left" rowspan="1" colspan="1">0.077</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">0.00064</td><td align="left" rowspan="1" colspan="1">1.411</td><td align="left" rowspan="1" colspan="1">0.870</td><td align="left" rowspan="1" colspan="1">0.0086</td><td align="left" rowspan="1" colspan="1">0.068</td><td align="left" rowspan="1" colspan="1">0.447</td><td align="left" rowspan="1" colspan="1">1.42</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>NOENZ</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">0.00063</td><td align="left" rowspan="1" colspan="1">1.420</td><td align="left" rowspan="1" colspan="1">0.835</td><td align="left" rowspan="1" colspan="1">0.0046</td><td align="left" rowspan="1" colspan="1">0.099</td><td align="left" rowspan="1" colspan="1">0.508</td><td align="left" rowspan="1" colspan="1">1.36</td><td align="left" rowspan="1" colspan="1">0.078</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ALL</bold>
</td><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">0.00063</td><td align="left" rowspan="1" colspan="1">1.414</td><td align="left" rowspan="1" colspan="1">0.696</td><td align="left" rowspan="1" colspan="1">0.0085</td><td align="left" rowspan="1" colspan="1">0.068</td><td align="left" rowspan="1" colspan="1">0.489</td><td align="left" rowspan="1" colspan="1">1.14</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">0.00064</td><td align="left" rowspan="1" colspan="1">1.415</td><td align="left" rowspan="1" colspan="1">0.771</td><td align="left" rowspan="1" colspan="1">0.0065</td><td align="left" rowspan="1" colspan="1">0.075</td><td align="left" rowspan="1" colspan="1">0.501</td><td align="left" rowspan="1" colspan="1">1.26</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">0.00066</td><td align="left" rowspan="1" colspan="1">1.412</td><td align="left" rowspan="1" colspan="1">0.798</td><td align="left" rowspan="1" colspan="1">0.0055</td><td align="left" rowspan="1" colspan="1">0.078</td><td align="left" rowspan="1" colspan="1">0.495</td><td align="left" rowspan="1" colspan="1">1.30</td><td align="left" rowspan="1" colspan="1">0.079</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">0.00064</td><td align="left" rowspan="1" colspan="1">1.433</td><td align="left" rowspan="1" colspan="1">0.860</td><td align="left" rowspan="1" colspan="1">0.0159</td><td align="left" rowspan="1" colspan="1">0.069</td><td align="left" rowspan="1" colspan="1">0.495</td><td align="left" rowspan="1" colspan="1">1.41</td><td align="left" rowspan="1" colspan="1">0.076</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">0.00067</td><td align="left" rowspan="1" colspan="1">1.436</td><td align="left" rowspan="1" colspan="1">0.893</td><td align="left" rowspan="1" colspan="1">0.0155</td><td align="left" rowspan="1" colspan="1">0.077</td><td align="left" rowspan="1" colspan="1">0.515</td><td align="left" rowspan="1" colspan="1">1.46</td><td align="left" rowspan="1" colspan="1">0.076</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">0.00068</td><td align="left" rowspan="1" colspan="1">1.435</td><td align="left" rowspan="1" colspan="1">0.936</td><td align="left" rowspan="1" colspan="1">0.0073</td><td align="left" rowspan="1" colspan="1">0.086</td><td align="left" rowspan="1" colspan="1">0.518</td><td align="left" rowspan="1" colspan="1">1.53</td><td align="left" rowspan="1" colspan="1">0.076</td></tr></tbody></table></alternatives></table-wrap> <table-wrap id="pcbi-1000179-t005" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t005</object-id><label>Table 5</label><caption><title>Performance of 17 ESSTs on Detecting Active Sites.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1">Matrix Type</td><td align="left" rowspan="1" colspan="1">Masking Type</td><td align="left" rowspan="1" colspan="1">TP</td><td align="left" rowspan="1" colspan="1">FP</td><td align="left" rowspan="1" colspan="1">FN</td><td align="left" rowspan="1" colspan="1">TN</td><td align="left" rowspan="1" colspan="1">SENS</td><td align="left" rowspan="1" colspan="1">SPEC</td><td align="left" rowspan="1" colspan="1">COV</td><td align="left" rowspan="1" colspan="1">F-Measure</td></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>OLD</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">168</td><td align="left" rowspan="1" colspan="1">4832</td><td align="left" rowspan="1" colspan="1">432</td><td align="left" rowspan="1" colspan="1">75976</td><td align="left" rowspan="1" colspan="1">0.28</td><td align="left" rowspan="1" colspan="1">0.9401</td><td align="left" rowspan="1" colspan="1">0.0336</td><td align="left" rowspan="1" colspan="1">0.060</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">168</td><td align="left" rowspan="1" colspan="1">4830</td><td align="left" rowspan="1" colspan="1">432</td><td align="left" rowspan="1" colspan="1">75978</td><td align="left" rowspan="1" colspan="1">0.28</td><td align="left" rowspan="1" colspan="1">0.9401</td><td align="left" rowspan="1" colspan="1">0.0336</td><td align="left" rowspan="1" colspan="1">0.060</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">J</td><td align="left" rowspan="1" colspan="1">189</td><td align="left" rowspan="1" colspan="1">4877</td><td align="left" rowspan="1" colspan="1">411</td><td align="left" rowspan="1" colspan="1">75931</td><td align="left" rowspan="1" colspan="1">0.315</td><td align="left" rowspan="1" colspan="1">0.9395</td><td align="left" rowspan="1" colspan="1">0.0373</td><td align="left" rowspan="1" colspan="1">0.067</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">219</td><td align="left" rowspan="1" colspan="1">4888</td><td align="left" rowspan="1" colspan="1">381</td><td align="left" rowspan="1" colspan="1">75920</td><td align="left" rowspan="1" colspan="1">0.365</td><td align="left" rowspan="1" colspan="1">0.9394</td><td align="left" rowspan="1" colspan="1">0.0429</td><td align="left" rowspan="1" colspan="1">0.077</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ENZ</bold>
</td><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">221</td><td align="left" rowspan="1" colspan="1">4942</td><td align="left" rowspan="1" colspan="1">379</td><td align="left" rowspan="1" colspan="1">75866</td><td align="left" rowspan="1" colspan="1">0.3683</td><td align="left" rowspan="1" colspan="1">0.9387</td><td align="left" rowspan="1" colspan="1">0.0428</td><td align="left" rowspan="1" colspan="1">0.077</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">225</td><td align="left" rowspan="1" colspan="1">4968</td><td align="left" rowspan="1" colspan="1">375</td><td align="left" rowspan="1" colspan="1">75840</td><td align="left" rowspan="1" colspan="1">0.375</td><td align="left" rowspan="1" colspan="1">0.9384</td><td align="left" rowspan="1" colspan="1">0.0433</td><td align="left" rowspan="1" colspan="1">0.078</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">240</td><td align="left" rowspan="1" colspan="1">4870</td><td align="left" rowspan="1" colspan="1">360</td><td align="left" rowspan="1" colspan="1">75938</td><td align="left" rowspan="1" colspan="1">0.4</td><td align="left" rowspan="1" colspan="1">0.9396</td><td align="left" rowspan="1" colspan="1">0.047</td><td align="left" rowspan="1" colspan="1">0.084</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">248</td><td align="left" rowspan="1" colspan="1">4977</td><td align="left" rowspan="1" colspan="1">352</td><td align="left" rowspan="1" colspan="1">75831</td><td align="left" rowspan="1" colspan="1">0.4133</td><td align="left" rowspan="1" colspan="1">0.9383</td><td align="left" rowspan="1" colspan="1">0.0475</td><td align="left" rowspan="1" colspan="1">0.085</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">264</td><td align="left" rowspan="1" colspan="1">4805</td><td align="left" rowspan="1" colspan="1">336</td><td align="left" rowspan="1" colspan="1">76003</td><td align="left" rowspan="1" colspan="1">0.44</td><td align="left" rowspan="1" colspan="1">0.9404</td><td align="left" rowspan="1" colspan="1">0.0521</td><td align="left" rowspan="1" colspan="1">0.093</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">270</td><td align="left" rowspan="1" colspan="1">4984</td><td align="left" rowspan="1" colspan="1">330</td><td align="left" rowspan="1" colspan="1">75824</td><td align="left" rowspan="1" colspan="1">0.45</td><td align="left" rowspan="1" colspan="1">0.9382</td><td align="left" rowspan="1" colspan="1">0.0514</td><td align="left" rowspan="1" colspan="1">0.092</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>NOENZ</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">273</td><td align="left" rowspan="1" colspan="1">5234</td><td align="left" rowspan="1" colspan="1">327</td><td align="left" rowspan="1" colspan="1">75574</td><td align="left" rowspan="1" colspan="1">0.455</td><td align="left" rowspan="1" colspan="1">0.9351</td><td align="left" rowspan="1" colspan="1">0.0496</td><td align="left" rowspan="1" colspan="1">0.089</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ALL</bold>
</td><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">249</td><td align="left" rowspan="1" colspan="1">5283</td><td align="left" rowspan="1" colspan="1">351</td><td align="left" rowspan="1" colspan="1">75525</td><td align="left" rowspan="1" colspan="1">0.415</td><td align="left" rowspan="1" colspan="1">0.9345</td><td align="left" rowspan="1" colspan="1">0.045</td><td align="left" rowspan="1" colspan="1">0.081</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">259</td><td align="left" rowspan="1" colspan="1">5285</td><td align="left" rowspan="1" colspan="1">341</td><td align="left" rowspan="1" colspan="1">75523</td><td align="left" rowspan="1" colspan="1">0.4317</td><td align="left" rowspan="1" colspan="1">0.9345</td><td align="left" rowspan="1" colspan="1">0.0467</td><td align="left" rowspan="1" colspan="1">0.084</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">262</td><td align="left" rowspan="1" colspan="1">5246</td><td align="left" rowspan="1" colspan="1">338</td><td align="left" rowspan="1" colspan="1">75562</td><td align="left" rowspan="1" colspan="1">0.4367</td><td align="left" rowspan="1" colspan="1">0.935</td><td align="left" rowspan="1" colspan="1">0.0476</td><td align="left" rowspan="1" colspan="1">0.086</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">273</td><td align="left" rowspan="1" colspan="1">5150</td><td align="left" rowspan="1" colspan="1">327</td><td align="left" rowspan="1" colspan="1">75658</td><td align="left" rowspan="1" colspan="1">0.455</td><td align="left" rowspan="1" colspan="1">0.9362</td><td align="left" rowspan="1" colspan="1">0.0503</td><td align="left" rowspan="1" colspan="1">0.091</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">277</td><td align="left" rowspan="1" colspan="1">5136</td><td align="left" rowspan="1" colspan="1">323</td><td align="left" rowspan="1" colspan="1">75672</td><td align="left" rowspan="1" colspan="1">0.4617</td><td align="left" rowspan="1" colspan="1">0.9363</td><td align="left" rowspan="1" colspan="1">0.0512</td><td align="left" rowspan="1" colspan="1">0.092</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">282</td><td align="left" rowspan="1" colspan="1">5187</td><td align="left" rowspan="1" colspan="1">318</td><td align="left" rowspan="1" colspan="1">75621</td><td align="left" rowspan="1" colspan="1">0.47</td><td align="left" rowspan="1" colspan="1">0.9357</td><td align="left" rowspan="1" colspan="1">0.0516</td><td align="left" rowspan="1" colspan="1">0.093</td></tr></tbody></table></alternatives></table-wrap> <table-wrap id="pcbi-1000179-t006" position="float"><object-id pub-id-type="doi">10.1371/journal.pcbi.1000179.t006</object-id><label>Table 6</label><caption><title>Performance of ESSTs on Protein–Protein Interaction Residues.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td align="left" rowspan="1" colspan="1">Matrix Type</td><td align="left" rowspan="1" colspan="1">Masking Type</td><td align="left" rowspan="1" colspan="1">TP</td><td align="left" rowspan="1" colspan="1">FP</td><td align="left" rowspan="1" colspan="1">FN</td><td align="left" rowspan="1" colspan="1">TN</td><td align="left" rowspan="1" colspan="1">SENS</td><td align="left" rowspan="1" colspan="1">SPEC</td><td align="left" rowspan="1" colspan="1">COV</td><td align="left" rowspan="1" colspan="1">F-Measure</td></tr></thead><tbody><tr><td align="left" rowspan="1" colspan="1">
<bold>OLD</bold>
</td><td align="left" rowspan="1" colspan="1">B</td><td align="left" rowspan="1" colspan="1">931</td><td align="left" rowspan="1" colspan="1">4176</td><td align="left" rowspan="1" colspan="1">10986</td><td align="left" rowspan="1" colspan="1">65317</td><td align="left" rowspan="1" colspan="1">0.0781</td><td align="left" rowspan="1" colspan="1">0.8560</td><td align="left" rowspan="1" colspan="1">0.1823</td><td align="left" rowspan="1" colspan="1">0.1094</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">R</td><td align="left" rowspan="1" colspan="1">934</td><td align="left" rowspan="1" colspan="1">4064</td><td align="left" rowspan="1" colspan="1">10983</td><td align="left" rowspan="1" colspan="1">65429</td><td align="left" rowspan="1" colspan="1">0.0784</td><td align="left" rowspan="1" colspan="1">0.8563</td><td align="left" rowspan="1" colspan="1">0.1869</td><td align="left" rowspan="1" colspan="1">0.1104</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">939</td><td align="left" rowspan="1" colspan="1">4061</td><td align="left" rowspan="1" colspan="1">10978</td><td align="left" rowspan="1" colspan="1">65432</td><td align="left" rowspan="1" colspan="1">0.0788</td><td align="left" rowspan="1" colspan="1">0.8563</td><td align="left" rowspan="1" colspan="1">0.1878</td><td align="left" rowspan="1" colspan="1">0.1110</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">J</td><td align="left" rowspan="1" colspan="1">939</td><td align="left" rowspan="1" colspan="1">4127</td><td align="left" rowspan="1" colspan="1">10978</td><td align="left" rowspan="1" colspan="1">65366</td><td align="left" rowspan="1" colspan="1">0.0788</td><td align="left" rowspan="1" colspan="1">0.8562</td><td align="left" rowspan="1" colspan="1">0.1854</td><td align="left" rowspan="1" colspan="1">0.1106</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ENZ</bold>
</td><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">906</td><td align="left" rowspan="1" colspan="1">4163</td><td align="left" rowspan="1" colspan="1">11011</td><td align="left" rowspan="1" colspan="1">65330</td><td align="left" rowspan="1" colspan="1">0.0760</td><td align="left" rowspan="1" colspan="1">0.8558</td><td align="left" rowspan="1" colspan="1">0.1787</td><td align="left" rowspan="1" colspan="1">0.1067</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">908</td><td align="left" rowspan="1" colspan="1">4202</td><td align="left" rowspan="1" colspan="1">11009</td><td align="left" rowspan="1" colspan="1">65291</td><td align="left" rowspan="1" colspan="1">0.0762</td><td align="left" rowspan="1" colspan="1">0.8557</td><td align="left" rowspan="1" colspan="1">0.1777</td><td align="left" rowspan="1" colspan="1">0.1067</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">921</td><td align="left" rowspan="1" colspan="1">4242</td><td align="left" rowspan="1" colspan="1">10996</td><td align="left" rowspan="1" colspan="1">65251</td><td align="left" rowspan="1" colspan="1">0.0773</td><td align="left" rowspan="1" colspan="1">0.8558</td><td align="left" rowspan="1" colspan="1">0.1784</td><td align="left" rowspan="1" colspan="1">0.1078</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">925</td><td align="left" rowspan="1" colspan="1">4268</td><td align="left" rowspan="1" colspan="1">10992</td><td align="left" rowspan="1" colspan="1">65225</td><td align="left" rowspan="1" colspan="1">0.0776</td><td align="left" rowspan="1" colspan="1">0.8558</td><td align="left" rowspan="1" colspan="1">0.1781</td><td align="left" rowspan="1" colspan="1">0.1081</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">960</td><td align="left" rowspan="1" colspan="1">4265</td><td align="left" rowspan="1" colspan="1">10957</td><td align="left" rowspan="1" colspan="1">65228</td><td align="left" rowspan="1" colspan="1">0.0806</td><td align="left" rowspan="1" colspan="1">0.8562</td><td align="left" rowspan="1" colspan="1">0.1837</td><td align="left" rowspan="1" colspan="1">0.1120</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">973</td><td align="left" rowspan="1" colspan="1">4281</td><td align="left" rowspan="1" colspan="1">10944</td><td align="left" rowspan="1" colspan="1">65212</td><td align="left" rowspan="1" colspan="1">0.0816</td><td align="left" rowspan="1" colspan="1">0.8563</td><td align="left" rowspan="1" colspan="1">0.1852</td><td align="left" rowspan="1" colspan="1">0.1133</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>NOENZ</bold>
</td><td align="left" rowspan="1" colspan="1">X</td><td align="left" rowspan="1" colspan="1">893</td><td align="left" rowspan="1" colspan="1">4614</td><td align="left" rowspan="1" colspan="1">11024</td><td align="left" rowspan="1" colspan="1">64879</td><td align="left" rowspan="1" colspan="1">0.0749</td><td align="left" rowspan="1" colspan="1">0.8548</td><td align="left" rowspan="1" colspan="1">0.1622</td><td align="left" rowspan="1" colspan="1">0.1025</td></tr><tr><td align="left" rowspan="1" colspan="1">
<bold>ALL</bold>
</td><td align="left" rowspan="1" colspan="1">Xt</td><td align="left" rowspan="1" colspan="1">930</td><td align="left" rowspan="1" colspan="1">4602</td><td align="left" rowspan="1" colspan="1">10987</td><td align="left" rowspan="1" colspan="1">64891</td><td align="left" rowspan="1" colspan="1">0.0780</td><td align="left" rowspan="1" colspan="1">0.8552</td><td align="left" rowspan="1" colspan="1">0.1681</td><td align="left" rowspan="1" colspan="1">0.1066</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Bt</td><td align="left" rowspan="1" colspan="1">953</td><td align="left" rowspan="1" colspan="1">4516</td><td align="left" rowspan="1" colspan="1">10964</td><td align="left" rowspan="1" colspan="1">64977</td><td align="left" rowspan="1" colspan="1">0.0800</td><td align="left" rowspan="1" colspan="1">0.8556</td><td align="left" rowspan="1" colspan="1">0.1743</td><td align="left" rowspan="1" colspan="1">0.1096</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Dt</td><td align="left" rowspan="1" colspan="1">963</td><td align="left" rowspan="1" colspan="1">4581</td><td align="left" rowspan="1" colspan="1">10954</td><td align="left" rowspan="1" colspan="1">64912</td><td align="left" rowspan="1" colspan="1">0.0808</td><td align="left" rowspan="1" colspan="1">0.8556</td><td align="left" rowspan="1" colspan="1">0.1737</td><td align="left" rowspan="1" colspan="1">0.1103</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Rt</td><td align="left" rowspan="1" colspan="1">980</td><td align="left" rowspan="1" colspan="1">4528</td><td align="left" rowspan="1" colspan="1">10937</td><td align="left" rowspan="1" colspan="1">64965</td><td align="left" rowspan="1" colspan="1">0.0822</td><td align="left" rowspan="1" colspan="1">0.8559</td><td align="left" rowspan="1" colspan="1">0.1779</td><td align="left" rowspan="1" colspan="1">0.1125</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Ct</td><td align="left" rowspan="1" colspan="1">1000</td><td align="left" rowspan="1" colspan="1">4245</td><td align="left" rowspan="1" colspan="1">10917</td><td align="left" rowspan="1" colspan="1">65248</td><td align="left" rowspan="1" colspan="1">0.0839</td><td align="left" rowspan="1" colspan="1">0.8567</td><td align="left" rowspan="1" colspan="1">0.1907</td><td align="left" rowspan="1" colspan="1">0.1165</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">At</td><td align="left" rowspan="1" colspan="1">1003</td><td align="left" rowspan="1" colspan="1">4420</td><td align="left" rowspan="1" colspan="1">10914</td><td align="left" rowspan="1" colspan="1">65073</td><td align="left" rowspan="1" colspan="1">0.0842</td><td align="left" rowspan="1" colspan="1">0.8564</td><td align="left" rowspan="1" colspan="1">0.1850</td><td align="left" rowspan="1" colspan="1">0.1157</td></tr></tbody></table></alternatives></table-wrap>
<inline-formula></inline-formula> <inline-formula></inline-formula> <inline-formula></inline-formula> <disp-formula></disp-formula> <inline-formula></inline-formula>
<supplementary-material content-type="local-data" id="pcbi.1000179.s001"><label>Table S1</label><caption><p>Probability of Residue Conservation.</p><p>(0.11 MB DOC)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pcbi.1000179.s002"><label>Table S2</label><caption><p>Distance Matrix of 17 ESSTs.</p><p>(0.10 MB DOC)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pcbi.1000179.s003"><label>Table S3</label><caption><p>Performance of ESSTs on the Residue Interacting with Nucleic Acids and Ligands.</p><p>(0.07 MB DOC)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pcbi.1000179.s004"><label>Table S4</label><caption><p>Lists of Computer Programs and Databases used in this Study.</p><p>(0.06 MB DOC)</p></caption></supplementary-material>
<table-wrap-foot><fn id="nt101"><label/><p>The versions of CSA ##REF##14681376##[16]## and UniProt ##REF##14681372##[17]## were 2.2.7 and 12.2, respectively. InterPare ##REF##16122378##[18]## was based on SCOP ##REF##7723011##[19]## version 1.71. The “Feature Identifier” is only for UniProt annotations. (A: all masking, B: no protein–protein interaction, C: no active sites, D: active-site only.)</p></fn></table-wrap-foot> <table-wrap-foot><fn id="nt102"><label/><p>New ESSTs were based on the structure alignments of SCOP families ##REF##7723011##[19]##. ENZ is 221 enzyme-specific SCOP families which contain at least one ACT_SITE annotation of UniProt ##REF##14681372##[17]## or hand-curated CSA entry ##REF##14681376##[16]##. NOENZ is the opposite of ENZ. NOENZ does not even contain the predicted entries of CSA. ALL is the final alignment source obtained from the filtering process (see <xref ref-type="sec" rid="s3">Materials and Methods</xref>). The masking sources of A, B, C, and D are in ##TAB##0##Table 1##. X is for non-masking and R is for random-masking. R is set as a control to see the significance of removing functional residues from the substitution models. The ESST of Shi <italic>et al.</italic> (OLD-J) ##REF##11419950##[11]## is based on 177 HOMSTRAD families which consist of 706 structures. It masks 2,048 resides which are involved in (1) interaction with heteroatoms and (2) domain–domain interaction. OLD-X and OLD-R is non-masking and random-masking model of J.</p></fn><fn id="nt103"><label>a</label><p>Number of all residues.</p></fn><fn id="nt104"><label>b</label><p>Number of masking residues.</p></fn><fn id="nt105"><label>c</label><p>%Mask = number of masking residues/number of all residues*100.</p></fn></table-wrap-foot> <table-wrap-foot><fn id="nt106"><label/><p>Spearman's rank correlations were calculated between the variables of P<sub>CONS</sub>, Z-score, SENS, DIST, and %Mask. See <xref ref-type="sec" rid="s3">Materials and Methods</xref> for the definition of Spearman's rank correlation. %Mask is from ##TAB##1##Table 2##. Z-Score and SENS are from ##TAB##4##Table 5##. DIST is from the first row of ##SUPPL##1##Table S2##. P<sub>CONS</sub> is from the bottom line of ##SUPPL##0##Table S1##. P<sub>cons</sub>: probability of residue conservation, Z-score: average Z-score 602 active sites, SENS: sensitivity, DIST: distance between two ESSTs, %Mask: percentage of discarded functional residues.</p></fn></table-wrap-foot> <table-wrap-foot><fn id="nt107"><label/><p>The average Z-scores are shown for four categories of functional residues in the test-sets: catalytic activity, protein–protein interactions, protein–nucleic acid interactions, and protein–ligand interactions. The test-sets consist of 73 SCOP families, which is one third of SCOP families in ENZ (see ##TAB##1##Table 2##).</p></fn><fn id="nt108"><label>a</label><p>Total number of residue from test-sets (81,410).</p></fn><fn id="nt109"><label>b</label><p>Residue predicted by CRESCENDO.</p></fn><fn id="nt110"><label>c</label><p>Active-site residues (602).</p></fn><fn id="nt111"><label>d</label><p>Protein–protein interaction sites (11,917).</p></fn><fn id="nt112"><label>e</label><p>Protein–nucleic acid interaction sites (194).</p></fn><fn id="nt113"><label>f</label><p>Protein–ligand interaction sites (1,348).</p></fn><fn id="nt114"><label>g</label><p>Ratio of Z-score at the active site residues compared with that of OLD-J.</p></fn><fn id="nt115"><label>h</label><p>P-value (right-tail) of the predicted residues.</p></fn></table-wrap-foot> <table-wrap-foot><fn id="nt116"><label/><p>Out of 81,410 residues in the test-sets, 602 residues are annotated as “ACT_SITE” by UniProt ##REF##14681372##[17]## or CSA ##REF##14681376##[16]##. For those active sites, CRESCENDO ##REF##15364576##[8]## could either correctly predict (TP) or fail to predict (FN) (see text). Two active sites of ‘d7odca1’ (A chain of PDB 7odc), which is a SCOP domain in the test-sets, was discarded as of an internal error; hence, 600 active sites either in the TP or FN. The number of predicted residues is same as the sum of TP and FP for each ESST type. Note that residues only from the first cluster of predicted residues (rank 1) were considered in this analysis. TP: True Positive, FP: False Positive, FN: False Negative, TN: True Negative, SENS: Sensitivity, SPEC: Specificity, COV: Coverage.</p></fn></table-wrap-foot> <table-wrap-foot><fn id="nt117"><label/><p>11,917 residues are annotated by InterPare ##REF##16122378##[18]## out of 81,410 residues in the test-sets. The definitions of TP, FP, FN, TN, SENS, SPEC, COV, and F-measure are same as ##TAB##4##Table 5##. Residues only from the first cluster of predicted residues were considered in this analysis. TP: True Positive, FP: False Positive, FN: False Negative, TN: True Negative, SENS: Sensitivity, SPEC: Specificity, COV: Coverage.</p></fn></table-wrap-foot> <fn-group><fn fn-type="COI-statement"><p>The authors have declared that no competing interests exist.</p></fn><fn fn-type="financial-disclosure"><p>SG is partially supported by Mogam Science Scholarship Foundation of Korea.</p></fn></fn-group>
<graphic id="pcbi-1000179-t001-1" xlink:href="pcbi.1000179.t001"/> <graphic id="pcbi-1000179-t002-2" xlink:href="pcbi.1000179.t002"/> <graphic xlink:href="pcbi.1000179.g001"/> <graphic id="pcbi-1000179-t003-3" xlink:href="pcbi.1000179.t003"/> <graphic id="pcbi-1000179-t004-4" xlink:href="pcbi.1000179.t004"/> <graphic xlink:href="pcbi.1000179.g002"/> <graphic xlink:href="pcbi.1000179.g003"/> <graphic id="pcbi-1000179-t005-5" xlink:href="pcbi.1000179.t005"/> <graphic id="pcbi-1000179-t006-6" xlink:href="pcbi.1000179.t006"/> <inline-graphic xlink:href="pcbi.1000179.e001.jpg" mimetype="image"/> <inline-graphic xlink:href="pcbi.1000179.e002.jpg" mimetype="image"/> <inline-graphic xlink:href="pcbi.1000179.e003.jpg" mimetype="image"/> <graphic xlink:href="pcbi.1000179.e004.jpg" mimetype="image" position="float"/> <inline-graphic xlink:href="pcbi.1000179.e005.jpg" mimetype="image"/>
<media xlink:href="pcbi.1000179.s001.doc"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pcbi.1000179.s002.doc"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pcbi.1000179.s003.doc"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pcbi.1000179.s004.doc"><caption><p>Click here for additional data file.</p></caption></media>
[{"label": ["2"], "element-citation": ["\n"], "surname": ["Dayhoff", "Eck"], "given-names": ["MO", "RV"], "year": ["1968"], "source": ["Atlas of Protein Sequence and Structure. Volume 3"], "publisher-loc": ["Silver Spring (Maryland)"], "publisher-name": ["National Biomedical Research Foundation"], "size": ["33"]}, {"label": ["7"], "element-citation": ["\n"], "surname": ["Zuckerkandl", "Pauling", "Kasha", "Pullman"], "given-names": ["E", "LB", "M", "B"], "year": ["1962"], "article-title": ["Molecular disease, evolution, and genetic heterogeneity."], "source": ["Horizons in Biochemistry"], "publisher-loc": ["New York"], "publisher-name": ["Academic Press"], "fpage": ["189"], "lpage": ["225"]}, {"label": ["32"], "element-citation": ["\n"], "surname": ["Word"], "given-names": ["MJ"], "year": ["2000"], "source": ["All-atom small-probe contact surface analysis: An information-rich description of molecular goodness-of-fit [PhD thesis]"], "publisher-loc": ["Durham (North Carolina)"], "publisher-name": ["Duke University"]}]
PLoS Comput Biol. 2008 Oct 3; 4(10):e1000179