<title>Background</title> <p>DNA microarray technology [##REF##9634850##1##,##REF##7569999##2##] has rapidly advanced due to the intrinsic and unprecedented ability to simultaneously measure gene expression on a whole genome basis. Microarray technology continues to develop and is widely cited as offering much utility for translational science, from improved drug discovery, including target discovery, to improved clinical diagnostics and disease stage determination, prognostics and treatment selection, and more. With the prospect of microarray-derived biomarkers being applied in clinical applications, the bar is substantially raised for identification of informative genes enabling accurate classifiers, and efforts to this end are prevalent in the literature [##UREF##0##3##, ####REF##11389458##4##, ##REF##11251224##5##, ##REF##12461517##6##, ##REF##15379650##7##, ##REF##12499298##8##, ##REF##15852500##9##, ##REF##16709585##10##, ##REF##17338815##11####17338815##11##]. More specifically, there is a compelling need to identify a subset of genes from among the more than 20,000 in the entire genome that allow robust classifiers to be developed. The difficulty and challenge is to overcome the intrinsic characteristics of microarray data that contains a substantially small number of samples when compared to the number of genes [##REF##16108087##12##,##REF##17303535##13##]. These characteristics lead to the risk of fitting to noise as genes with high variability unrelated to phenotype masquerade as informative genes. The truly differentiating signals derived from small numbers of experimental replicates are difficult to distinguish in the sea of noise, leading to the appearance of unstable (i.e., non-reproducible) significant gene lists [##REF##16964229##14##, ####REF##16026597##15##, ##REF##18155896##16####18155896##16##].</p> <p>Gene selection is synonymous with feature selection or variable selection in machine learning, a process extensively used to mitigate the so called "curse of dimensionality" [##UREF##1##17##, ####UREF##2##18##, ##REF##16249260##19##, ##UREF##3##20####3##20##]. Generally, gene selection is done for either hypothesis testing or hypothesis generation. Selecting a subset of genes as molecular signatures or biomarkers that could be used for developing a generalized and accurate classifier for differentiating phenotypes is a hypothesis testing process [##REF##11983868##21##], wherein rigorous validation is needed. On the other hand, identifying a list of putatively relevant genes related to a phenotype or endpoint of interest for subsequent research is a hypothesis generating process [##REF##16398926##22##], wherein validation of the genes is much more relaxed; the genes so identified often shed light on the fundamental molecular mechanisms and biological processes under study.</p> <p>Selecting and validating an "optimal" set of genes for a molecular signature or biomarker for a robust classifier is a complicated and time-consuming task. An exhaustive search encompassing all possible gene subsets to find the set yielding the smallest error can be an intractable computational task. Worse still, because the number of genes far outnumber samples, the potential for fitting to random noise is high, making stringent testing and validation essential [##REF##15308542##23##,##REF##16670007##24##].</p> <p>Most methods to select informative genes for classification model development reported in the literature rely on ranked genes by fold change, correlation coefficient, or p-value from a t-statistic, Wilcoxon statistic, or analysis of variance (ANOVA), or some combination of these [##REF##16398926##22##,##REF##11751221##25##, ####REF##15450124##26##, ##REF##17915022##27##, ##REF##15680584##28##, ##REF##16504159##29##, ##REF##18175770##30####18175770##30##]. To a greater or lesser degree, all of these methods yield an informative gene list varying on the sample size, which has led doubt on microarray reliability [##REF##16964229##14##, ####REF##16026597##15##, ##REF##18155896##16####18155896##16##]. In theory, true phenotype differentiating genes should be expected to express consistently with each other regardless of the sample size. In other words, the list of informative genes as well as the underlying mechanisms inferred by these genes should have nothing to do with the sample size.</p> <p>In this study, a bagging [##UREF##4##31##] based new hybrid gene selection approach was investigated to identify informative genes. The rationale of the approach is that informative genes should consistently show significance for different variations of sample size. Accordingly, many re-sampling iterations are conducted to generate different variations of sample size and the frequency of genes exhibiting significance throughout the iterations formed the basis for identification of the informative genes that are considered as a Very Important Pool (VIP) of genes. In reality, the VIP genes can be identified using any existing gene selection approach or their combinations and can be used to derive molecular signatures to build robust classifiers with good generalization capability, or to narrow subsequent research to reveal relevant, fundamental molecular mechanisms in biological processes. In this study, t-statistic and discriminatory analysis are used to evaluate the significance of genes. In the t-statistic, the significant genes are identified based on p-values. In the discriminatory analysis, disjoint Principal Component Analyses (PCAs) are conducted for each class of samples, and those genes with high discrimination power (DP) [##UREF##5##32##] are identified as significant genes. The VIP genes are those having high frequency of showing significance in the re-sampling iterations. The utility of the proposed approach was demonstrated with nine diverse microarray datasets for identifying the informative genes for classifier development and compared with commonly used p-value ranking gene selection approaches.</p>
<title>Materials and methods</title> <title>Microarray datasets and software</title> <p>Nine publicly available microarray datasets were used to demonstrate the relative prediction performance of the proposed VIP gene selection approach. The datasets are from Alon <italic>et al</italic>. [##REF##10359783##47##], Beer <italic>et al</italic>. [##REF##12118244##48##], Bhattacharjee <italic>et al</italic>. [##REF##11707567##49##], Chen <italic>et al</italic>. [##REF##12058060##50##], Gordon <italic>et al</italic>. [##REF##12208747##51##], Pomeroy <italic>et al</italic>. [##REF##11807556##52##], Resenwald <italic>et al</italic>. [##REF##12075054##53##], Shipp <italic>et al</italic>. [##REF##11786909##54##], Singh <italic>et al</italic>. [##REF##12086878##55##], Yeoh <italic>et al</italic>. [##REF##12086872##56##], and van't Veer <italic>et al</italic>. [##REF##11823860##57##], that for convenience are hereafter respectively referred to as "Alon", "Beer", "Bhattacharjee", "Chen", "Gordon", "Pomeroy", "Resenwald", "Shipp", "Singh", "Yeoh", and "van't Veer"; information for each dataset is given in Table ##TAB##0##1##.</p> <p>The VIP gene selection approach was developed using the programming language Matlab<sup>® </sup>7.0, running on a DELL™ Precision 490 workstation equipped with two Intel<sup>® </sup>Dual Core Xeon™ 3.0 GHz processors and 2 GB of memory. The Matlab codes are available upon request.</p> <p>The biological interpretation of genes was conducted using PathArt <ext-link ext-link-type="uri" xlink:href="http://www.jubilantbiosys.com/ppa.htm"/> through the FDA genomic tool, ArrayTrack <ext-link ext-link-type="uri" xlink:href="http://www.fda.gov/nctr/science/centers/toxicoinformatics/ArrayTrack/"/>.</p> <title>Algorithm</title> <p>The VIP gene selection approach combines discriminatory powers derived from two independent principal component analyses and p values from t-statistic to filter genes based on a bagging, re-sampling technique. The algorithmic process is depicted in Figure ##FIG##1##2##, where the training dataset is composed of <italic>n</italic><sub>1 </sub>samples of class 1 and <italic>n</italic><sub>2 </sub>samples of class 2. Samples of class 1 and class 2 are represented by the matrices <bold>X</bold><sub>1 </sub>and <bold>X</bold><sub>2</sub>, respectively. The VIP genes are chosen through the following steps:</p> <p>1. Randomly select 75% of samples from the training data, <bold>X</bold><sub>1 </sub>and <bold>X</bold><sub>2, </sub>using a bagging, re-sampling strategy. The selected samples are represented with <bold>X</bold><sub>1<italic>m </italic></sub>for class 1 and <bold>X</bold><sub>2<italic>m </italic></sub>for class 2.</p> <p>2. Rank genes by their p-values and only keep the top 100 genes for next step. P-values are calculated from a two-tailed and unpaired t-statistic with pooled variance estimate (i.e., equal variances or homoscedastic assumption) on <bold>X</bold><sub>1<italic>m </italic></sub>and <bold>X</bold><sub>2<italic>m</italic></sub>. The remaining data are represented by  and , respectively.</p> <p>3. Rank genes based on their discrimination powers (DPs) and the increment the frequencies of the top 50 genes by one. The calculation of DPs is described in detail in the next section "calculation of discrimination power".</p> <p>4. Repeat steps one through three 100 times.</p> <p>5. Rank genes by frequencies and choose the top 50 genes as VIP genes.</p> <title>Calculation of discrimination power</title> <p>DPs are calculated from two independent principal component analyses (PCAs). PCA is performed on each p-value-filtered data,  and  from step 2. The optimum number of components for each PCA is determined using Malinowski's factor indicator function (IND) [##UREF##6##58##] with eqs. (1) – (3):</p> <p></p> <p></p> <p></p> <p>where <bold>X </bold>is either  and ; <bold>T </bold>and <bold>P </bold>are the score and loading matrices of the PCA; <italic>λ</italic><sub><italic>i </italic></sub>is the <italic>i</italic><sup><italic>th </italic></sup>eigenvalue of the total <italic>g </italic>eigenvalues; and <italic>n </italic>and <italic>p </italic>are the number of samples and the number of genes in the matrix <bold>X</bold>, respectively. The optimum number (<italic>k</italic>) of components for the PCA is the one that yields the minimum <italic>IND </italic>value. The discrimination power (DP<sub><italic>j</italic></sub>) for a gene <italic>j </italic>can be calculated with eq. (4):</p> <p></p> <p>where , , , and  are the <italic>j </italic>columns of matrices <bold>E</bold><sub>11</sub>, <bold>E</bold><sub>12</sub>, <bold>E</bold><sub>22</sub>, and <bold>E</bold><sub>21</sub>, respectively. <bold>E</bold><sub>11 </sub>and <bold>E</bold><sub>12 </sub>are the residue matrices after projecting  into the PCA spaces of class 1 and class 2, respectively, while <bold>E</bold><sub>22 </sub>and <bold>E</bold><sub>21 </sub>are the residue matrices after projecting  into the PCA spaces of class 1 and class 2, respectively. A residue matrix is calculated with eq. (5).</p> <p></p> <p>where <bold>E </bold>is one of the four residue matrices <bold>E</bold><sub>11</sub>, <bold>E</bold><sub>12</sub>, <bold>E</bold><sub>22</sub>, and <bold>E</bold><sub>21</sub>.</p> <title>Prediction performance</title> <p>The prediction performance of a Nearest-Centroid classifier in this study is characterized with four metrics: accuracy, specificity, sensitivity, and the Matthew's correlation coefficient (MCC). The metrics can be calculated from the prediction confusion matrix shown in Table ##TAB##4##5## as follows:</p> <p></p> <p></p> <p></p> <p></p> <p>where TP, TN, FP, FN are respectively the numbers of true positive, true negative, false positive, and false negative predictions in the confusion matrix (Table ##TAB##4##5##).</p>
<title>Results</title> <p>The VIP gene selection approach for microarray based molecular signatures was applied to the nine publicly available microarray gene expression datasets described in Table ##TAB##0##1##. For the purpose of comparison, the p-value ranking method was also used. For each dataset, an unbiased sample splitting, gene selection, and validation dataset prediction process as depicted in Figure ##FIG##0##1## was carried out. Briefly, a dataset is first randomly split into a training set with two thirds of the samples and a validation set with the remaining samples. With validation samples set aside, gene selection and classifier development are done using the training samples. Two lists of 50 genes are selected, one using the proposed VIP gene selection approach and the other using p-value ranking. The p-value ranking is based on an unpaired, two-tailed t-statistic with pooled variance estimate. In order to exam whether the VIP gene selection approach can identify informative genes or not, three sets of classifiers were generated, one for the VIP genes, one for the p-value genes and another for the genes uniquely identified by the VIP method (called unique genes hereafter). A Nearest-Centroid[##REF##15705458##33##] classification method was used to develop classifiers. These classifiers are applied to predict the validation samples. The prediction performance of classifiers were compared by accuracies, specificities, sensitivities, and the Matthew's correlation coefficients (MCCs). The definitions of these measures are given in the section titled "materials and methods". The sample splitting, gene selection, and validation dataset prediction steps were repeated 50 times for adequate statistics.</p> <p>We first compared the classifiers based on the VIP genes with those from the p-value ranking. As shown in Table ##TAB##1##2##, the VIP classifiers exhibited somewhat better performance compared to the classifiers from the p-value selected genes. The p-values from t-statistic for accuracy, specificity, sensitivity and MCC between two groups of classifiers (the VIP classifiers versus the p-value ranking classifiers) are 0.0027, 0.32, 0.059, and 0.0092, respectively. Therefore, at the 0.05 confidence level, the improvement of classifier measured in MCC and accuracy is significant, but not for specificity and sensitivity. The results indicate that the VIP genes may convey more, but not less, biologically relevant information than the p-value selected genes.</p> <p>Next, to determine whether the unique genes indeed contribute to the sample differentiation and thus biological relevance, we compared prediction performance of the classifiers built from unique genes with those built from the p-value ranked genes across the nine datasets. The average number of unique genes for each dataset is also listed in Table ##TAB##1##2##. It was shown that the average performance metrics (accuracy, specificity, sensitivity, and MCC) for classifiers built from unique genes (number from 14 to 22) are not very different from those built from top 50 p-value ranked genes for all nine datasets. The difference of each pair of average performance metrics is respectively tested across nine datasets with a null hypothesis that the compared performance metrics (accuracy, specificity, sensitivity, or MCC) is not very different from each other by using a paired and two-tailed t-statistic. The p-values given by t-statistic are 0.63, 0.77, 0.95, and 0.81 for accuracy, specificity, sensitivity, and MCC respectively. Apparently, the differences of all prediction performance metrics among classifiers are not significant at the 0.05 confidence level. This suggests that the unique VIP genes are statistically equivalent as those identified by p-value ranking in distinguishing different types of samples. Therefore, these unique genes could be an additional subset of genes which are equally as important as those selected with p-value ranking. The existence of additional subsets of classifying genes may imply that there exist multiple biological processes for studied endpoints or co-factors.</p> <p>Lastly, to gain more understanding of the VIP genes in terms of biology related to the investigated dataset, we further examined the unique genes as well as the common genes shared by the p-value method in the van't Veer dataset using PathArt <ext-link ext-link-type="uri" xlink:href="http://www.jubilantbiosys.com/ppa.htm"/> through the FDA genomic tool, ArrayTrack <ext-link ext-link-type="uri" xlink:href="http://www.fda.gov/nctr/science/centers/toxicoinformatics/ArrayTrack/"/>. PathArt is a pathway analysis tool that contains disease related canonical pathways manually created from the literature. The van't Veer dataset contains 24 unique genes and 26 common genes. Of 24 unique genes, ten genes were found in PathArt and were listed in Table ##TAB##2##3##. Most of these ten genes involve biological processes related to various cancers; for example, IGFBP5 and MMP9 are directly related to breast cancer. We also examined the pathways associated with the 26 common genes and found seven unique genes were involved in seven pathways identified by the common genes (Table ##TAB##3##4##). These results demonstrate that the unique genes not identified by the p-value ranking could convey additional important information for biological interpretation.</p>
<title>Discussion</title> <p>Quantitatively assessing the effectiveness of gene selection methods can be problematic owing to several limitations among which selection bias caused by information leakage from training phase to validation phase figures prominently [##REF##16670007##24##]. The most severe bias was described by Ambroise <italic>et al</italic>. [##REF##11983868##21##] and Simon <italic>et al</italic>. [##REF##12509396##34##] as occurring when identifying genes from the entire dataset (i.e., training set and validation set) and using them in cross-validation. Wessels <italic>et al</italic>. [##REF##15817694##35##] and Lai <italic>et al</italic>. [##REF##16670007##24##] describe a less severe bias. Typically, the training samples are used to generate a series of gene subsets, while the performance of a classifier trained with the training samples and tested with the validation samples is applied to estimate the informativeness of each gene subset. The bias derives from the fact that the validation samples are used to select the best performing gene subset. Since optimization of the gene subset is part of the training process, selection of the best gene subset should be conducted with the training samples only. This process as shown in Figure ##FIG##0##1## has been carried out in this study to assess the utility of the proposed VIP gene selection method by entirely avoiding bias due to information leakage from validation dataset in training phase.</p> <p>Classification method selection is another important aspect of developing predictive models from microarray expression data. Many classifiers are created with one or more adjustable parameters that affect not only the prediction accuracy but also the complexity of the classifiers and the computational expense of their use. The proper adjustment of the tuneable parameters can affect the fairness of comparative predictive performance assessments. For example, the relatively simple k-Nearest Neighbour (KNN)[##REF##11108479##36##] classification method has a tuneable k in the prediction rules. Adjusting k requires some validation process be carried out. Generally, different validation strategies such as leave-one-out cross validation, k-Fold cross-validation, or Monte Carlo validation, will yield different preferred values of k. Other classification approaches, such as Support Vector Machine (SVM) [##REF##8555380##37##], Partial Least Squares Discriminant Analysis (PLS-DA) [##REF##16808466##38##], Random Forest (RF)[##REF##16398926##22##], and Artificial Neural Networks (ANN) [##REF##12221094##39##] are considerably more complex by comparison, causing more work and computational cost. According to Wessels <italic>et al</italic>. [##REF##15817694##35##], Michiels <italic>et al</italic>. [##REF##15705458##33##], and Lai <italic>et al</italic>. [##REF##16670007##24##], choosing a classification method with a limited complexity can help prevent over-training, thus providing a more robust predictor. In this study, the simple classification approach Nearest-Centroid was used to develop and compare classifiers based on unique VIP genes and top 50 p-value ranked genes. Since the method lacks a tuneable parameter, risks of overtraining are lessened compared to other methods, as are the chances that differences in prediction accuracy are due to method rather than selected genes.</p> <p>Commonly used gene selection approaches in DNA microarray data analysis, such as p-value ranking or fold change ranking and others, assume that all genes are stochastic variables that are unrelated to each for purposes of calculating significance. This assumption is inconsistent with the actual biological processes where most genes have some interdependency to and are interlinked with other genes through complex mechanisms and pathways. In contrast, the proposed VIP gene selection approach uses both DPs and p-values to assess the discriminatory capability of genes in differentiating sample types. DPs are calculated from two independent PCAs that fuse discriminating information across whole genes. The interdependence and interlinking effects among genes are embedded within the DP calculation, enhancing rather than reducing many aspects of actual biological processes. Furthermore, the bagging re-sampling technique, which has been used to analyze microarray data for clustering [##REF##18218074##40##, ####REF##18204054##41##, ##REF##12801869##42####12801869##42##] and classification [##REF##15466910##43##, ####REF##15978569##44##, ##REF##15691862##45##, ##REF##17624926##46####17624926##46##], is used here to mitigate the chance selection of genes. Compared with p-value ranking-type gene selection approaches, the proposed VIP gene selection has great potential to select additional informative genes that can be useful for either biological insights or to improve the prediction performance of classifiers.</p>
<title>Conclusion</title> <p>The new hybrid gene selection approach was investigated for identifying VIP genes from nine diverse gene expression datasets. The VIP gene selection approach quantifies discriminatory capability for differentiating sample classes using both discrimination analysis and p-value ranking through a bagging sampling process. The classifiers built from those unique VIP genes showed comparable prediction capability to those built from the top 50 t-statistic based p-value ranked genes in predicting the types of unknown samples. Therefore, the VIP gene selection approach could provide an additional subset of genes which are of equivalent performance as those selected with the t-statistic based p-value ranking. The subset of VIP genes could convey additional biological information in terms of associated biological pathways and mechanisms during hypothesis generation. Similarly, the VIP genes could be used to improve molecular fingerprints for use in clinical biomarkers.</p>
<p>This is an open access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0"/>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p> <title>Background</title> <p>Advances in DNA microarray technology portend that molecular signatures from which microarray will eventually be used in clinical environments and personalized medicine. Derivation of biomarkers is a large step beyond hypothesis generation and imposes considerably more stringency for accuracy in identifying informative gene subsets to differentiate phenotypes. The inherent nature of microarray data, with fewer samples and replicates compared to the large number of genes, requires identifying informative genes prior to classifier construction. However, improving the ability to identify differentiating genes remains a challenge in bioinformatics.</p> <title>Results</title> <p>A new hybrid gene selection approach was investigated and tested with nine publicly available microarray datasets. The new method identifies a Very Important Pool (VIP) of genes from the broad patterns of gene expression data. The method uses a bagging sampling principle, where the re-sampled arrays are used to identify the most informative genes. Frequency of selection is used in a repetitive process to identify the VIP genes. The putative informative genes are selected using two methods, t-statistic and discriminatory analysis. In the t-statistic, the informative genes are identified based on p-values. In the discriminatory analysis, disjoint Principal Component Analyses (PCAs) are conducted for each class of samples, and genes with high discrimination power (DP) are identified. The VIP gene selection approach was compared with the p-value ranking approach. The genes identified by the VIP method but not by the p-value ranking approach are also related to the disease investigated. More importantly, these genes are part of the pathways derived from the common genes shared by both the VIP and p-ranking methods. Moreover, the binary classifiers built from these genes are statistically equivalent to those built from the top 50 p-value ranked genes in distinguishing different types of samples.</p> <title>Conclusion</title> <p>The VIP gene selection approach could identify additional subsets of informative genes that would not always be selected by the p-value ranking method. These genes are likely to be additional true positives since they are a part of pathways identified by the p-value ranking method and expected to be related to the relevant biology. Therefore, these additional genes derived from the VIP method potentially provide valuable biological insights.</p>
<title>Disclaimer</title> <p>The views presented in this article do not necessarily reflect those of the US Food and Drug Administration.</p> <title>Competing interests</title> <p>The authors declare that they have no competing interests.</p> <title>Authors' contributions</title> <p>ZS had the original idea, developed the method, did all calculations and data analysis, and wrote the first draft of manuscript. WT had the original idea, discussed on data analysis and presentation of results. HF, HH, LS, and RP involved in discussion on data analysis, verified some of the calculations and assisted with writing the manuscript. All authors read and approved the final manuscript.</p>
<title>Acknowledgements</title> <p>ZS is grateful to the National Center for Toxicological Research (NCTR) of U.S. Food and Drug Administration (FDA) for postdoctoral support through the Oak Ridge Institute for Science and Education (ORISE).</p> <p>This article has been published as part of <italic>BMC Bioinformatics </italic>Volume 9 Supplement 9, 2008: Proceedings of the Fifth Annual MCBIOS Conference. Systems Biology: Bridging the Omics. The full contents of the supplement are available online at <ext-link ext-link-type="uri" xlink:href="http://www.biomedcentral.com/1471-2105/9?issue=S9"/></p>
<fig position="float" id="F1"><label>Figure 1</label><caption><p>The flowchart for the classifier development and validation using three gene sets: (A) Top 50 p-value ranked genes; (B) Top 50 VIP genes; and (C) the unique VIP genes. Specifically, the data set is first randomly divided into two thirds of samples for training and the remainder for validation. Next, three sets of genes are generated solely based on the training set, and are subsequently used to develop Nearest-Centroid classifiers. Lastly, the classifiers are used to predict the validation samples and their respective prediction performance measured by accuracy (Acc), specificity (Spec), sensitivity (Sens), and Matthew's correlation coefficient (MCC) are calculated. The process is repeated 50 times and the averaged performance metrics are reported in Table 2.</p></caption></fig> <fig position="float" id="F2"><label>Figure 2</label><caption><p>The detailed process for identifying a very important pool (VIP) of genes. X<sub>1 </sub>and X<sub>2 </sub>are, respectively, the gene expression profiles for class 1 samples and class 2 samples in the training set. X<sub>1<italic>m </italic></sub>and X<sub>2<italic>m </italic></sub>are samples randomly selected from X<sub>1 </sub>and X<sub>2 </sub>in the m<sup><italic>th </italic></sup>bagging step.  and  are the genes remaining after filtering genes from X<sub>1<italic>m </italic></sub>and X<sub>2<italic>m</italic></sub>, respectively. Malinowski's factor indicator function (IND) is calculated with equations  and <italic>IND</italic><sub><italic>k </italic></sub>= <italic>RE</italic><sub><italic>k</italic></sub>/(<italic>n </italic>- <italic>k</italic>)<sup>2</sup>, where <italic>λ</italic><sub><italic>i </italic></sub>is the <italic>i</italic><sup>th </sup>eigenvalue of the total <italic>g </italic>eigenvalues; <italic>n </italic>is the number of samples and <italic>p </italic>is the number of genes. The optimum number (<italic>k</italic>) of components corresponds to the IND minimum. E<sub>11 </sub>and E<sub>21 </sub>are the residue matrices after projecting X<sub>1<italic>m </italic></sub>and X<sub>2<italic>m </italic></sub>into the PCA space for class 1, respectively, while E<sub>22 </sub>and E<sub>12 </sub>are the residue matrices after projecting X<sub>2<italic>m </italic></sub>and X<sub>1<italic>m </italic></sub>into the PCA space for class 2, respectively. The discrimination power (DP) of a gene <italic>j </italic>is calculated with the equation: , where , , , and  are the <italic>j </italic>columns of residue matrices E<sub>11</sub>, E<sub>12</sub>, E<sub>22</sub>, and E<sub>21</sub>, respectively.</p></caption></fig>
<table-wrap position="float" id="T1"><label>Table 1</label><caption><p>Nine microarray datasets used in the study.</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>Name</bold></td><td align="center"><bold>Cancer type</bold></td><td align="center"><bold>Prediction task</bold></td><td align="center"><bold>Sample size</bold></td><td align="center"><bold>Number of events</bold></td><td align="center"><bold>Number of genes</bold></td><td align="center"><bold>Reference</bold></td></tr></thead><tbody><tr><td align="center">Beer</td><td align="center">Lung adenocarcinoma</td><td align="center">Survival</td><td align="center">86</td><td align="center">24</td><td align="center">6532</td><td align="center">[##REF##12118244##48##]</td></tr><tr><td align="center">Bhattacharjee</td><td align="center">Lung adenocarcinoma</td><td align="center">4-year survival</td><td align="center">62</td><td align="center">31</td><td align="center">5403</td><td align="center">[##REF##11707567##49##]</td></tr><tr><td align="center">Chen</td><td align="center">Hepatocellular carcinoma</td><td align="center">Tumors</td><td align="center">156</td><td align="center">82</td><td align="center">3964</td><td align="center">[##REF##12058060##50##]</td></tr><tr><td align="center">Pomeroy</td><td align="center">Medulloblastoma</td><td align="center">Medulloblastoma survival</td><td align="center">60</td><td align="center">21</td><td align="center">7129</td><td align="center">[##REF##11807556##52##]</td></tr><tr><td align="center">Rosenwald</td><td align="center">Non-Hodgkin lymphoma</td><td align="center">Survival</td><td align="center">240</td><td align="center">138</td><td align="center">7399</td><td align="center">[##REF##12075054##53##]</td></tr><tr><td align="center">Shipp</td><td align="center">Diffuse large b-cell lymphoma (DLBCL)</td><td align="center">Cured</td><td align="center">58</td><td align="center">32</td><td align="center">6817</td><td align="center">[##REF##11786909##54##]</td></tr><tr><td align="center">Singh</td><td align="center">Prostate cancer</td><td align="center">Tumors</td><td align="center">102</td><td align="center">52</td><td align="center">12600</td><td align="center">[##REF##12086878##55##]</td></tr><tr><td align="center">Yeoh</td><td align="center">Acute lymphocytic leukaemia</td><td align="center">Relapse-free survival</td><td align="center">233</td><td align="center">32</td><td align="center">12236</td><td align="center">[##REF##12086872##56##]</td></tr><tr><td align="center">van't Veer</td><td align="center">Breast cancer</td><td align="center">5-year metastasis-free survival</td><td align="center">97</td><td align="center">46</td><td align="center">4948</td><td align="center">[##REF##11823860##57##]</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T2"><label>Table 2</label><caption><p>Comparison of prediction performance for Nearest-Centroid classifiers built from unique VIP genes, top 50 p-value ranked genes, and 50 VIP genes. The classifier performance metrics, including accuracy (Acc), specificity (Spec), Sensitivity (Sens), and Matthew's correlation coefficient (MCC) were calculated based on averages of 50 repetitions of sample splitting, gene selection, and validation dataset prediction.</p></caption><table frame="hsides" rules="groups"><thead><tr><td/><td align="center" colspan="5"><bold>Unique VIP genes</bold></td><td align="center" colspan="4"><bold>50 p-value ranked genes</bold></td><td align="center" colspan="4"><bold>50 VIP genes</bold></td></tr><tr><td/><td colspan="13"><hr/></td></tr><tr><td align="left"><bold>Data set</bold></td><td align="center"><bold>Number of genes</bold></td><td align="center"><bold>Acc (%)</bold></td><td align="center"><bold>Spec (%)</bold></td><td align="center"><bold>Sens (%)</bold></td><td align="center"><bold>MCC</bold></td><td align="center"><bold>Acc (%)</bold></td><td align="center"><bold>Spec (%)</bold></td><td align="center"><bold>Sens (%)</bold></td><td align="center"><bold>MCC</bold></td><td align="center"><bold>Acc (%)</bold></td><td align="center"><bold>Spec (%)</bold></td><td align="center"><bold>Sens (%)</bold></td><td align="center"><bold>MCC</bold></td></tr></thead><tbody><tr><td align="left">Beer</td><td align="center">15</td><td align="center">64.7</td><td align="center">38.3</td><td align="center">74.0</td><td align="center">0.13</td><td align="center">64.7</td><td align="center">38.3</td><td align="center">74.0</td><td align="center">0.12</td><td align="center">65.2</td><td align="center">35.4</td><td align="center">75.6</td><td align="center">0.11</td></tr><tr><td align="left">Bhattacharjee</td><td align="center">17</td><td align="center">58.7</td><td align="center">57.8</td><td align="center">59.6</td><td align="center">0.18</td><td align="center">58.0</td><td align="center">59.2</td><td align="center">56.8</td><td align="center">0.16</td><td align="center">58.6</td><td align="center">59.4</td><td align="center">57.8</td><td align="center">0.18</td></tr><tr><td align="left">Chen</td><td align="center">14</td><td align="center">96.5</td><td align="center">99.9</td><td align="center">93.6</td><td align="center">0.93</td><td align="center">95.3</td><td align="center">100.0</td><td align="center">91.2</td><td align="center">0.91</td><td align="center">95.8</td><td align="center">100.0</td><td align="center">92.1</td><td align="center">0.92</td></tr><tr><td align="left">Pomeroy</td><td align="center">20</td><td align="center">60.8</td><td align="center">54.0</td><td align="center">64.2</td><td align="center">0.19</td><td align="center">60.8</td><td align="center">51.7</td><td align="center">65.3</td><td align="center">0.18</td><td align="center">62.4</td><td align="center">55.7</td><td align="center">65.8</td><td align="center">0.22</td></tr><tr><td align="left">Rosenwald</td><td align="center">18</td><td align="center">55.5</td><td align="center">58.1</td><td align="center">53.6</td><td align="center">0.12</td><td align="center">56.8</td><td align="center">63.2</td><td align="center">52.2</td><td align="center">0.15</td><td align="center">57.4</td><td align="center">62.3</td><td align="center">53.8</td><td align="center">0.16</td></tr><tr><td align="left">Shipp</td><td align="center">18</td><td align="center">51.6</td><td align="center">50.8</td><td align="center">52.5</td><td align="center">0.03</td><td align="center">47.9</td><td align="center">51.8</td><td align="center">43.0</td><td align="center">-0.05</td><td align="center">49.0</td><td align="center">47.4</td><td align="center">51.0</td><td align="center">-0.02</td></tr><tr><td align="left">Singh</td><td align="center">15</td><td align="center">94.3</td><td align="center">98.3</td><td align="center">91.7</td><td align="center">0.89</td><td align="center">98.1</td><td align="center">100.0</td><td align="center">96.9</td><td align="center">0.96</td><td align="center">97.8</td><td align="center">100.0</td><td align="center">96.4</td><td align="center">0.96</td></tr><tr><td align="left">Yeoh</td><td align="center">22</td><td align="center">74.6</td><td align="center">37.8</td><td align="center">80.2</td><td align="center">0.15</td><td align="center">78.2</td><td align="center">31.0</td><td align="center">85.4</td><td align="center">0.15</td><td align="center">80.2</td><td align="center">35.0</td><td align="center">87.0</td><td align="center">0.21</td></tr><tr><td align="left">van't Veer</td><td align="center">20</td><td align="center">64.8</td><td align="center">64.8</td><td align="center">64.9</td><td align="center">0.30</td><td align="center">65.2</td><td align="center">61.5</td><td align="center">68.6</td><td align="center">0.31</td><td align="center">66.9</td><td align="center">66.1</td><td align="center">67.6</td><td align="center">0.34</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T3"><label>Table 3</label><caption><p>Pathways identified for the unique VIP genes and common genes for the van't Veer dataset.</p></caption><table frame="hsides" rules="groups"><thead><tr><td/><td align="center"><bold>Accession number (Symbol)</bold></td><td align="left"><bold>Full Name</bold></td><td align="left"><bold>Pathway name</bold></td><td align="left"><bold>Category (e.g. disease)</bold></td></tr></thead><tbody><tr><td align="center"><bold>Unique VIP genes</bold></td><td align="center">AF055033 (IGFBP5)</td><td align="left">Insulin-like growth factor binding protein 5</td><td align="left">Estrogen signaling pathway</td><td align="left">Breast cancer</td></tr><tr><td/><td/><td/><td align="left">IGF signaling pathway</td><td align="left">Lung cancer</td></tr><tr><td/><td align="center">NM_000599 (IGFBP5)</td><td/><td align="left">AR mediated pathway; insulin-like growth factor-1 signaling pathway</td><td align="left">Prostate cancer</td></tr><tr><td/><td/><td/><td align="left">Responsive genes</td><td align="left">Ovarian cancer</td></tr><tr><td/><td align="center">NM_000017 (ACADS)</td><td align="left">Acyl-coenzyme A dehydrogenase, C-2 to C-3 short chain</td><td align="left">Responsive genes</td><td align="left">Colon cancer</td></tr><tr><td/><td align="center">NM_004994 (MMP9)</td><td align="left">Matrix metallopeptidase 9 (gelatinase B, 92 kDa gelatinase, 92 kDa type IV collagenase)</td><td align="left">Heregulin, and CXCL12 signaling pathway</td><td align="left">Breast cancer</td></tr><tr><td/><td/><td/><td align="left">Bombesin, IL10, IL8, TGFbeta, and HGF signaling pathway; responsive genes</td><td align="left">Prostate cancer</td></tr><tr><td/><td/><td/><td align="left">Responsive genes; thrombospondin signaling pathway</td><td align="left">Pancreatic cancer</td></tr><tr><td/><td/><td/><td align="left">Gastrin, HGF, and IL4 signaling pathway; integrin, and UPAR mediated pathway</td><td align="left">Colon cancer</td></tr><tr><td/><td/><td/><td align="left">Responsive genes</td><td align="left">Chronic myeloid leukemia</td></tr><tr><td/><td/><td/><td align="left">EGF signaling pathway; VEGF mediated pathway; responsive genes</td><td align="left">Ovarian cancer</td></tr><tr><td/><td/><td/><td align="left">HGF, and IL6 signaling pathway; Responsive genes</td><td align="left">Lung cancer</td></tr><tr><td/><td align="center">NM_001197 (BIK)</td><td align="left">BCL2-interacting killer (apoptosis-inducing)</td><td align="left">p53 mediated pathway</td><td align="left">Colon cancer</td></tr><tr><td/><td align="center">NM_001809 (CENPA)</td><td align="left">Centromere protein A</td><td align="left">Responsive genes</td><td align="left">Lung cancer</td></tr><tr><td/><td/><td/><td align="left">p21 mediated pathway</td><td align="left">Cell-cycle</td></tr><tr><td/><td align="center">NM_002808 (PSMD2)</td><td align="left">Proteasome (prosome, macropain) 26S subunit, non-ATPase, 2</td><td align="left">Tat signaling pathway</td><td align="left">Acquired immuno deficiency syndrome</td></tr><tr><td/><td align="center">NM_004336 (BUB1)</td><td align="left">BUB1 budding uninhibited by benzimidazoles 1 homolog (yeast)</td><td align="left">Spindle Checkpoint Pathway</td><td align="left">Cell-cycle</td></tr><tr><td/><td align="center">NM_004626 (WNT11)</td><td align="left">Wingless-type MMTV integration site family, member 11</td><td align="left">Cell-cell signaling pathway</td><td align="left">Others</td></tr><tr><td/><td/><td/><td align="left">WNT receptor signaling pathway</td><td align="left">Others</td></tr><tr><td/><td align="center">NM_004887 (CXCL14)</td><td align="left">Chemokine (C-X-C motif) ligand 14</td><td align="left">Signal transduction pathway</td><td align="left">Others</td></tr><tr><td colspan="5"><hr/></td></tr><tr><td align="center"><bold>Common genes</bold></td><td align="center">AL050227 (PTGER3)</td><td align="left">Prostaglandin E receptor 3 (subtype EP3)</td><td align="left">Estrogen signaling pathway</td><td align="left">Breast cancer</td></tr><tr><td/><td/><td/><td align="left">PGE2 mediated pathway</td><td align="left">Lung cancer</td></tr><tr><td/><td align="center">NM_006763 (BTG2)</td><td align="left">BTG family, member 2</td><td align="left">Estrogen signaling pathway</td><td align="left">Breast cancer</td></tr><tr><td/><td/><td/><td align="left">Responsive genes</td><td align="left">Prostate cancer</td></tr><tr><td/><td/><td/><td align="left">CEBP alpha mediated pathway</td><td align="left">Chronic myeloid leukemia</td></tr><tr><td/><td/><td/><td align="left">Miscellaneous</td><td align="left">DNA repair</td></tr><tr><td/><td/><td/><td align="left">BTG mediated pathway</td><td align="left">Cell-cycle</td></tr><tr><td/><td align="center">NM_003862 (FGF18)</td><td align="left">Fibroblast growth factor 18</td><td align="left">WNT signaling pathway</td><td align="left">Colon cancer</td></tr><tr><td/><td align="center">NM_006115 (PRAME)</td><td align="left">Preferentially expressed antigen in melanoma</td><td align="left">Responsive genes</td><td align="left">Ovarian cancer</td></tr><tr><td/><td align="center">X05610 (COL4A2)</td><td align="left">Collagen, type IV, alpha 2</td><td align="left">Responsive genes</td><td align="left">Glioblastoma</td></tr><tr><td/><td align="center">NM_003981 (PRC1)</td><td align="left">Protein regulator of cytokinesis 1</td><td align="left">p21 mediated pathway</td><td align="left">Cell-cycle</td></tr><tr><td/><td align="center">NM_006027 (EXO1)</td><td align="left">Exonuclease 1</td><td align="left">p21 mediated pathway</td><td align="left">Cell-cycle</td></tr><tr><td/><td align="center">NM_002811 (PSMD7)</td><td align="left">Proteasome (prosome, macropain) 26S subunit, non-ATPase, 7</td><td align="left">Tat signaling pathway</td><td align="left">Acquired immuno deficiency syndrome</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T4"><label>Table 4</label><caption><p>The pathways involved with both unique VIP genes and common genes for the van't Veer dataset</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Pathway name</bold></td><td align="left"><bold>Unique gene</bold></td><td align="left"><bold>Common gene</bold></td><td align="left"><bold>Category</bold></td></tr></thead><tbody><tr><td align="left">Estrogen signaling pathway</td><td align="left">IGFBP5 (AF055033, NM_000599)</td><td align="left">BTG2, PTGER3</td><td align="left">Breast cancer</td></tr><tr><td align="left">p21 mediated pathway</td><td align="left">BUB1B, CENPA</td><td align="left">EX01, PRC1</td><td align="left">Cell-cycle</td></tr><tr><td align="left">CEBPalpha mediated pathway</td><td align="left">MMP9</td><td align="left">BTG2</td><td align="left">Chronic myeloid leukemia</td></tr><tr><td align="left">WNT signaling pathway</td><td align="left">WNT11</td><td align="left">FGF18</td><td align="left">Colon Cancer</td></tr><tr><td align="left">Tat signaling pathway</td><td align="left">PSMD2</td><td align="left">PSMD7</td><td align="left">Acquired immuno deficiency syndrome</td></tr><tr><td align="left">Responsive genes</td><td align="left">MMP9</td><td align="left">BTG2</td><td align="left">Prostate cancer</td></tr><tr><td align="left">Responsive genes</td><td align="left">MMP9, IGFBP5 (AF055033, NM_000599)</td><td align="left">PRAME</td><td align="left">Ovarian cancer</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T5"><label>Table 5</label><caption><p>The prediction confusion matrix</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>Observation</bold></td><td align="center" colspan="2"><bold>Prediction</bold></td></tr><tr><td/><td colspan="2"><hr/></td></tr><tr><td/><td align="center">+1</td><td align="center">-1</td></tr></thead><tbody><tr><td align="center">+1</td><td align="center">TP (True positive)</td><td align="center">FN (False negative)</td></tr><tr><td align="center">-1</td><td align="center">FP (False positive)</td><td align="center">TN (True negative)</td></tr></tbody></table></table-wrap>
<inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M1" name="1471-2105-9-S9-S9-i1" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>1</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M2" name="1471-2105-9-S9-S9-i2" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>2</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M3" name="1471-2105-9-S9-S9-i3" overflow="scroll"><mml:semantics><mml:mrow><mml:mi>R</mml:mi><mml:msub><mml:mi>E</mml:mi><mml:mi>k</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:msqrt><mml:mrow><mml:mrow><mml:mrow><mml:mstyle displaystyle="true"><mml:munderover><mml:mo>∑</mml:mo><mml:mrow><mml:mi>i</mml:mi><mml:mo>=</mml:mo><mml:mi>k</mml:mi><mml:mo>+</mml:mo><mml:mn>1</mml:mn></mml:mrow><mml:mi>g</mml:mi></mml:munderover><mml:mrow><mml:msub><mml:mi>λ</mml:mi><mml:mi>i</mml:mi></mml:msub></mml:mrow></mml:mstyle></mml:mrow><mml:mo>/</mml:mo><mml:mrow><mml:mi>p</mml:mi><mml:mo stretchy="false">(</mml:mo><mml:mi>n</mml:mi><mml:mo>−</mml:mo><mml:mi>k</mml:mi><mml:mo stretchy="false">)</mml:mo></mml:mrow></mml:mrow></mml:mrow></mml:msqrt></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M4" name="1471-2105-9-S9-S9-i4" overflow="scroll"><mml:semantics><mml:mrow><mml:mi>D</mml:mi><mml:msub><mml:mi>P</mml:mi><mml:mi>j</mml:mi></mml:msub><mml:mo>=</mml:mo><mml:mo stretchy="false">[</mml:mo><mml:mrow><mml:mrow><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>T</mml:mtext></mml:msup><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>21</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>T</mml:mtext></mml:msup><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>21</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">]</mml:mo></mml:mrow><mml:mo>/</mml:mo><mml:mrow><mml:mo stretchy="false">[</mml:mo><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>T</mml:mtext></mml:msup><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo>+</mml:mo><mml:msup><mml:mrow><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>22</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo></mml:mrow><mml:mtext>T</mml:mtext></mml:msup><mml:mo stretchy="false">(</mml:mo><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>22</mml:mn></mml:mrow></mml:msubsup><mml:mo stretchy="false">)</mml:mo><mml:mo stretchy="false">]</mml:mo></mml:mrow></mml:mrow></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M5" name="1471-2105-9-S9-S9-i5" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M6" name="1471-2105-9-S9-S9-i6" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M7" name="1471-2105-9-S9-S9-i7" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>22</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M8" name="1471-2105-9-S9-S9-i8" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>21</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M9" name="1471-2105-9-S9-S9-i1" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>1</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M10" name="1471-2105-9-S9-S9-i2" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>2</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M11" name="1471-2105-9-S9-S9-i1" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>1</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M12" name="1471-2105-9-S9-S9-i2" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>2</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <disp-formula id="bmcM1"><label>(1)</label><bold>X </bold>= <bold>TP</bold></disp-formula> <disp-formula id="bmcM2"><label>(2)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M13" name="1471-2105-9-S9-S9-i9" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>R</mml:mi>
                           <mml:msub>
                              <mml:mi>E</mml:mi>
                              <mml:mi>k</mml:mi>
                           </mml:msub>
                           <mml:mo>=</mml:mo>
                           <mml:msqrt>
                              <mml:mrow>
                                 <mml:mfrac>
                                    <mml:mrow>
                                       <mml:mstyle displaystyle="true">
                                          <mml:munderover>
                                             <mml:mo>∑</mml:mo>
                                             <mml:mrow>
                                                <mml:mi>i</mml:mi>
                                                <mml:mo>=</mml:mo>
                                                <mml:mi>k</mml:mi>
                                                <mml:mo>+</mml:mo>
                                                <mml:mn>1</mml:mn>
                                             </mml:mrow>
                                             <mml:mi>g</mml:mi>
                                          </mml:munderover>
                                          <mml:mrow>
                                             <mml:msub>
                                                <mml:mi>λ</mml:mi>
                                                <mml:mi>i</mml:mi>
                                             </mml:msub>
                                          </mml:mrow>
                                       </mml:mstyle>
                                    </mml:mrow>
                                    <mml:mrow>
                                       <mml:mi>p</mml:mi>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>n</mml:mi>
                                       <mml:mo>−</mml:mo>
                                       <mml:mi>k</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                 </mml:mfrac>
                              </mml:mrow>
                           </mml:msqrt>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <disp-formula id="bmcM3"><label>(3)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M14" name="1471-2105-9-S9-S9-i10" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>I</mml:mi>
                           <mml:mi>N</mml:mi>
                           <mml:msub>
                              <mml:mi>D</mml:mi>
                              <mml:mi>k</mml:mi>
                           </mml:msub>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:mi>R</mml:mi>
                                 <mml:msub>
                                    <mml:mi>E</mml:mi>
                                    <mml:mi>k</mml:mi>
                                 </mml:msub>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:msup>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>n</mml:mi>
                                       <mml:mo>−</mml:mo>
                                       <mml:mi>k</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mn>2</mml:mn>
                                 </mml:msup>
                              </mml:mrow>
                           </mml:mfrac>
                           <mml:mo>,</mml:mo>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M15" name="1471-2105-9-S9-S9-i1" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>1</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M16" name="1471-2105-9-S9-S9-i2" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>2</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <disp-formula id="bmcM4"><label>(4)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M17" name="1471-2105-9-S9-S9-i11" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:msub>
                              <mml:mrow>
                                 <mml:mtext>DP</mml:mtext>
                              </mml:mrow>
                              <mml:mi>j</mml:mi>
                           </mml:msub>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:msup>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:msubsup>
                                          <mml:mstyle mathvariant="bold" mathsize="normal">
                                             <mml:mi>e</mml:mi>
                                          </mml:mstyle>
                                          <mml:mi>j</mml:mi>
                                          <mml:mrow>
                                             <mml:mn>12</mml:mn>
                                          </mml:mrow>
                                       </mml:msubsup>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mtext>T</mml:mtext>
                                 </mml:msup>
                                 <mml:mo stretchy="false">(</mml:mo>
                                 <mml:msubsup>
                                    <mml:mstyle mathvariant="bold" mathsize="normal">
                                       <mml:mi>e</mml:mi>
                                    </mml:mstyle>
                                    <mml:mi>j</mml:mi>
                                    <mml:mrow>
                                       <mml:mn>12</mml:mn>
                                    </mml:mrow>
                                 </mml:msubsup>
                                 <mml:mo stretchy="false">)</mml:mo>
                                 <mml:mo>+</mml:mo>
                                 <mml:msup>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:msubsup>
                                          <mml:mstyle mathvariant="bold" mathsize="normal">
                                             <mml:mi>e</mml:mi>
                                          </mml:mstyle>
                                          <mml:mi>j</mml:mi>
                                          <mml:mrow>
                                             <mml:mn>21</mml:mn>
                                          </mml:mrow>
                                       </mml:msubsup>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mtext>T</mml:mtext>
                                 </mml:msup>
                                 <mml:mo stretchy="false">(</mml:mo>
                                 <mml:msubsup>
                                    <mml:mstyle mathvariant="bold" mathsize="normal">
                                       <mml:mi>e</mml:mi>
                                    </mml:mstyle>
                                    <mml:mi>j</mml:mi>
                                    <mml:mrow>
                                       <mml:mn>21</mml:mn>
                                    </mml:mrow>
                                 </mml:msubsup>
                                 <mml:mo stretchy="false">)</mml:mo>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:msup>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:msubsup>
                                          <mml:mstyle mathvariant="bold" mathsize="normal">
                                             <mml:mi>e</mml:mi>
                                          </mml:mstyle>
                                          <mml:mi>j</mml:mi>
                                          <mml:mrow>
                                             <mml:mn>11</mml:mn>
                                          </mml:mrow>
                                       </mml:msubsup>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mtext>T</mml:mtext>
                                 </mml:msup>
                                 <mml:mo stretchy="false">(</mml:mo>
                                 <mml:msubsup>
                                    <mml:mstyle mathvariant="bold" mathsize="normal">
                                       <mml:mi>e</mml:mi>
                                    </mml:mstyle>
                                    <mml:mi>j</mml:mi>
                                    <mml:mrow>
                                       <mml:mn>11</mml:mn>
                                    </mml:mrow>
                                 </mml:msubsup>
                                 <mml:mo stretchy="false">)</mml:mo>
                                 <mml:mo>+</mml:mo>
                                 <mml:msup>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:msubsup>
                                          <mml:mstyle mathvariant="bold" mathsize="normal">
                                             <mml:mi>e</mml:mi>
                                          </mml:mstyle>
                                          <mml:mi>j</mml:mi>
                                          <mml:mrow>
                                             <mml:mn>22</mml:mn>
                                          </mml:mrow>
                                       </mml:msubsup>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                    <mml:mtext>T</mml:mtext>
                                 </mml:msup>
                                 <mml:mo stretchy="false">(</mml:mo>
                                 <mml:msubsup>
                                    <mml:mstyle mathvariant="bold" mathsize="normal">
                                       <mml:mi>e</mml:mi>
                                    </mml:mstyle>
                                    <mml:mi>j</mml:mi>
                                    <mml:mrow>
                                       <mml:mn>22</mml:mn>
                                    </mml:mrow>
                                 </mml:msubsup>
                                 <mml:mo stretchy="false">)</mml:mo>
                              </mml:mrow>
                           </mml:mfrac>
                           <mml:mo>,</mml:mo>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M18" name="1471-2105-9-S9-S9-i5" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M19" name="1471-2105-9-S9-S9-i6" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M20" name="1471-2105-9-S9-S9-i7" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>22</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M21" name="1471-2105-9-S9-S9-i8" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mstyle mathvariant="bold" mathsize="normal"><mml:mi>e</mml:mi></mml:mstyle><mml:mi>j</mml:mi><mml:mrow><mml:mn>21</mml:mn></mml:mrow></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M22" name="1471-2105-9-S9-S9-i1" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>1</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <inline-formula><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M23" name="1471-2105-9-S9-S9-i2" overflow="scroll"><mml:semantics><mml:mrow><mml:msubsup><mml:mtext>X</mml:mtext><mml:mrow><mml:mn>2</mml:mn><mml:mi>m</mml:mi></mml:mrow><mml:mo>'</mml:mo></mml:msubsup></mml:mrow></mml:semantics></mml:math></inline-formula> <disp-formula id="bmcM5"><label>(5)</label><bold>E </bold>= <bold>X </bold>- <bold>XPP</bold><sup>T</sup>,</disp-formula> <disp-formula id="bmcM6"><label>(6)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M24" name="1471-2105-9-S9-S9-i12" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>A</mml:mi>
                           <mml:mi>c</mml:mi>
                           <mml:mi>c</mml:mi>
                           <mml:mi>u</mml:mi>
                           <mml:mi>r</mml:mi>
                           <mml:mi>a</mml:mi>
                           <mml:mi>c</mml:mi>
                           <mml:mi>y</mml:mi>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>N</mml:mi>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>N</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>N</mml:mi>
                              </mml:mrow>
                           </mml:mfrac>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <disp-formula id="bmcM7"><label>(7)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M25" name="1471-2105-9-S9-S9-i13" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>S</mml:mi>
                           <mml:mi>p</mml:mi>
                           <mml:mi>e</mml:mi>
                           <mml:mi>c</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>f</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>c</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>t</mml:mi>
                           <mml:mi>y</mml:mi>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>N</mml:mi>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>N</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>P</mml:mi>
                              </mml:mrow>
                           </mml:mfrac>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <disp-formula id="bmcM8"><label>(8)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M26" name="1471-2105-9-S9-S9-i14" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>S</mml:mi>
                           <mml:mi>e</mml:mi>
                           <mml:mi>n</mml:mi>
                           <mml:mi>s</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>t</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>v</mml:mi>
                           <mml:mi>i</mml:mi>
                           <mml:mi>t</mml:mi>
                           <mml:mi>y</mml:mi>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>P</mml:mi>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>+</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>N</mml:mi>
                              </mml:mrow>
                           </mml:mfrac>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula> <disp-formula id="bmcM9"><label>(9)</label><mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" id="M27" name="1471-2105-9-S9-S9-i15" overflow="scroll">
                     <mml:semantics>
                        <mml:mrow>
                           <mml:mi>M</mml:mi>
                           <mml:mi>C</mml:mi>
                           <mml:mi>C</mml:mi>
                           <mml:mo>=</mml:mo>
                           <mml:mfrac>
                              <mml:mrow>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>×</mml:mo>
                                 <mml:mi>T</mml:mi>
                                 <mml:mi>N</mml:mi>
                                 <mml:mo>−</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>P</mml:mi>
                                 <mml:mo>×</mml:mo>
                                 <mml:mi>F</mml:mi>
                                 <mml:mi>N</mml:mi>
                              </mml:mrow>
                              <mml:mrow>
                                 <mml:msqrt>
                                    <mml:mrow>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>T</mml:mi>
                                       <mml:mi>P</mml:mi>
                                       <mml:mo>+</mml:mo>
                                       <mml:mi>F</mml:mi>
                                       <mml:mi>P</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                       <mml:mo>×</mml:mo>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>T</mml:mi>
                                       <mml:mi>P</mml:mi>
                                       <mml:mo>+</mml:mo>
                                       <mml:mi>F</mml:mi>
                                       <mml:mi>N</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                       <mml:mo>×</mml:mo>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>T</mml:mi>
                                       <mml:mi>N</mml:mi>
                                       <mml:mo>+</mml:mo>
                                       <mml:mi>F</mml:mi>
                                       <mml:mi>P</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                       <mml:mo>×</mml:mo>
                                       <mml:mo stretchy="false">(</mml:mo>
                                       <mml:mi>T</mml:mi>
                                       <mml:mi>N</mml:mi>
                                       <mml:mo>+</mml:mo>
                                       <mml:mi>F</mml:mi>
                                       <mml:mi>N</mml:mi>
                                       <mml:mo stretchy="false">)</mml:mo>
                                    </mml:mrow>
                                 </mml:msqrt>
                              </mml:mrow>
                           </mml:mfrac>
                           <mml:mo>,</mml:mo>
                        </mml:mrow>
                        
                     </mml:semantics>
                  </mml:math></disp-formula>
<graphic xlink:href="1471-2105-9-S9-S9-1"/> <graphic xlink:href="1471-2105-9-S9-S9-2"/>
[{"surname": ["Quackenbush"], "given-names": ["J"], "article-title": ["Computational approaches to analysis of DNA microarray data"], "source": ["Methods Inf Med"], "year": ["2006"], "volume": ["45"], "fpage": ["91"], "lpage": ["103"]}, {"surname": ["Jain", "Duin", "Mao"], "given-names": ["AK", "RPW", "J"], "article-title": ["Statistical Pattern Recognition: A Review"], "source": ["IEEE Transactions on Pattern Analysis and Machine Intelligence"], "year": ["2000"], "volume": ["22"], "fpage": ["4"], "lpage": ["37"], "pub-id": ["10.1109/34.824819"]}, {"surname": ["Raudys", "Jain"], "given-names": ["SJ", "AK"], "article-title": ["Small Sample Size Effects in Statistical Pattern Recognition: Recommendations for Practitioners"], "source": ["IEEE Transactions on Pattern Analysis and Machine Intelligence"], "year": ["1991"], "volume": ["13"], "fpage": ["252"], "lpage": ["264"], "pub-id": ["10.1109/34.75512"]}, {"surname": ["Bluma", "Langley"], "given-names": ["AL", "P"], "article-title": ["Selection of relevant features and examples in machine learning"], "source": ["Artificial Intelligence"], "year": ["1997"], "volume": ["97"], "fpage": ["245"], "lpage": ["271"], "pub-id": ["10.1016/S0004-3702(97)00063-5"]}, {"surname": ["Breiman"], "given-names": ["L"], "article-title": ["Bagging predictors"], "source": ["Machine Learning"], "year": ["1996"], "volume": ["24"], "fpage": ["123"], "lpage": ["140"]}, {"collab": ["InfoMetrix"], "article-title": ["Multivariate Data Analysis Version 4.0"], "source": ["Pirouette User Guide"], "year": ["2007"]}, {"surname": ["Wold"], "given-names": ["S"], "article-title": ["Pattern Recognition by Means of Disjoint Principle Components Models"], "source": ["Pattern Recognition"], "year": ["1976"], "volume": ["8"], "fpage": ["127"], "lpage": ["139"], "pub-id": ["10.1016/0031-3203(76)90014-5"]}]
BMC Bioinformatics. 2008 Aug 12; 9(Suppl 9):S9