dna microarray technology provides us a way to monitor the expression levels of thousands of genes simultaneously across a collection of related samples .
this technology has been applied particularly to the prediction of different types of human cancer with encouraging results .  
support vector machines ( svm )   are powerful machine learning techniques that have been applied to the classification of cancer samples .
however , the categorization of different cancer types remains a difficult problem for classical svm algorithms .
in particular , the svm is based on euclidean distances that fail to reflect accurately the proximities among the sample profiles .
non - euclidean dissimilarities misclassify frequently different subsets of patterns because each one reflects complementary features of the data .
therefore , they should be integrated in order to reduce the fraction of patterns misclassified by the base dissimilarities . in this paper
, we introduce a framework to learn a linear combination of non - euclidean dissimilarities that reflect better the proximities among the sample profiles .
each dissimilarity is embedded in a feature space using the empirical kernel map [ 5 , 6 ] .
after that , learning the dissimilarity is equivalent to optimize the weights of the linear combination of kernels .
the kernel is learnt optimizing an error function that maximizes the alignment between the input kernel and an idealized kernel . however , this error function is not related to the misclassification error and is prone to overfitting . to avoid this problem ,  
this approach includes a term to penalize the complexity of the family of kernels considered .
this algorithm is not able to incorporate infinite families of kernels and does not overcome the overfitting of the data . in this paper ,
the combination of distances is learnt in a ( hyper reproducing kernel hilbert space ) hrkhs following the approach of hyperkernels proposed in .
moreover , it allow us to work with infinite families of distances . the algorithm has been applied to the prediction of different kinds of human cancer .
the experimental results suggest that the combination of dissimilarities in a hyper reproducing kernel hilbert space improves the accuracy of classifiers based on a single distance , particularly for nonlinear problems .
besides , our approach outperforms the lanckriet formalism specially for multicategory problems and is more robust to overfitting .  
section 3 illustrates the performance of the algorithm in the challenging problem of gene expression data analysis .
   an important step in the design of a classifier is the choice of a proper dissimilarity that reflects the proximities among the objects .
each measure reflects different features of the data and the classifiers induced by the dissimilarities misclassify frequently a different set of patterns . in this section ,
we comment shortly the main differences among several dissimilarities proposed to evaluate the proximity between biological samples considering their gene expression profiles . for a deeper description and definitions see .  
, xd ] be the vectorial representation of a sample where xi is the expression level of gene i. the   euclidean distance   evaluates if the gene expression levels differ significantly across different samples : 
								 ( 1)deuclid  ( x , y)=i=1d(xiyi)2 . an interesting alternative is the   cosine dissimilarity .
this measure will become small when the ratio between the gene expression levels is similar for the two samples considered .
it differs significantly from the euclidean distance when the data is not normalized by the l2 norm : 
								 ( 2)dcosine  ( x , y)=1xtyxy. 
							 the   correlation measure   evaluates if the expression level of genes change similarly in both samples .
correlation - based measures tend to group together samples whose expression levels are linearly related .
the correlation differs significantly from the cosine if the means of the sample profiles are not zero .
this measure is more sensitive to outliers : 
								 ( 3)dcor  ( x , y)=1i=1d(xix)(yiy)i=1d(xix)2j=1d(yjy)2  , 
							 where x and y are the means of the gene expression profiles .
the   spearman rank dissimilarity is less sensitive to outliers because it computes a correlation between the ranks of the gene expression levels : 
								 ( 4)dspeam  ( x,y)=1i=1d(xix)(yiy)i=1d(xix)2i=1d(yiy)2 , 
							 where xi = rank(xi ) and yj = rank(yj ) .
an alternative measure that helps to overcome the problem of outliers is the kendall-   index   which is related to the mutual information probabilistic measure : 
								 ( 5)dkendall(x , y)=1i=1dj=1dcxijcyijd(d1 )  , 
							 where cxij = sign(xi  xj ) and cyij = sign(yi  yj ) .   finally , the dissimilarities have been transformed using the inverse multiquadratic kernel because this transformation helps to discover certain properties of the underlying structure of the data [ 12 , 13 ] .
the inverse multiquadratic transformation is based on the inverse multiquadratic kernel defined as follows : 
								 ( 6)k(x , y)=1xy2+c2 , 
							 where c is a smoothing parameter . considering that ||x  y|| is the euclidean distance , ( 6 ) can be rewritten in terms of a dissimilarity as follows : 
								 ( 7)k(x , y)=1dij2+c2 . 
							
the above nonlinear transformation gives more weight to small dissimilarities , particularly when c becomes small .
support vector machines   are powerful classifiers that are able to deal with high dimensional and noisy data keeping a high generalization ability . they have been widely applied in cancer classification using gene expression profiles [ 1 , 14 ] . in this paper , we will focus on the -support vector machines ( svm ) .
the -svm is a reparametrization of the classical c - svm   that allows to interpret the regularization parameter in terms of the number of support vectors and margin errors .
this property helps to control the complexity of the approximating functions in an intuitive way .
this feature is desirable for the application we are dealing with because the sample size is frequently small and the resulting classifiers are prone to overfitting .
let { ( xi , yi)}i = 1 be the training set codified in . we assume that each xi belongs to one of the two classes labeled by yi 
{ 1 , 1}. the svm algorithm looks for the linear hyperplane f(x ; w ) = wx + b that maximizes the margin  = 2/||w|| .
the slack variables i allow to consider classification errors and are defined as i = max{0 , 1  yif(xi)}. for the -svm , the hyperplane that minimizes the prediction error is obtained solving the following optimization problem : 
								 ( 8)minw,{i},  12w2+1miis.t.yi(w ,  xi+b)i ,  i=1,  ,m,i0 ,  0  i=1,  ,m , 
							 where  is an upper bound on the fraction of margin errors and a lower bound on the number of support vectors .
the optimization problem can be solved efficiently in the dual space and the discriminant function can be expressed exclusively in terms of scalar products : 
								 ( 9)f(x)=i>0iyix , xi+b , 
							 where i are the lagrange multipliers in the dual optimization problem .
the -svm algorithm can be easily extended to the nonlinear case substituting the scalar products by a mercer kernel . besides
, non - euclidean dissimilarities can be incorporated into the -svm via the kernel of dissimilarities .
finally , several approaches have been proposed in the literature to extend the svm to deal with multiple classes . in this paper , we have followed the one - against - one ( ovo ) strategy .
 1)/2 binary classifiers are trained and the appropriate class is found by a voting scheme .
this strategy compares favorably with more sophisticated methods and it is more efficient computationally than the one - against - rest ( ovr ) approach .   
the empirical kernel map allows us to incorporate non - euclidean dissimilarities into the svm algorithm using the kernel trick [ 5 , 13 ] .
let d :      be a dissimilarity and r = { p1 ,  , pn } a subset of representatives drawn from the training set .
define the mapping  :    as 
								 ( 10)(z)=d(z , r)=[d(z , p1),d(z , p2), 
this mapping defines a dissimilarity space where feature i is given by d( , pi ) .
the choice of r is equivalent to select a subset of features in the dissimilarity space . due to the small number of samples in our application
notice that it has been suggested in literature   that for small samples reducing the set of representatives does not help to improve the classifier performance . in order to learn a linear combination of non - euclidean dissimilarities ,
each distance is embedded in an rkhs via the empirical kernel map presented in section 2.3 .
next , a regularized quality functional is introduced that incorporates an l2-penalty over the complexity of the family of distances considered . the solution to this regularized quality functional
let xtrain = { x1 , x2 ,  , xm } and ytrain = { y1 , y2 ,  , yn } be a finite sample of training patterns
where yi  {  1 ,   + 1}. let  be a family of semidefinite positive kernels .
our goal is to learn a kernel of dissimilarities k   that represents the combination of dissimilarities and minimizes the following empirical quality functional : 
								 ( 11)qemp(f , xtrain , ytrain)=1mi=1ml(xi , yi , f(xi))+2f2 , 
							 where l is a loss function , || || is the l2 norm defined in a reproducing kernel hilbert space , and  is a regularization parameter that controls the balance between training error and the generalization ability .   by virtue of the representer theorem ,
we know that ( 11 ) can be written as a kernel expansion : 
								 ( 12)qemp = min   ,  k  [ 1mi=1ml(xi , yi,[k]i)+2tk ] . 
							
however , if the family of kernels  is complex enough it is possible to find a kernel that achieves zero error overfitting the data . to avoid this problem ,
a rigorous definition of the hrkhs is provided in the appendix : 
								 ( 13)qreg(k , x , y)=qemp(k , x , y)+q2kh2 , 
							 where ||  || is the l2 norm defined in the hyper reproducing kernel hilbert space generated by the hyperkernel k. q is a regularization parameter that controls the complexity of the resulting kernel .  
the following theorem allows us to write the solution to the minimization of this regularized quality functional as a linear combination of hyperkernels in an hrkhs .    
theorem 1 ( representer theorem for hyper - rkhs ) let x , y be the combined training and test set , then each minimizer   k of the regularized quality functional qreg(k , x , y ) admits a representation of the form 
 ( 14)k(x , x)=i , j=1mijk((xi , xj),(x , x ) ) , 
 for all   x , x  x , where   ij   , for each 1  i , j  m.   let x , y be the combined training and test set , then each minimizer   k of the regularized quality functional qreg(k ,
x , y ) admits a representation of the form 
 ( 14)k(x , x)=i , j=1mijk((xi , xj),(x , x ) ) , 
 for all   x , x  x , where   ij   , for each 1  i , j  m. however , we are only interested in solutions that give rise to positive semidefinite kernels .
the following condition over the hyperkernels   allows us to guarantee that the solution is a positive semidefinite kernel .
property 1given a hyperkernel   k with elements such that for any fixed   xx , the function   k(xp , xq)=k(x,(xp , xq ) ) , with   xp , xq   , is a positive semidefinite kernel , and   ij  0 for all i , j = 1 ,  ,
m , then the kernel 
 ( 15)k(xp , xq)=i , j=1mijk(xi , xj , xp , xq ) 
 is positive semidefinite . given a hyperkernel   k with elements such that for any fixed   xx , the function   k(xp , xq)=k(x,(xp , xq ) ) , with   xp , xq   , is a positive semidefinite kernel , and   ij  0 for all i , j = 1 ,  , m , then the kernel 
 ( 15)k(xp , xq)=i , j=1mijk(xi , xj , xp , xq ) 
 is positive semidefinite .
now , we address the problem of combining a finite set of dissimilarities . as we mentioned in section 2.3 , each dissimilarity can be represented by a kernel using the empirical kernel map .
next , the hyperkernel is defined as 
								 ( 16)k(x,x)=i=1nciki(x)ki(x ) , 
							 where each ki is a positive semidefinite kernel of dissimilarities and ci is a constant   0 .  
first , k is a kernel because it can be written as a dot product (x),(x) where 
								 ( 17)(x)=(c1  k1(x),c2  k2(x),  ,cn  kn(x ) ) . 
							
next , the resulting kernel ( 15 ) is positive semidefinite because for all x,k(x,(xp , xq ) ) is a positive semidefinite kernel and ij can be constrained to be   0 .
besides , the linear combination of kernels is a kernel and therefore is positive semidefinite .
notice that k(x,(xp , xq ) ) is positive semidefinite if ci  0 and ki are pointwise positive for training data . both rbf and
finally , we show that the resulting kernel is a linear combination of the original ki . substituting the expression of the hyperkernel ( 16 ) in ( 15 )
, the kernel is written as 
								 ( 18)k(xp , xq)=i , j=1mijl=1nclkl(xi , xj)kl(xp , xq ) . 
							
now the kernel can be written as a linear combination of base kernels : 
								 ( 19)k(xp , xq)=l=1n[cli , j=1mijkl(xi , xj)]kl(xp , xq ) . 
							 therefore , the above kernel introduces into the -svm a linear combination of base dissimilarities represented by kl with coefficients l = cli , j = 1ijkl(xi , xj ) .
the previous approach can be extended to an infinite family of distances . in this case , the space that generates the kernel is infinite dimensional . therefore , in order to work in this space , it is necessary to define a hyperkernel and to optimize it using an hrkhs .
the hyperkernel is defined as follows : 
								 ( 20)k(x,x)=i=0ci(k(x)k(x))i , 
							 where ci  0 and i = 0 ,  , . in this case , the nonlinear transformation to feature space is infinite dimensional .
particularly , we are considering all powers of the original kernels which is equivalent to transform nonlinearly the original dissimilarities : 
								 ( 21)(x)=((c1)k(x),(c2)k2(x),  ,(cn)kn(x ) ) , 
							 where n is the dimensionality of the space which is infinite in this case . as we mentioned in section 2.1 , nonlinear transformations of a given dissimilarity
as for the finite family , it can be easily shown that k is a valid hyperkernel provided that the kernels considered are pointwise positive .
next , we derive the hyperkernel expression for the multiquadratic kernel .     proposition 1 ( see [ harmonic hyperkernel])suppose k is a kernel with range [ 0 , 1 ] and   ci = ( 1  h)h , i   , 0 < h < 1 . then , computing the infinite sum in ( 20 ) , one has the following expression for the harmonic hyperkernel : 
 ( 22)k(x,x)=(1h)i=0(hk(x)k(x))i=1h1hk(x)k(x),h is a regularization term that controls the complexity of the resulting kernel .
particularly , larger values for h give more weight to strongly nonlinear kernels while smaller values give coverage for wider kernels.in this paper one has considered the inverse multiquadratic kernel defined in ( 6 ) . substituting in ( 22 ) ,
one gets the inverse multiquadratic hyperkernel : 
 ( 23)k(x,x)=1h1h((xx2+c2)(xx2+c2))1/2 , 
 where   x=(x , x ) and x=(x,x ) .  
suppose k is a kernel with range [ 0 , 1 ] and   ci = ( 1  h)h , i   , 0 < h < 1 . then , computing the infinite sum in ( 20 ) , one has the following expression for the harmonic hyperkernel : 
 ( 22)k(x,x)=(1h)i=0(hk(x)k(x))i=1h1hk(x)k(x),h is a regularization term that controls the complexity of the resulting kernel .
particularly , larger values for h give more weight to strongly nonlinear kernels while smaller values give coverage for wider kernels . in this paper one
has considered the inverse multiquadratic kernel defined in ( 6 ) . substituting in ( 22 ) , one gets the inverse multiquadratic hyperkernel : 
 ( 23)k(x,x)=1h1h((xx2+c2)(xx2+c2))1/2 , 
 where   x=(x , x ) and x=(x,x ) .      in this section ,
we detail how to learn the kernel for a -support vector machine in an hrkhs .
first , we will introduce the optimization problem and next , we will explain shortly how to solve it using an sdp approach .  
we start some notation that is used in the -svm algorithm . for p , q , r   ,
n   let r = p  q be defined as element by element   multiplication , ri = pi  qi . the pseudoinverse of a matrix k is denoted by k. define the hyperkernel gram   matrix k by kijpq = k((xi , xj),(xp , xq ) ) , the kernel matrix k = reshape  ( k ) ( reshaping an m by 1 vector , k , to an m  m matrix ) , y = diag(y ) ( a matrix with y on the diagonal and zero otherwise ) , g( ) = yky ( the dependence on  is made explicit ) , and 1 is a vector of ones .
the -svm considered in this paper uses an l1 soft margin , where l(xi , yi , f(xi ) ) = max(0 , 1  yif(xi ) ) .
substituting in ( 13 ) qemp by the one optimized by -svm ( 8) the regularized quality functional in an hrkhs can be written as 
								 ( 24)minkhminwk1mi=1mi+12w2+q2kh2s.t.yif(xi)i ,  i=1,  ,m,i0  i=1,  ,m , 
							 where  is the regularization parameter that achieves a balance between training error and the complexity of the approximating functions and q is a parameter that penalizes the complexity of the family of kernels considered .  
0 ,  0 ,  0 ,  0,(27 )  k1/2t2 ,  1t=1,(28)[g()zztt1]0 , 
							 where z = y + 1 +    the value of  which optimizes the corresponding lagrange function is g()z , and the classification function , f = sign(k(  y )  boffset ) , is given by 
								 ( 29)f = sign(kg()(yz)),k is the hyperkernel defined in section 2.4 which represents the combination of dissimilarities considered . finally , the algorithm proposed can be easily extended to deal with multiple classes via a one - against - one approach ( ovo ) .
this strategy is simple , more efficient computationally than the ovr , and compares well with more sophisticated multicategory svm methods .   
the optimization problem ( 25 ) were solved using sedumi 1.1r3   and yalmip   sdp optimization packages running under matlab . as in the sdp problem
however , it can be significantly reduced if the hyperkernel { k((xi , xj), )    1i , jm2 } is approximated by a small fraction of terms , p  m for a given error . in particular , we have chosen an m  p truncated lower triangular matrix g which approximate the hyperkernel matrix to an error  = 10 using the incomplete cholesky factorization method .
the gene expression datasets considered in this paper correspond to several human cancer problems and exhibit different features as shown in table 1 .
we have considered both , binary and multi - category problems with a broad range of signal to noise ratio ( var / samp . ) , different number of samples , and varying priors for the larger category .
all the datasets are available from the broad institute of mit and harvard http://www.broad.mit.edu / cgi - bin / cancer / datasets.cgi/. next we detail the features and preprocessing applied to each dataset .     
the first dataset was obtained from 77 patients with ( diffuse large b - cell lymphoma ) dlbcl ( 58 samples ) or fl ( follicular lymphoma ) ( 19 samples ) and they were subjected to transcriptional profiling using oligonucleotide affymetrix gene chip   hu68000   containing probes for 6817 genes .
the second dataset consists of frozen tumors specimens from newly diagnosed , previously untreated mlbcl patients ( 34 samples ) and dlbcl patients ( 176 samples ) .
they were hybridized to affymetrix hgu133b   gene chip containing probes for 44000 genes . in both cases
the raw intensities have been normalized using the rma algorithm   available from bioconductor package .
the third problem we address concerns the clinically important issue of metastatic spread of the tumor .
the determination of the extent of lymph node involvement in primary breast cancer is the single most important risk factor in disease outcome and here the analysis compares primary cancers that have not spread beyond the breast to ones that have metastasized to axillary lymph nodes at the time of diagnosis .
we identified tumors as  reported negative  ( 24 ) when no positive lymph nodes were discovered and  reported positive  ( 25 ) for tumors with at least three identifiably positive nodes .
the fourth dataset   address the clinical challenge concerning medulloblastoma due to the variable response of patients to therapy .
samples were hybridized to affymetrix hugenefl arrays containing 5920 known genes and 897 expressed sequence tags .
all the datasets have been standarized subtracting the median and dividing by the inter - quantile range .
the rescaling were performed based only on the training set to avoid bias . regarding the identification of multiple classes of cancer we have considered three different datasets .
the first one consists of 49 samples of breast cancer generated using 1-channel oligonucleotide affymetrix hugenefl .
the second and third datasets consist of 58 and a129 samples from diffuse large b - cell lymphoma with survival data .
the 10% oligonucleotides with smaller interquantile range were filtered to remove genes with expression level constant across samples .    in order to assure an honest evaluation of all the classifiers
the outer loop is based on stratified tenfold cross - validation that iteratively splits the data in ten sets , one for testing and the others for training .
the inner loop perform stratified ninefold cross - validation over the training set and is used to estimate the optimal parameters avoiding overfitting .
the stratified variant of cross - validation keeps the same proportion of patterns for each class in training and test sets .
this is necessary in our problem because the class proportions are not equal . finally , the error measure considered to evaluate the classifiers has been accuracy
the accuracy is easy to interpret and allows us to compare with the results obtained by previously published studies .   
the parameters for the -svm and for the classifiers based on a linear combination of dissimilarities have been set up by a nested stratified tenfold crossvalidation procedure .
this method avoids the overfitting as is described in section 2.8 and takes into account the asymmetric distribution of class priors . for the -svm we have considered both , linear and inverse multiquadratic kernels .
the optimal parameters have been obtained by a grid search strategy over the following set of values :  = { 0.1 , 0.2 , 0.3 , 0.4 , 0.5 } and  = { d/2 , d , 2d } ,   where d denotes the dimensionality of the input space .  
additionally , for the finite family of distances ci = 1/m where m is the number of dissimilarities considered , and q = 1 because the misclassification errors are hardly sensitive to the regularization parameter that controls the kernel complexity .
finally , for the infinite family of dissimilarities , the regularization parameter h in the harmonic hyperkernel ( 22 ) has been set up to 0.6 which gives an adequate coverage of various kernel widths .
all the base kernel of dissimilarities have been normalized so that all ones have the same scale
. regarding the lanckriet   formalism that allows to combine a finite set of dissimilarities , several values for the regularization parameter c have been tried , c = { 0.1 , 1 , 10 , 100 , 1000}. a grid search strategy has been applied to determine the best values for both , the kernel parameters and the regularization parameter .
the kernel matrices have been normalized by the trace as recommended in the original paper .   
therefore , we have evaluated the classifiers for the following subsets of genes { 280 , 146 , 101 , 56 , 34}. the -svm is robust against noise and is able to deal with high dimensional data .
however , the empirical evidence suggests that considering a larger subset of genes or even the whole set of genes increases the misclassification errors .  
the genes are ranked according to the ratio of between - group to within - group sums of squares defined in : 
								 ( 30)bw(j)=iki(yi = k)(xj(k)xj)2iki(yi = k)(xijxj(k))2 , 
							 where xj(k ) and xj denote  respectively  the average expression level of gene j for class k and the overall average expression level of gene j across all samples , yi denotes the class of sample i , and i( ) is the indicator function .
finally , the ranking of genes has been carried out considering only the training set to avoid bias .
   the algorithms proposed have been applied to the identification of several cancer human samples using microarray gene expression data .
table 2   reports the accuracy for the two combination approaches proposed in this paper .
the second one considers an infinite family of distances obtained by transforming nonlinearly the base dissimilarities to feature space .
we have compared with the -svm based on the best distance ( linear and nonlinear kernel ) and the classical -svm .
the performance for the lanckriet formalism   that allow us to incorporate a finite linear combination of dissimilarities is also reported . before computing the kernel of dissimilarities , all the distances
this nonlinear transformation helps to improve the accuracy for all the techniques evaluated . from the analysis of table 2 ,
the -svm based on a finite set of distances improves the -svm based on the best dissimilarity for brain prognosis and lymphoma datasets .
this may be explained because the ratio ( var / samp . ) in table 1   suggests that both datasets are quite noisy and nonlinear .
the combination of a finite set of dissimilarities is not able to improve the separation between classes and increases slightly the overfitting of the data .
similarly , our algorithm helps to improve the svm based on coordinates , particularly for the previous problems .
we also report that working directly from a dissimilarity matrix may help to reduce the misclassification errors .
the infinite family of distances outperforms the -svm based on the best distance disregarding the kernel considered for all the datasets .
brain cancer prognosis is a complex problem according to the original study   and the nonlinear transformations of the dissimilarities help to reduce the misclassification errors .
besides , the infinite family improves the accuracy of the finite family of distances particularly for lymphoma cell b and breast ln .
. however , the infinite family of distances outperforms the lanckriet formalism particularly for brain and lymphoma cell b which are more complex problems .
table 3   compares the proposed algorithms with -svm based on the best distance ( linear and nonlinear kernel ) and the classical -svm .
our approach considers an infinite family of distances obtained by transforming nonlinearly the base dissimilarities to feature space . before computing the kernel of dissimilarities , all the distances
have been transformed using the multiquadratic kernel introduced in section 2.1 . from the analysis of table 3
the combination of non - euclidean dissimilarities helps to improve the svm based on the best dissimilarity disregarding the kernel considered for the two first datasets .
the error is slightly larger for the third dataset which may suggest that the problem is linear .
the experimental results suggest that the nonlinear transformations of the dissimilarities help to increase the separation among classes .  
the hyperkernel classifier outperforms the lanckriet formalism for multicategory problems . as the number of classes growths the number of samples per class comes down and the lanckriet formalism seems to be less robust to overfitting .
finally , notice that our algorithm allow us to work with applications in with only a dissimilarity is defined .
moreover , we avoid the complex task of choosing a dissimilarity that reflects properly the proximities among the sample profiles .
in this paper , we propose two methods to incorporate in the -svm algorithm a linear combination of non - euclidean dissimilarities .
the family of distances is learnt in a ( hyper reproducing kernel hilbert space ) hrkhs using a semidefinite programming approach .
the experimental results suggest that the combination of dissimilarities in a hyper reproducing kernel hilbert space improves the accuracy of classifiers based on a single distance particularly for nonlinear problems .
besides , this approach outperforms the lanckriet formalism specially for multi - category problems and is more robust to overfitting .
future research trends will focus on learning the combination of dissimilarities for other classifiers such as k - nn .
definition 1 ( see [ reproducing kernel hilbert space])let  be a nonempty set and  be a hilbert space of functions f :   . let  ,  be a dot product in  which induces a norm as ||f||=f , f.  is called an rkhs if there is a function k :    with the following properties :   k has the reproducing property f , k(x , )
= f(x ) for all f   , x  ;k spans  , that is , =span{k(x, )    x} , where x is the completion of the set x ; k is symmetric , that is , k(x , y ) = k(y , x ) .  
let  be a nonempty set and  be a hilbert space of functions f :   . let 
,  be a dot product in  which induces a norm as ||f||=f , f.  is called an rkhs if there is a function k :    with the following properties :   k has the reproducing property f , k(x , )
= f(x ) for all f   , x  ;k spans  , that is , =span{k(x, )    x} , where x is the completion of the set x ; k is symmetric , that is , k(x , y ) = k(y , x ) .  
= f(x ) for all f   , x   ; k spans  , that is , =span{k(x, )    x} , where x is the completion of the set x ;   k is symmetric , that is , k(x , y ) = k(y , x ) .  
next , we introduce the hyper reproducing kernel hilbert space . definition 2 ( see [ hyper - reproducing kernel hilbert space ] )     let  be a nonempty set and = be the cartesian product .
let  be the hilbert space of functions k: with a dot product  ,  and a norm ||k||=(k , k ) .
 is a hyper reproducing kernel hilbert space if there is a hyperkernel k:xx with the following properties :       k has the reproducing property k , k(x,)=k(x ) for all k ; k spans h=span{k(x, )    xx} ; k(x , y , s , t)=k(y , x , s , t ) for all x , y , s , t 
let  be the hilbert space of functions k: with a dot product  ,  and a norm ||k||=(k , k ) .
 is a hyper reproducing kernel hilbert space if there is a hyperkernel k:xx with the following properties :       k has the reproducing property k , k(x,)=k(x ) for all k ; k spans h=span{k(x, )    xx} ; k(x , y , s , t)=k(y , x , s , t ) for all x , y , s , t  .   k has the reproducing property k , k(x,)=k(x ) for all k ;   k spans h=span{k(x, )    xx} ;   k(x , y , s , t)=k(y , x , s , t ) for all x , y , s , t  .
 dna microarrays provide rich profiles that are used in 
 cancer prediction considering the gene expression levels 
 across a collection of related samples . 
 support vector machines 
 ( svm ) have been applied to the classification of cancer 
 samples with encouraging results . 
 however , they rely on 
 euclidean distances that fail to reflect accurately the proximities 
 among sample profiles . then 
 , non - euclidean dissimilarities 
 provide additional information that should be considered 
 to reduce the misclassification errors . 
 in this paper 
 , we incorporate in the -svm algorithm a 
 linear combination of non - euclidean dissimilarities . 
 the 
 weights of the combination are learnt in a ( hyper 
 reproducing kernel hilbert space ) hrkhs using a semidefinite 
 programming algorithm . 
 this approach allows us to incorporate 
 a smoothing term that penalizes the complexity of the 
 family of distances and avoids overfitting . 
 the experimental results suggest that the method proposed 
 helps to reduce the misclassification errors in several 
 human cancer problems . 
1. Introduction
2. Material and Methods
3. Results and Analysis
4. Conclusions

					