<title>Introduction</title> <p>The dynamics of gene expression in a biological system exposed to varying experimental conditions, such as dose response to a drug or a time course, can be analyzed now at the whole genome level by generating series of microarrays or using massively parallel sequencing technologies. Each gene in the genome becomes associated with a set of expression values, called gene expression profile. The main challenge for the biologist is to identify, among the tens of thousands of gene expression profiles, trends or patterns revealing biological properties of the system that may lead to the formation of novel hypotheses. Some such patterns are easy to detect, e.g., when a gene is silent under most conditions but is actively transcribed under a subset of conditions. However, other patterns may be subtle and of unknown shape, as well as relatively noisy, so there is a continuous need for better methods of pattern detection in gene expression data.</p> <p>Microarray time series have been extensively generated to study periodic biological processes, such as the cell cycle ##REF##9843569##[1]##, circadian regulation ##REF##11733057##[2]##, ##REF##11719206##[3]##, the life cycle of malaria parasite in human blood ##REF##12929205##[4]## and vertebrae segmentation ##REF##17095659##[5]##. In most of these cases, the periodic behavior observed at the macroscopic scale is associated with periodic changes in the level of multiple mRNAs. Several approaches have been used to identify genes whose periodic expression underlies the cellular- or tissue-level periodic behavior of the system. A common feature of these approaches is their strict assumptions about the shape of periodic profiles. For example, popular Fourier-based methods detect periodicity by decomposing gene expression profiles into a series of sine curves. However, these methods are less sensitive to many types of periodic profiles that are poorly approximated by sine curves (because of the noise in the experimental measurements or because periodic profiles might have a different shape, such as asymmetric profiles with short peak and long trough), introducing biases to the results. Moreover, little attention has been given to the possible presence of aperiodic, yet non-random, patterns of gene expression in the transcription program of periodic biological processes.</p> <p>The segmentation of the vertebrate axis into periodic structures, such as vertebrae, occurs during embryogenesis when the vertebral precursors, the somites, are formed rhythmically from the presomitic mesoderm (PSM). This process is associated with a molecular oscillator, the segmentation clock, which drives periodic gene expression in the PSM with a period corresponding to that of somite formation ##REF##9393857##[6]##, ##REF##18414404##[7]##. During one somite formation (one clock cycle), cyclic genes, such as <italic>Lunatic fringe</italic> (<italic>Lfng</italic>), are expressed as a wave initiated in the posterior PSM that progressively migrates along the PSM and narrows as it moves anteriorly ##REF##9742402##[8]##–##REF##9740806##[10]##. A microarray time series of PSM samples encompassing one period of the segmentation clock has been generated in the mouse and analyzed using the Lomb-Scargle (L) periodogram, a method related to Fourier analysis in that it attempts to fit the observed data to a sine curve ##REF##17095659##[5]##, ##REF##16303799##[11]## (Microarray data are available at ArrayExpress at <ext-link ext-link-type="uri" xlink:href="http://www.ebi.ec.uk/arrayexpress/">www.ebi.ec.uk/arrayexpress/</ext-link> under accession number E-TABM-163). This analysis identified a large number of novel cyclic genes that fall into two biologically coherent clusters oscillating in opposite phase, one of which is associated with the Wnt and the other with the Notch and FGF signaling pathways.</p> <p>This paper is the result of a collaborative effort which occurred in the context of the Defense Advanced Research Projects Agency (DARPA) FUNBIO program that brought together mathematicians, physicists and biologists to evaluate novel mathematical approaches for biological data analysis. In this paper, we applied four different mathematical approaches to the same mouse segmentation dataset and compared the results to the original study. The four methods are: Phase consistency (P), Address reduction (A), Cyclohedron test (C), and Stable persistence (S). These methods can be divided into two groups. In the first group, the P and S methods ##UREF##0##[12]## are hypothesis-driven and search for periodic profiles but in a very different way compared to the L method. The P method optimizes the ratio of the total variation to the sum of the piecewise variations, with the pieces set by the behavior of the known cyclic gene <italic>Lfng</italic>, and the S method is based on a numerical assessment that is provably stable (see <xref ref-type="sec" rid="s3">Materials and Methods</xref> - “Pattern Detection Methods”). In the second group, the A ##UREF##1##[13]##, ##UREF##2##[14]## and C ##REF##17764440##[15]##, ##UREF##3##[16]## methods are data-driven and attempt to identify significant patterns without assuming the periodic nature of the patterns of interest. Both methods associate significance inversely with the likelihood of certain groups of patterns but differ from each other in how they partition the set of all possible patterns into groups.</p> <p>All methods identified previously known cyclic genes among their top ranked candidates and each method identified a number of novel candidate cyclic genes of the Wnt pathway. We show that one such gene, coding for the Wnt-target and Wnt-modulator <italic>cysteine rich protein 61</italic> (<italic>Cyr61</italic>) identified by three of the methods, represents a novel bona fide cyclic gene of the mouse segmentation clock.</p>
<title>Materials and Methods</title> <title>Description of the starting microarray dataset</title> <p>Microarray data, available at ArrayExpress at <ext-link ext-link-type="uri" xlink:href="http://www.ebi.ec.uk/arrayexpress/">www.ebi.ec.uk/arrayexpress/</ext-link> under accession number E-TABM-163, were normalized as described ##REF##17095659##[5]## and filtered based on detection call (by removing the probe sets called “absent” throughout the experiment), signal intensity (by removing genes with low-maximum expression level &lt;50) and amplitude (by eliminating peak-to-trough variation &lt;1.65). After these filters, the dataset consisted of 7,549 probe sets.</p> <title>Pattern Detection Methods</title> <p>Here we describe the four methods used in the analysis of the mouse segmentation clock: Phase consistency (P), Address reduction (A), Cyclohedron test (C) and Stable persistence (S). For further details, we refer the reader to papers describing each individual method. A description of the Lomb-Scargle method (L), previously used to study the mouse segmentation clock in ##REF##17095659##[5]## can be found in ##REF##16303799##[11]##. In contrast to experiments exhibiting two or more periods, which are well suited to Fourier analysis and related methods (see, e.g.,##REF##17400726##[30]##), the mouse embryo data in this paper represents only a single period. The analysis of this system is therefore particularly challenging and requires novel approaches.</p> <p>The methods A, C and S begin by converting the raw data into rank order, which we explain here. Each gene is characterized by its expression profile, which is a function <italic>f</italic> whose values are given at <italic>N</italic>  =  17 distinct time points. In the raw data, these values <italic>f<sub>i</sub></italic>, for 1≤<italic>i</italic>≤<italic>N</italic>, are real numbers quantifying the amount of expression as measured by the microarray. We sort the values and replace each <italic>f<sub>i</sub></italic> by its rank within this sorted order. For example, the values (0.41, 0.63, 0.11, 0.23, 0.59) would be replaced by (3, 5, 1, 2, 4). The function <italic>f</italic> is thus replaced by a permutation which we denote <italic>π</italic>(<italic>f</italic>) and the <italic>i</italic>th element of <italic>π</italic> is <italic>π<sub>i</sub></italic>. Ramifications of this step are provided in the Discussion.</p> <p>All four methods associate with each gene expression profile a number <italic>μ</italic>(<italic>f</italic>). This number is used to rank the probe sets in order of significance (as defined by each method).</p> <title>Phase consistency (P)</title> <p>This method is unique in that it looks directly at the raw data (<italic>f</italic> rather than <italic>π</italic>(<italic>f</italic>)) and uses information that is specific to the mouse embryo experiment. Specifically, it was observed that the expression of the gene <italic>Lfng</italic> suggests a decomposition into three <italic>phases</italic> comprising the first four, the next five and the last eight measurements in each time series. To make the phase lengths more equal in size, we further divided the last phase into two subphases, each comprising four measurements. Measurements were assigned to the respective subphases according to their projection onto the main principal component of the data in the eight-dimensional space. The periodicity of a function <italic>f</italic> is assessed by comparing the overall standard deviation with the sum of the normalized standard deviations of the four phases.</p> <p>
<italic>Mathematical description</italic>— First we normalize the function values to zero average and unit variance: <italic>x<sub>i</sub></italic> = (<italic>f<sub>i</sub></italic>−avg)/var<sup>1/2</sup>, where  and . By construction, the standard deviation of the normalized values is . The estimated population standard deviations of the four phases are denoted by <italic>σ<sub>i</sub></italic>. The measure used by P is thenOrdering by decreasing <italic>μ<sub>P</sub></italic> prioritizes profiles which exhibit a high global variation and low local variation.</p> <title>Address reduction (A)</title> <p>This method is based on the idea of algorithmic information content, also known as Kolmogorov complexity. In its original form, the Kolmogorov complexity is the length, in bits, of the shortest description of a data string given some universal computer. Address reduction bounds the Kolmogorov complexity of a gene expression profile and uses this to determine how much a curve can be compressed, measured in bits. This method works with the ranked data <italic>π</italic>(<italic>f</italic>), and the bound is calculated by dividing the address of the rank permutation into two parts: a coarse address (a block) and a fine address (the permutation within the block).</p> <p>
<italic>Mathematical description</italic>—We first partition the space of permutations into blocks using some <italic>blocking function γ<sub>A</sub></italic> that maps each permutation to a real number; permutations with the same number are in the same block. Second, we base the measure of an expression profile <italic>f</italic> on the size of the block that contains it, and the total number of possible blocks. Then the number of bits <italic>μ<sub>A</sub></italic>(<italic>f</italic>) that <italic>f</italic> can be compressed iswhere  is the set of permutations mapping to the same block as <italic>π</italic>(<italic>f</italic>) and Im(<italic>γ<sub>A</sub></italic>), the image of <italic>γ<sub>A</sub></italic>, is the set of possible values that the blocking function can take on. The vertical bars denote the number of elements in the set shown between them. Subtracting the logarithm of the image size allows comparison between different blocking functions and curves with different numbers of data points, which we do not consider here. In the application to the mouse embryo data, we use what is sometimes called the <italic>bounded variation</italic>, , where <italic>π<sub>i</sub></italic> is the rank of <italic>f<sub>i</sub></italic> in the sorted order (see ##FIG##5##Figure 6## left for an example). Other blocking functions can be used: see ##FIG##0##Figure 1## right and ##REF##16766565##[31]##, as well as the discussions of the methods C and S. Further details about address reduction can be found in ##UREF##2##[14]##, ##REF##16766565##[31]##.</p> <title>Cyclohedron test (C)</title> <p>This method is a non-parametric test that determines the significance of each expression profile based on its topography. In addition, <italic>p-</italic>values are computed for groups of highest ranked genes. Similar to A, the score in C is derived from the ranked data <italic>π</italic>(<italic>f</italic>). It involves a partition of the set of patterns, and ascribes higher biological significance to patterns in small blocks of the partition. However, the details of C and A are quite different.</p> <p>
<italic>Mathematical description</italic>—This method is a non-parametric test that is based on the significance of a <italic>topographical map</italic> constructed from a permutation. The topographical map is obtained by encircling the vertices of a cycle in decreasing order of their corresponding raw data vector coordinates. Denoting the first circle by the set <italic>σ</italic>
<sub>1</sub>, the second by <italic>σ</italic>
<sub>2</sub>, and so on, the circles are constructed according to the following provision: in order to encircle the vertex <italic>δ<sub>i</sub></italic>, if it is adjacent to some vertex <italic>j</italic> which has already been encircled by some <italic>σ<sub>k</sub></italic>, then <italic>σ<sub>i</sub></italic> must contain the <italic>σ<sub>k</sub></italic> circle. ##FIG##6##Figure 7## depicts the beginning of the creation of such a topographical map.</p> <p>The score <italic>μ<sub>C</sub></italic>(<italic>f</italic>) assigned to the raw data vector <italic>f</italic> is the number of permutations that have the same topographical map as the permutation <italic>π</italic>(<italic>f</italic>); this score is called the <italic>permutation count</italic>. Data vectors with small permutation counts are deemed significant, because it is unlikely that a random permutation will have a topographical map shared by few permutations. A full description of the cyclohedron test, including a method for computing <italic>p-</italic>values, appears in ##REF##17764440##[15]##. Connections to algebraic combinatorics are discussed in ##UREF##3##[16]##.</p> <title>Stable persistence (S)</title> <p>In contrast to A and C, this method assesses the biological significance of an expression pattern directly from the corresponding permutation <italic>π</italic>(<italic>f</italic>), without calculating block sizes of the implied partition. The main focus is to use a measure that is stable under small perturbations of the gene expression profile.</p> <p>
<italic>Mathematical description</italic>—Each expression pattern corresponds to one period of somitogenesis. We represent this period by a circle and denote time points where expression levels were measured by <italic>x<sub>i</sub></italic>, 1≤<italic>i</italic>≤<italic>N</italic>. Since these times are unknown, we choose the <italic>N</italic> points <italic>x<sub>i</sub></italic> at regular intervals during the period, that is, , and define <italic>g</italic>(<italic>x<sub>i</sub></italic>) = (<italic>π<sub>i</sub></italic>−1)/(<italic>N</italic>−1), where <italic>π<sub>i</sub></italic> is the rank of <italic>f<sub>i</sub></italic> in the sorted ordering, as before. Values of <italic>g</italic>(<italic>x</italic>) at other points of the circle are obtained by linear interpolation. Notice that the normalization constant 1/(<italic>N</italic>−1) guarantees that 0≤<italic>g</italic>(<italic>x</italic>)≤1.</p> <p>Given a threshold <italic>t</italic>, the <italic>sublevel set g</italic>
<sup>−1</sup>[0, <italic>t</italic>] consists of all points <italic>x</italic> of the circle with <italic>g</italic>(<italic>x</italic>)≤<italic>t</italic>. In other words, it contains all the time intervals during which the (modified) expression level is below <italic>t</italic>. As we increase the threshold from 0 to 1, the sublevel set grows until it eventually covers the entire circle. A <italic>birth event</italic> corresponds to <italic>t</italic> passing the function value of a minimum, at which time a new interval is added to the sublevel set. A <italic>death event</italic> corresponds to <italic>t</italic> passing the value of a maximum, at which time the sublevel set merges two intervals into one or, at the last and global maximum, it closes up to form the complete circle. Using this process we form a canonical pairing in which each minimum is matched with the maximum that merges its interval with another interval started by an earlier minimum; see ##UREF##0##[12]## and ##FIG##7##Figure 8##.</p> <p>After matching the global minimum with the global maximum we exhausted all minima and maxima and completed the construction of the canonical pairing. The <italic>persistence</italic> of a min-max pair (<italic>x<sub>i</sub></italic>, <italic>x<sub>j</sub></italic>) is the difference between the function values pers(<italic>i</italic>, <italic>j</italic>)  =  <italic>g</italic>(<italic>x<sub>j</sub></italic>)−<italic>g</italic>(<italic>x<sub>i</sub></italic>), which is necessarily positive. Pairs with small persistence correspond to small local variations of the expression profile, while pairs with large persistence correspond to significant oscillations. We note that the sum of persistences is equal to half the bounded variation used in A, except that there the domain is taken as the interval rather than the circle. For each non-negative integer <italic>p</italic>, we define the <italic>order-p measure</italic> as the sum of the <italic>p</italic>-th powers of the persistences over all min-max pairs. (Incidentally, the blocking functions <italic>γ<sub>A</sub></italic> and <italic>γ<sub>C</sub></italic> are related to the order-1 measure.) As proved in ##UREF##4##[32]##, this measure is stable for <italic>p</italic>≥2 and unstable for <italic>p</italic> equal to 0 or 1. Method S uses the order-2 measure, since two is the smallest integer power that implies stability. Thus,Further details about stable persistence can be found in ##UREF##0##[12]##, ##UREF##4##[32]##.</p> <title>Cluster analysis</title> <p>The 300 top ranked expression profiles of each method were clustered using K-means based on the Pearson correlation distance in MultiExperiment Viewer (MEV) software. The optimal number of clusters was determined using the Figure of Merit (FOM) function ##REF##11301299##[33]## in the MEV package that provides a measure of the fit of the expression patterns for the clusters produced by K-means.</p> <title>Dimensionality analysis</title> <p>Effective dimensionality, or number of degrees of freedom of the five “top 300” datasets (##SUPPL##0##Figure S1##) can be inferred from Principal Component Analysis (see e.g., ##REF##18269978##[34]##). The transcription profiles have been normalized to zero average and unit variance. Then, principal components have been computed for each of the sets of 300 points (top 300 from each method). Intrinsic dimensions in each set were considered significant until differences in log residual variance drop and converge towards the common noise level.</p> <title>Experimental validation</title> <p>The candidate cyclic gene <italic>Cyr61</italic> was experimentally validated by whole mount <italic>in situ</italic> hybridization that was performed as described ##REF##7596411##[35]## on 9.0 dpc mouse embryos using expressed sequence tag (ESTs) from Image clone 5716887 as a probe for <italic>Cyr61</italic>.</p> <title>Accession Numbers</title> <p>The NCBI EntrezGene (<ext-link ext-link-type="uri" xlink:href="http://www.ncbi.nlm.nih.gov/sites/entrez/query.fcgidbgene">http://www.ncbi.nlm.nih.gov/sites/entrez/query.fcgidbgene</ext-link>) accession numbers for the genes discussed in this paper are <italic>Axin2</italic> (12006), <italic>c-Myc</italic> (17869), <italic>Cyr61</italic> (16007), <italic>Dact1</italic> (59036), <italic>Dkk1</italic> (13380), <italic>Fgf9</italic> (14180), <italic>Gbx2</italic> (14472), <italic>Hoxb1</italic> (15407), <italic>Lfng</italic> (16848), <italic>Rho</italic> (212541) and <italic>Spen</italic> (56381).</p>
<title>Results and Discussion</title> <p>In this study, we used a microarray dataset generated in earlier work ##REF##17095659##[5]## to identify cyclic genes associated with the mouse segmentation clock. A microarray time series was generated by collecting the PSM tissue from 17 embryos (17 time points) along the clock cycle and analyzed using L analysis ##REF##17095659##[5]## that focuses on the genes whose expression patterns display the best fit to a sine curve ##REF##16303799##[11]##. This led to identification of 27 strongly periodic probe sets (corresponding to 25 genes), including seven cyclic genes whose cyclic expression pattern had been discovered earlier by <italic>in situ</italic> hybridization ##REF##9742402##[8]##–##REF##9740806##[10]##, ##REF##12636920##[17]##–##REF##11923214##[22]## and 20 more probe sets that subsequently were experimentally validated by <italic>in situ</italic> hybridization after L analysis ##REF##17095659##[5]## (Supplementary Information, ##SUPPL##1##Table S1##).</p> <p>In this study, we used the four methods (P, A, C and S) to rank the 7,549 probe sets of the same dataset in order of the significance of their expression profile (as defined by each method (see <xref ref-type="sec" rid="s3">Materials and Methods</xref> - “Pattern Detection Methods”). We selected the top 300 ranked probe sets from each list (Supplementary Information, ##SUPPL##2##Tables S2##, ##SUPPL##3##S3##, ##SUPPL##4##S4##, ##SUPPL##5##S5## and ##SUPPL##6##S6##). First, we compared the rank of the seven known cyclic genes that were independently identified from non-microarray experimental methods. The L, P, A and S methods each identified at least five out of the seven benchmark genes in the top ranked 100 probe sets; whereas, C identified three of the seven known genes (##FIG##0##Figure 1A##). To measure the performance to a higher resolution, we repeated this analysis using a larger collection of 27 probe sets experimentally validated ##REF##17095659##[5]##. As indicated in ##FIG##0##Figure 1B##, method S performs best by identifying 90% of the benchmark probesets, followed by methods A and P (approximately 75% and 63%, respectively) and C (approximately 37%). Among the top 10 probe sets of each list, the methods perform similarly by ranking among them from four to five benchmark probesets. Thus, all methods, whether or not designed to detect specifically periodic patterns, identified cyclic genes from among their top ranked candidates. This suggests that periodic patterns of gene expression are predominant among all non-random patterns in this dataset, which is consistent with the experimental design of the time series generation. Indeed, due to technical issues, the right PSM samples of the time series were dissected from mouse embryos belonging to five consecutive somite cycles, and they were ordered based on their phase of <italic>Lfng</italic> expression pattern (revealed by <italic>in situ</italic> hybridization on the left PSM of each dissected mouse embryo) to reconstitute a unique oscillation cycle ##REF##17095659##[5]##. One of the consequences of this strategy is that the collapsed dataset generated by this procedure preserves periodic patterns associated with the segmentation clock, while it may affect most other patterns (such as a linear increase with developmental time).</p> <p>We next compared the intersection of the top 300 ranked probe sets from the four methods and method L. This is represented in ##FIG##1##Figure 2A## as a five-set Venn diagram in which each color corresponds to a different method and in ##FIG##1##Figure 2B## as a Haase diagram in the form of the lattice of the subsets of a five-element set. The total number of distinct probe sets in all of the five sets (the union) is 884; the total number in each of the five sets (the intersection) is 21. The overlap contains eight true positive cyclic genes (Supplementary Information, ##SUPPL##7##Table S7##). Many candidate genes were identified by only one, two, three or four methods. The L, P and C methods identified larger numbers of unique genes (104, 160 and 154, respectively) compared to method A (67) and method S (47) (##FIG##1##Figure 2##). Although it is not possible to know whether all the uniquely predicted genes are associated with the segmentation clock, many of them are biologically plausible since they are associated with the Wnt pathway.</p> <p>We then studied the possible biological links of the top 300 genes predicted by each method to the segmentation clock process. Most of the validated cyclic genes (22 probesets or 20 genes) identified in the top 38 probesets list of the original L analysis are associated with the Notch-, FGF- and Wnt-signaling pathways and organized in two clusters ##REF##17095659##[5]##. In the first cluster, almost one half of the genes are associated with the Notch- and FGF-signaling pathways. The second cluster shows an even more striking biological coherence with more than 90% of the genes linked to Wnt signaling. To test the biological relevance of the predictions of each method, we investigated their ability to identify novel cyclic candidates associated with Wnt signaling. We first independently clustered the top 300 gene expression profiles identified by the P, A, C, S and L methods (##FIG##2##Figure 3##; Supplementary Information, ##SUPPL##8##Table S8##, ##SUPPL##9##S9##, ##SUPPL##10##S10##, ##SUPPL##11##S11## and ##SUPPL##12##S12## and <xref ref-type="sec" rid="s3">Materials and Methods</xref>). While the L and S methods identified periodic patterns oscillating in different phases, the P, A and C methods also identified a larger variety of patterns (illustrated by higher numbers of clusters). Dimensionality analysis, inferred from principal component analysis (<xref ref-type="sec" rid="s3">Materials and Methods</xref>; ##SUPPL##0##Figure S1##) of the corresponding top 300 probeset lists, is in agreement with these observations. The highest numbers of degrees of freedom (between four and six) found for C and A stem from the uninformed priors used in these methods, allowing for discovery of unrestricted profile shapes. In contrast, the other methods are characterized by smaller numbers of degrees of freedom: L had only two significant degrees of freedom, corresponding to sine and cosine of the main harmonic oscillation; S had two strong sin-cos components, plus two additional, presumably related to shape parameters; and finally, P showed three degrees of freedom (corresponding to the difference between phases 1 and 3, the difference between phases 2 and 3, and the variation within phase 3).</p> <p>In each of the five analyses, we identified a cluster of periodic profiles containing the known cyclic genes <italic>Axin2</italic>, <italic>dickkopf homolog 1</italic> (<italic>Dkk1</italic>), <italic>myelocytomatosis oncogene</italic> (<italic>c-Myc</italic>) and <italic>dapper homolog</italic> (<italic>Dact1</italic>) of the Wnt pathway (##FIG##2##Figure 3## [red boxes]; ##FIG##3##Figure 4##; ##TAB##0##Table 1##). Given the very tight biological coherence of the Wnt cluster identified by the L method and according to the principle of “guilt by association,” it is likely that other gene members of the cluster also belong to the Wnt pathway. We find that the S method identifies the eight known members of the Wnt cluster previously identified by the L method and validated as described ##REF##17095659##[5]##, while the P and A methods identify six out of eight, and the C method identifies five out of eight of the known Wnt cyclic genes. We further analyzed the novel candidate cyclic genes contained in each of the Wnt clusters through a literature search to investigate their potential link to Wnt signaling (##TAB##0##Table 1##). The PubMed database was searched for each of the 142 genes in the Wnt clusters to identify articles indicating a link between these genes and the Wnt pathway. The results indicated some articles containing the two search terms: the “gene name” and “Wnt.” Manual curation of these results was necessary to verify the biological connection between each gene and the Wnt pathway. The search of the PubMed database was automated using the MedlineR library ##REF##15284107##[23]## for the R statistical language. The number of matches for each pair of search terms was returned, as well as a link to the abstracts for each match. Thirteen genes were identified as novel Wnt cyclic gene candidates (##TAB##0##Table 1##).</p> <p>This allowed us to identify six novel candidate genes in the L-Wnt cluster showing a link to the Wnt pathway. These include the genes <italic>Cyr61</italic>
##REF##12702657##[24]##, <italic>homeo box B1</italic> (<italic>Hoxb1</italic>) ##REF##15857914##[25]##, <italic>rhodopsin</italic> (<italic>Rho</italic>) ##REF##14519393##[26]##, <italic>SPEN homolog</italic>, <italic>transcriptional regulator</italic> (<italic>Drosophila</italic>), (<italic>Spen</italic>) ##REF##17234755##[27]## and <italic>fibroblast growth factor 9</italic> (<italic>Fgf9</italic>) ##REF##12782598##[28]## which were all previously identified as Wnt targets. Interestingly, the P method performs similarly to the L method by predicting six new candidates (although only two are common with those predicted by L), while A, S and C methods predict two, two and three additional members, respectively. Most of the Wnt cyclic gene candidates predicted by the L method are also predicted by at least one of the other methods. In contrast, the P and C methods identify the largest numbers of putative Wnt pathway candidates that are not predicted by any other method.</p> <p>One of the candidates, <italic>Cyr61</italic> (##FIG##4##Figure 5A–E##), a well known Wnt target ##REF##16581771##[29]## which codes for a modulator of the Wnt-signaling pathway ##REF##12702657##[24]## that had not been identified in the original analysis ##REF##17095659##[5]##, was identified by three of the methods. We experimentally investigated the expression pattern of this gene by <italic>in situ</italic> hybridization in the PSM of mouse embryos (##FIG##4##Figure 5B–E##) and indeed, observed a dynamic pattern of expression in the posterior PSM that was reminiscent of the typical expression of a cyclic gene; hence, validating it as a novel cyclic gene and extending the list of known cyclic genes associated with the Wnt pathway. More generally, the other Wnt cyclic gene candidates identified by the different methods are attractive, potential new cyclic genes involved in the mouse segmentation clock and would deserve to be further experimentally validated. Interestingly, the <italic>gastrulation brain homeobox 2</italic> (<italic>Gbx2</italic>) gene predicted by method C and which is a target of Wnt signaling, was reported to be expressed in the PSM ##REF##12782598##[28]##, ##REF##16581771##[29]##.</p> <p>An interesting feature common to the A, C and S methods is that they work on the ranked data as opposed to the raw amplitudes of the signal. In other words, the signal intensities that describe over time the expression of a gene are sorted by magnitude, and each signal intensity is then replaced by the integer rank within this sorted order. Thus, each gene expression profile is represented by a permutation that is invariant over the transformations of monotonically increasing functions (such as log or taking the square) and is much more mathematically tractable. These methods offer a particular advantage for the analysis of this segmentation clock time series in which only the ordering of the time points could be estimated, but not the exact time interval in between. These methods, based on the rank permutation, do not require such precise timing information. These methods perform similarly to the L and P methods, which use the raw signal intensities. This suggests that moving to ranked data despite losing some information (like fold change), might be advantageous in certain cases, especially when these methods are not based on <italic>a priori</italic> biological knowledge, making them promising exploratory tools to discover novel, interesting transcriptional patterns in large-scale expression analysis.</p>
<title>Results and Discussion</title> <p>In this study, we used a microarray dataset generated in earlier work ##REF##17095659##[5]## to identify cyclic genes associated with the mouse segmentation clock. A microarray time series was generated by collecting the PSM tissue from 17 embryos (17 time points) along the clock cycle and analyzed using L analysis ##REF##17095659##[5]## that focuses on the genes whose expression patterns display the best fit to a sine curve ##REF##16303799##[11]##. This led to identification of 27 strongly periodic probe sets (corresponding to 25 genes), including seven cyclic genes whose cyclic expression pattern had been discovered earlier by <italic>in situ</italic> hybridization ##REF##9742402##[8]##–##REF##9740806##[10]##, ##REF##12636920##[17]##–##REF##11923214##[22]## and 20 more probe sets that subsequently were experimentally validated by <italic>in situ</italic> hybridization after L analysis ##REF##17095659##[5]## (Supplementary Information, ##SUPPL##1##Table S1##).</p> <p>In this study, we used the four methods (P, A, C and S) to rank the 7,549 probe sets of the same dataset in order of the significance of their expression profile (as defined by each method (see <xref ref-type="sec" rid="s3">Materials and Methods</xref> - “Pattern Detection Methods”). We selected the top 300 ranked probe sets from each list (Supplementary Information, ##SUPPL##2##Tables S2##, ##SUPPL##3##S3##, ##SUPPL##4##S4##, ##SUPPL##5##S5## and ##SUPPL##6##S6##). First, we compared the rank of the seven known cyclic genes that were independently identified from non-microarray experimental methods. The L, P, A and S methods each identified at least five out of the seven benchmark genes in the top ranked 100 probe sets; whereas, C identified three of the seven known genes (##FIG##0##Figure 1A##). To measure the performance to a higher resolution, we repeated this analysis using a larger collection of 27 probe sets experimentally validated ##REF##17095659##[5]##. As indicated in ##FIG##0##Figure 1B##, method S performs best by identifying 90% of the benchmark probesets, followed by methods A and P (approximately 75% and 63%, respectively) and C (approximately 37%). Among the top 10 probe sets of each list, the methods perform similarly by ranking among them from four to five benchmark probesets. Thus, all methods, whether or not designed to detect specifically periodic patterns, identified cyclic genes from among their top ranked candidates. This suggests that periodic patterns of gene expression are predominant among all non-random patterns in this dataset, which is consistent with the experimental design of the time series generation. Indeed, due to technical issues, the right PSM samples of the time series were dissected from mouse embryos belonging to five consecutive somite cycles, and they were ordered based on their phase of <italic>Lfng</italic> expression pattern (revealed by <italic>in situ</italic> hybridization on the left PSM of each dissected mouse embryo) to reconstitute a unique oscillation cycle ##REF##17095659##[5]##. One of the consequences of this strategy is that the collapsed dataset generated by this procedure preserves periodic patterns associated with the segmentation clock, while it may affect most other patterns (such as a linear increase with developmental time).</p> <p>We next compared the intersection of the top 300 ranked probe sets from the four methods and method L. This is represented in ##FIG##1##Figure 2A## as a five-set Venn diagram in which each color corresponds to a different method and in ##FIG##1##Figure 2B## as a Haase diagram in the form of the lattice of the subsets of a five-element set. The total number of distinct probe sets in all of the five sets (the union) is 884; the total number in each of the five sets (the intersection) is 21. The overlap contains eight true positive cyclic genes (Supplementary Information, ##SUPPL##7##Table S7##). Many candidate genes were identified by only one, two, three or four methods. The L, P and C methods identified larger numbers of unique genes (104, 160 and 154, respectively) compared to method A (67) and method S (47) (##FIG##1##Figure 2##). Although it is not possible to know whether all the uniquely predicted genes are associated with the segmentation clock, many of them are biologically plausible since they are associated with the Wnt pathway.</p> <p>We then studied the possible biological links of the top 300 genes predicted by each method to the segmentation clock process. Most of the validated cyclic genes (22 probesets or 20 genes) identified in the top 38 probesets list of the original L analysis are associated with the Notch-, FGF- and Wnt-signaling pathways and organized in two clusters ##REF##17095659##[5]##. In the first cluster, almost one half of the genes are associated with the Notch- and FGF-signaling pathways. The second cluster shows an even more striking biological coherence with more than 90% of the genes linked to Wnt signaling. To test the biological relevance of the predictions of each method, we investigated their ability to identify novel cyclic candidates associated with Wnt signaling. We first independently clustered the top 300 gene expression profiles identified by the P, A, C, S and L methods (##FIG##2##Figure 3##; Supplementary Information, ##SUPPL##8##Table S8##, ##SUPPL##9##S9##, ##SUPPL##10##S10##, ##SUPPL##11##S11## and ##SUPPL##12##S12## and <xref ref-type="sec" rid="s3">Materials and Methods</xref>). While the L and S methods identified periodic patterns oscillating in different phases, the P, A and C methods also identified a larger variety of patterns (illustrated by higher numbers of clusters). Dimensionality analysis, inferred from principal component analysis (<xref ref-type="sec" rid="s3">Materials and Methods</xref>; ##SUPPL##0##Figure S1##) of the corresponding top 300 probeset lists, is in agreement with these observations. The highest numbers of degrees of freedom (between four and six) found for C and A stem from the uninformed priors used in these methods, allowing for discovery of unrestricted profile shapes. In contrast, the other methods are characterized by smaller numbers of degrees of freedom: L had only two significant degrees of freedom, corresponding to sine and cosine of the main harmonic oscillation; S had two strong sin-cos components, plus two additional, presumably related to shape parameters; and finally, P showed three degrees of freedom (corresponding to the difference between phases 1 and 3, the difference between phases 2 and 3, and the variation within phase 3).</p> <p>In each of the five analyses, we identified a cluster of periodic profiles containing the known cyclic genes <italic>Axin2</italic>, <italic>dickkopf homolog 1</italic> (<italic>Dkk1</italic>), <italic>myelocytomatosis oncogene</italic> (<italic>c-Myc</italic>) and <italic>dapper homolog</italic> (<italic>Dact1</italic>) of the Wnt pathway (##FIG##2##Figure 3## [red boxes]; ##FIG##3##Figure 4##; ##TAB##0##Table 1##). Given the very tight biological coherence of the Wnt cluster identified by the L method and according to the principle of “guilt by association,” it is likely that other gene members of the cluster also belong to the Wnt pathway. We find that the S method identifies the eight known members of the Wnt cluster previously identified by the L method and validated as described ##REF##17095659##[5]##, while the P and A methods identify six out of eight, and the C method identifies five out of eight of the known Wnt cyclic genes. We further analyzed the novel candidate cyclic genes contained in each of the Wnt clusters through a literature search to investigate their potential link to Wnt signaling (##TAB##0##Table 1##). The PubMed database was searched for each of the 142 genes in the Wnt clusters to identify articles indicating a link between these genes and the Wnt pathway. The results indicated some articles containing the two search terms: the “gene name” and “Wnt.” Manual curation of these results was necessary to verify the biological connection between each gene and the Wnt pathway. The search of the PubMed database was automated using the MedlineR library ##REF##15284107##[23]## for the R statistical language. The number of matches for each pair of search terms was returned, as well as a link to the abstracts for each match. Thirteen genes were identified as novel Wnt cyclic gene candidates (##TAB##0##Table 1##).</p> <p>This allowed us to identify six novel candidate genes in the L-Wnt cluster showing a link to the Wnt pathway. These include the genes <italic>Cyr61</italic>
##REF##12702657##[24]##, <italic>homeo box B1</italic> (<italic>Hoxb1</italic>) ##REF##15857914##[25]##, <italic>rhodopsin</italic> (<italic>Rho</italic>) ##REF##14519393##[26]##, <italic>SPEN homolog</italic>, <italic>transcriptional regulator</italic> (<italic>Drosophila</italic>), (<italic>Spen</italic>) ##REF##17234755##[27]## and <italic>fibroblast growth factor 9</italic> (<italic>Fgf9</italic>) ##REF##12782598##[28]## which were all previously identified as Wnt targets. Interestingly, the P method performs similarly to the L method by predicting six new candidates (although only two are common with those predicted by L), while A, S and C methods predict two, two and three additional members, respectively. Most of the Wnt cyclic gene candidates predicted by the L method are also predicted by at least one of the other methods. In contrast, the P and C methods identify the largest numbers of putative Wnt pathway candidates that are not predicted by any other method.</p> <p>One of the candidates, <italic>Cyr61</italic> (##FIG##4##Figure 5A–E##), a well known Wnt target ##REF##16581771##[29]## which codes for a modulator of the Wnt-signaling pathway ##REF##12702657##[24]## that had not been identified in the original analysis ##REF##17095659##[5]##, was identified by three of the methods. We experimentally investigated the expression pattern of this gene by <italic>in situ</italic> hybridization in the PSM of mouse embryos (##FIG##4##Figure 5B–E##) and indeed, observed a dynamic pattern of expression in the posterior PSM that was reminiscent of the typical expression of a cyclic gene; hence, validating it as a novel cyclic gene and extending the list of known cyclic genes associated with the Wnt pathway. More generally, the other Wnt cyclic gene candidates identified by the different methods are attractive, potential new cyclic genes involved in the mouse segmentation clock and would deserve to be further experimentally validated. Interestingly, the <italic>gastrulation brain homeobox 2</italic> (<italic>Gbx2</italic>) gene predicted by method C and which is a target of Wnt signaling, was reported to be expressed in the PSM ##REF##12782598##[28]##, ##REF##16581771##[29]##.</p> <p>An interesting feature common to the A, C and S methods is that they work on the ranked data as opposed to the raw amplitudes of the signal. In other words, the signal intensities that describe over time the expression of a gene are sorted by magnitude, and each signal intensity is then replaced by the integer rank within this sorted order. Thus, each gene expression profile is represented by a permutation that is invariant over the transformations of monotonically increasing functions (such as log or taking the square) and is much more mathematically tractable. These methods offer a particular advantage for the analysis of this segmentation clock time series in which only the ordering of the time points could be estimated, but not the exact time interval in between. These methods, based on the rank permutation, do not require such precise timing information. These methods perform similarly to the L and P methods, which use the raw signal intensities. This suggests that moving to ranked data despite losing some information (like fold change), might be advantageous in certain cases, especially when these methods are not based on <italic>a priori</italic> biological knowledge, making them promising exploratory tools to discover novel, interesting transcriptional patterns in large-scale expression analysis.</p>
<p>Performed the experiments: MLD. Analyzed the data: MLD. Wrote the paper: MLD HE TMAF GH AK AM MR OP. Prepared the microarray data: MD. Conceived, designed and implemented the algorithm of the Address reduction method: SA TMAF. Conceived and designed the algorithm of the Stable persistence method: HE YM. Implemented the algorithm of the Lomb Scargle method: EFG. Implemented the automated PubMed Search: GH. Conceived, designed and implemented the algorithm of the Phase consistency method: AK MR. Conceived, designed and implemented the algorithm of the Cyclohedron test method: JM AS. Conceived and designed the algorithm of the Cyclohedron test method: LP BS.</p> <p>While genome-wide gene expression data are generated at an increasing rate, the repertoire of approaches for pattern discovery in these data is still limited. Identifying subtle patterns of interest in large amounts of data (tens of thousands of profiles) associated with a certain level of noise remains a challenge. A microarray time series was recently generated to study the transcriptional program of the mouse segmentation clock, a biological oscillator associated with the periodic formation of the segments of the body axis. A method related to Fourier analysis, the Lomb-Scargle periodogram, was used to detect periodic profiles in the dataset, leading to the identification of a novel set of cyclic genes associated with the segmentation clock. Here, we applied to the same microarray time series dataset four distinct mathematical methods to identify significant patterns in gene expression profiles. These methods are called: Phase consistency, Address reduction, Cyclohedron test and Stable persistence, and are based on different conceptual frameworks that are either hypothesis- or data-driven. Some of the methods, unlike Fourier transforms, are not dependent on the assumption of periodicity of the pattern of interest. Remarkably, these methods identified blindly the expression profiles of known cyclic genes as the most significant patterns in the dataset. Many candidate genes predicted by more than one approach appeared to be true positive cyclic genes and will be of particular interest for future research. In addition, these methods predicted novel candidate cyclic genes that were consistent with previous biological knowledge and experimental validation in mouse embryos. Our results demonstrate the utility of these novel pattern detection strategies, notably for detection of periodic profiles, and suggest that combining several distinct mathematical approaches to analyze microarray datasets is a valuable strategy for identifying genes that exhibit novel, interesting transcriptional patterns.</p>
<title>Supporting Information</title>
<p>The authors thank Z. Otwinowski for helpful discussions, J. Chatfield for editorial assistance and S. Esteban for artwork.</p>
<fig id="pone-0002856-g001" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g001</object-id><label>Figure 1</label><caption><title>Identification of benchmark cyclic genes in the top 300 probe set lists of the five methods.</title><p>(A) Benchmark genes are composed of cyclic genes identified independently from the Lomb-Scargle (L) analysis (seven probe sets). (B) Benchmark genes also include cyclic genes identified by the L analysis and experimentally validated (27 probe sets). L, Lomb-Scargle analysis; P, Phase consistency; A, Address reduction; C, Cyclohedron test; S, Stable persistence.</p></caption></fig> <fig id="pone-0002856-g002" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g002</object-id><label>Figure 2</label><caption><title>Comparison of the intersection of the top 300 ranked probe sets from the five methods.</title><p>(A) Venn diagram. (B) Haase diagram shows the pairwise intersection of two lists, the triple intersection of three lists, and so on. The total number of distinct probe sets in all of the five top 300 lists (the union) is 884; the total number in each of the five sets (the intersection) is 21. L, Lomb-Scargle analysis; P, Phase consistency; A, Address reduction; C, Cyclohedron test; S, Stable persistence.</p></caption></fig> <fig id="pone-0002856-g003" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g003</object-id><label>Figure 3</label><caption><title>Clustering analysis of the top 300 ranked probe sets from the five methods.</title><p>K-means clustering was applied as described in the <xref ref-type="sec" rid="s3">Materials and Methods</xref> section. The “Notch” and “Wnt” clusters contain validated cyclic genes regulated by the Notch and Wnt pathways, respectively. Blue, decrease in gene expression; yellow, increase in gene expression. Wnt clusters are boxed in red.</p></caption></fig> <fig id="pone-0002856-g004" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g004</object-id><label>Figure 4</label><caption><title>Heatmap of the members of the Wnt clusters identified by the five methods.</title><p>Blue, decrease in gene expression; yellow, increase in gene expression.</p></caption></fig> <fig id="pone-0002856-g005" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g005</object-id><label>Figure 5</label><caption><title>Identification of <italic>Cyr61</italic> as a novel Wnt-cyclic gene.</title><p>(A) Gene expression profiles (in log<sub>2</sub> ratio of <italic>Cyr61</italic>) represented by two probe sets and the benchmark Wnt-cyclic gene <italic>Axin2</italic>. (B–E) Experimental validation by <italic>in situ</italic> hybridization. (B, C) Lateral views of the tails of 9.0 dpc mouse embryos hybridized with the <italic>Cyr61</italic> probe. (D, E) are schematic representations of (B) and (C), respectively, and illustrate the dynamic expression of the gene in the presomitic mesoderm. Arrows in all four panels indicate the posterior boundary of the last formed somite (SI).</p></caption></fig> <fig id="pone-0002856-g006" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g006</object-id><label>Figure 6</label><caption><title>Address reduction.</title><p>The tree representations of the block structures for the blocking functions <italic>γ</italic>
<sub>Δ1</sub> (left) and <italic>γ</italic>
<sub>+−</sub> (right) (<italic>γ</italic>
<sub>+−</sub> is the number of permutations with a given sequence of rises and falls ##UREF##2##[14]##). Locating a given curve using the two-part address is equivalent to starting at the centre of the tree (A) and finding a particular exit at the edge (e.g., B). Address reduction <italic>μ<sub>A</sub></italic> gives the reduction in information, measured in bits, to get from A to some B, compared to the information needed to locate B explicitly. In the case above, the endpoint B, being in a block of four, could correspond to the permutation (4, 5, 3, 2, 1) (this and three other permutations have <italic>γ</italic>
<sub>Δ1</sub>  =  5). To find it, someone starting at A would require log<sub>2</sub> 8+log<sub>2</sub> 4 = 5 bits of information (8 paths to choose from, then 4 paths to choose from), which is <italic>μ<sub>A</sub></italic>  =  1.91 bits less than that required to transmit (4, 5, 3, 2, 1) explicitly, namely, log<sub>2</sub> 5!.</p></caption></fig> <fig id="pone-0002856-g007" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g007</object-id><label>Figure 7</label><caption><title>The Cyclohedron test constructs a topographic map on the <italic>N</italic>-cycle by subsequently encircling vertices.</title><p>Displayed at the top are the formations of the first two circles <italic>σ<sub>i</sub></italic>, and at the bottom are the third and fourth, for an example with <italic>N</italic>  =  11.</p></caption></fig> <fig id="pone-0002856-g008" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.g008</object-id><label>Figure 8</label><caption><title>Function <italic>g</italic>(<italic>x</italic>) for the expression pattern of Axin2.</title></caption></fig>
<table-wrap id="pone-0002856-t001" position="float"><object-id pub-id-type="doi">10.1371/journal.pone.0002856.t001</object-id><label>Table 1</label><caption><title>Composition of the Wnt Clusters of the Five Methods.</title></caption><alternatives><table frame="hsides" rules="groups"><colgroup span="1"><col align="left" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/><col align="center" span="1"/></colgroup><thead><tr><td colspan="2" align="left" rowspan="1">Predicted Wnt-Cyclic Genes</td><td align="left" rowspan="1" colspan="1">Gene Symbol</td><td align="left" rowspan="1" colspan="1">L Rank</td><td align="left" rowspan="1" colspan="1">P Rank</td><td align="left" rowspan="1" colspan="1">A Rank</td><td align="left" rowspan="1" colspan="1">C Rank</td><td align="left" rowspan="1" colspan="1">S Rank</td></tr></thead><tbody><tr><td colspan="2" align="left" rowspan="1">Wnt-benchmark cyclic genes</td><td align="left" rowspan="1" colspan="1">
<italic>Dkk1</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Myc</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Axin2</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Dact1</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Tnfrsf19</italic>
</td><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">2</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Sp5</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Has2</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Phlda1</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1">Wnt-candidate cyclic genes</td><td align="left" rowspan="1" colspan="1">Candidates identified by several methods</td><td align="left" rowspan="1" colspan="1">
<italic>Cyr61</italic>
</td><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1">2</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Hoxb1</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Rho</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Pfkfb1</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">Candidates identified by only one method</td><td align="left" rowspan="1" colspan="1">
<italic>Spen</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Fgf9</italic>
</td><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Hnf4a</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Sgk</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Foxb1</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Ppap2b</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Amph</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Gbx2</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/></tr><tr><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">
<italic>Ptprf</italic>
</td><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1"/><td align="left" rowspan="1" colspan="1">1</td><td align="left" rowspan="1" colspan="1"/></tr></tbody></table></alternatives></table-wrap>
<inline-formula></inline-formula> <inline-formula></inline-formula> <inline-formula></inline-formula> <disp-formula></disp-formula> <disp-formula></disp-formula> <inline-formula></inline-formula> <inline-formula></inline-formula> <inline-formula></inline-formula> <disp-formula></disp-formula>
<supplementary-material content-type="local-data" id="pone.0002856.s001"><label>Figure S1</label><caption><p>(3.25 MB PDF)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s002"><label>Table S1</label><caption><p>(0.02 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s003"><label>Table S2</label><caption><p>(0.06 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s004"><label>Table S3</label><caption><p>(0.07 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s005"><label>Table S4</label><caption><p>(0.06 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s006"><label>Table S5</label><caption><p>(0.06 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s007"><label>Table S6</label><caption><p>(0.06 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s008"><label>Table S7</label><caption><p>(0.02 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s009"><label>Table S8</label><caption><p>(0.25 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s010"><label>Table S9</label><caption><p>(0.13 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s011"><label>Table S10</label><caption><p>(0.13 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s012"><label>Table S11</label><caption><p>(0.13 MB XLS)</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="pone.0002856.s013"><label>Table S12</label><caption><p>(0.13 MB XLS)</p></caption></supplementary-material>
<table-wrap-foot><fn id="nt101"><p>Numbers indicate the count of probe sets detected per gene.</p></fn><fn id="nt102"><p>L = Lomb-Scargle analysis; P = Phase consistency; A = Address reduction; C = Cyclohedron test; S = Stable persistence.</p></fn></table-wrap-foot> <fn-group><fn fn-type="COI-statement"><p><bold>Competing Interests: </bold>Thomas M.A. Fink and Sebastian Ahnert have filed U.S. patent 20070086635, Method of identifying pattern in a series of data.</p></fn><fn fn-type="financial-disclosure"><p><bold>Funding: </bold>This research was partially supported by DARPA grant HR 0011-05-1-0057. HE and YM mathematical work was supported by DARPA grant HR0011-05-1-0007. AS research was supported by a Lucent Technologies Bell Labs Graduate Research. Fellowship; AK and MR research was supported by NIH grant GM U54 GM74942; and SA research was supported by Association pour la Recherche sur le Cancer (ARC), France. OP, AM, MLD, EG and GH research was supported by the Stowers Institute for Medical Research. OP is a Howard Hughes Medical Institute Investigator.</p></fn></fn-group>
<graphic xlink:href="pone.0002856.g001"/> <graphic xlink:href="pone.0002856.g002"/> <graphic xlink:href="pone.0002856.g003"/> <graphic xlink:href="pone.0002856.g004"/> <graphic id="pone-0002856-t001-1" xlink:href="pone.0002856.t001"/> <graphic xlink:href="pone.0002856.g005"/> <inline-graphic xlink:href="pone.0002856.e001.jpg" mimetype="image"/> <inline-graphic xlink:href="pone.0002856.e002.jpg" mimetype="image"/> <inline-graphic xlink:href="pone.0002856.e003.jpg" mimetype="image"/> <graphic xlink:href="pone.0002856.e004.jpg" mimetype="image" position="float"/> <graphic xlink:href="pone.0002856.e005.jpg" mimetype="image" position="float"/> <inline-graphic xlink:href="pone.0002856.e006.jpg" mimetype="image"/> <inline-graphic xlink:href="pone.0002856.e007.jpg" mimetype="image"/> <graphic xlink:href="pone.0002856.g006"/> <graphic xlink:href="pone.0002856.g007"/> <inline-graphic xlink:href="pone.0002856.e008.jpg" mimetype="image"/> <graphic xlink:href="pone.0002856.g008"/> <graphic xlink:href="pone.0002856.e009.jpg" mimetype="image" position="float"/>
<media xlink:href="pone.0002856.s001.pdf"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s002.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s003.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s004.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s005.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s006.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s007.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s008.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s009.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s010.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s011.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s012.xls"><caption><p>Click here for additional data file.</p></caption></media> <media xlink:href="pone.0002856.s013.xls"><caption><p>Click here for additional data file.</p></caption></media>
[{"label": ["12"], "element-citation": ["\n"], "surname": ["Edelsbrunner", "Letscher", "Zomorodian"], "given-names": ["H", "D", "A"], "year": ["2002"], "article-title": ["Topological persistence and simplification."], "source": ["Discrete Comput Geom"], "volume": ["28"], "fpage": ["511"], "lpage": ["533"]}, {"label": ["13"], "element-citation": ["\n"], "surname": ["Ahnert", "Fink"], "given-names": ["SE", "TMA"], "year": ["2006"], "article-title": ["New distance measure for microarray data series based on unbiased pattern detection."], "source": ["Bioinformatics"], "fpage": ["1"], "lpage": ["4"]}, {"label": ["14"], "element-citation": ["\n"], "surname": ["Fink", "Brown", "Willbrand"], "given-names": ["TM", "FCS", "K"], "year": ["2007"], "article-title": ["1-D random landscapes and non-random data series."], "source": ["Europhysics Letters (EPL)"], "volume": ["79"], "fpage": ["38006"]}, {"label": ["16"], "element-citation": ["\n"], "surname": ["Morton", "Pachter", "Shiu", "Sturmfels", "Wienand"], "given-names": ["J", "L", "A", "B", "O"], "year": ["2006"], "article-title": ["Geometry of rank tests."], "comment": ["Proceedings of the conference Probabilistic Graphical Models (PGM 3), Prague, Czech Republic, September 2006, available from ArXiv:math.ST/0605173"]}, {"label": ["32"], "element-citation": ["\n"], "surname": ["Cohen-Steiner", "Edelsbrunner", "Harer", "Mileyko"], "given-names": ["D", "H", "J", "Y"], "year": ["2007"], "article-title": ["Lipschitz functions have "], "italic": ["Lp"]}]
PLoS One. 2008 Aug 6; 3(8):e2856