cell - fate changes that occur during development are almost always accompanied by changes in gene expression .
thus detailed knowledge of the spatial and temporal expression patterns for all genes will be an important step in deciphering the complex regulatory networks governing development .
two methods have been used successfully to determine gene - expression patterns on a large scale - rna in situ hybridization   and dna microarrays .
whole - mount rna in situ hybridization is a well - established approach for determining precise spatial gene - expression patterns , and can be done in high - throughput fashion .
although rna in situ hybridization is carried out on fixed tissues , examining a large number of differently staged specimens provides an overview of the dynamic changes in gene - expression patterns that occur during development .
expression patterns can be documented by microscopy coupled to digital photography and distributed on the web as a valuable resource to the research community .
approaches using dna microarrays have been successful in studying genome - wide transcriptional regulation during animal development , but suffer from several limitations . in multicellular organisms ,
cell division and differentiation leads to an increase in tissue complexity throughout development , but whole - animal microarray analysis can not document this spatial information . one can attempt to isolate mrna from every tissue at different developmental stages , measure gene expression , and assign expression indexes to every tissue at every time for every gene , in order to recreate the entire developmental expression pattern . this is a formidable task .
moreover , the quantitative comparison of expression levels for a given gene , or among different genes , in multiple experiments is complicated by differential hybridization kinetics and cross - hybridization properties of each target - probe pair . on the other hand , microarray profiles
do provide a quantitative overview of the relative changes in each gene 's expression level across time .
we used high - throughput rna in situ hybridization to assemble a database of gene - expression patterns during embryonic development of drosophila melanogaster .
cdna clones are available for 70% of all drosophila genes , providing a convenient source of templates for generating specific hybridization probes for the majority of genes .
drosophila embryogenesis has been studied extensively , providing a strong foundation of knowledge for our project .
moreover , studies of a large number of individual genes have documented the diversity of gene - expression patterns that occur during drosophila embryogenesis and established the importance of tissue - specific gene expression for development . here
we describe the molecular , microscopic , and computational methods we used to produce a database of drosophila embryonic expression patterns that integrates results obtained by in situ hybridization to whole - mount embryos and by expression microarrays .
expression patterns are documented by assembling digital photographs of individual staged embryos that are ordered to visualize time - dependent changes . to facilitate computational analysis ,
these patterns are annotated using a controlled vocabulary that captures developmental and spatial relationships between embryonic tissues .
we used hierarchical clustering of the annotation terms to group together genes with similar expression patterns as well as tissues with similar sets of expressed genes .
we report several noteworthy observations based on our initial data , which provide a glimpse of the diversity of gene expression and the utility that will derive from a complete atlas of gene - expression patterns during drosophila development .
all production , image and annotation data are stored in a relational database and presented in searchable form on the web .
the starting material for the production of hybridization probes was the set of cdna clones that comprise the drosophila gene collection .
the cdnas were amplified in 96-well pcr plates using a vector - specific primer set that introduces a promoter for the production of a digoxigenin - labeled antisense rna probe by in vitro transcription .
pcr products were sized to confirm the identity of each clone and that the pcr reaction was successful ( figure 1a ) . the strength of each probe was determined by a dot - blot color reaction ( figure 1b ) .
these data were entered into a relational database and later used as experimental controls when assessing the outcome of each hybridization experiment .
rna probes were hybridized to fixed drosophila embryos   in 96-well plates ( see materials and methods ) .
three genes ( engrailed , hunchback , brinker ) with well - described expression patterns were included in each 96-well plate and used to monitor hybridization efficiency .
after hybridization , each plate was examined to determine the morphology of the embryos , quality of the staining and proportion of wells that showed staining ( figure 1c ) . a plate containing embryos of acceptable morphology , relatively free of staining artifacts and with more than 50% of the wells stained
low - magnification digital images of a group of embryos were taken ( figure 1d ) to provide a permanent record of the hybridization in each well .
low - resolution imaging was insufficient to document highly restricted expression patterns or to identify small subsets of cells .
for that purpose , each slide was examined under higher magnification using a zeiss axiophot optical microscope . at this stage ,
a human annotator carefully examined the entire slide , taking a large number of high - resolution digital photographs that document that gene 's expression pattern ( figure 1e ) .
all images were submitted to the relational database using a web - based annotation tool .
we determined the success of each hybridization experiment by taking into account the results of the agarose gel analysis of pcr products , dot - blot analysis of probes , microarray data ( described below ) , available information from public databases , and the quality of the captured images .
each experiment had two possible outcomes : either the observed expression pattern or the absence thereof was consistent with the available data , or there was a discrepancy indicating failure at some point and that the experiment needs to be repeated .
about 13% of the in situ experiments failed , as a result of either the absence of a pcr product ( 9.2% ) or a poor probe - labeling reaction ( 3.4% ) , which resulted in no detectable staining .
additionally , probes that generated expression patterns inconsistent with previously published data ( 0.3% ) or the microarray expression profile ( 7% ) were rejected as being possibly mislabeled or cross - contaminated .
overall , we obtained useful expression data for 2,179 out of 2,721 ( 80% ) of the genes whose transcript distribution we analyzed .
we captured high - resolution photographs of the 1,388 genes ( 63.7% of the 2,179 successfully asssayed genes ) that exhibited some level of tissue - specific gene expression .
the captured images were ordered according to the developmental stage of the embryos in order to visualize the change of the expression pattern over time .
the duration of developmental stages range from 15 minutes to more than 2 hours ; therefore the stages of development were differentially represented in our embryo collections ( see materials and methods ) .
some consecutive stages , although morphologically distinguishable , differ very little in terms of changes in gene expression , whereas other stage transitions , such as the onset of zygotic transcription or organogenesis , are accompanied by massive changes in gene expression .
we divided the first 16 stages of embryogenesis into six convenient stage ranges ( stages 1 - 3 , 4 - 6 , 7 - 8 , 9 - 10 , 11 - 12 and 13 - 16 ) . each captured image is assigned to a stage range , and for each stage range a number of images are taken so that all stages within the range are represented .
the groups of images assigned to a stage range are arranged in the web - based annotation tool from left to right so that one can follow the pattern through development ( figure 2 ) .
we took , on average , 16 individual images for each gene ; however , the number of images per gene varies from 1 to 80 .
this variability reflects our strategy to document highly dynamic , complex , novel and otherwise notable patterns extensively , while progressively lowering the number of images documenting common or simple expression patterns .
the number and type of images collected for each probe were chosen so as to allow an embryologist to reconstruct the expression pattern as if they were examining the stained embryos under a microscope .
although the in situ hybridization analysis is performed on fixed tissues , the ability to take many snapshots of developmental processes and to order them allows us to reconstruct dynamic developmental events .
for example , we can visualize the progressive segmental proliferation of the fat body ( figure 3a , b , c , d , e ) or follow the dispersal of blood - cell precursors throughout the embryo ( figure 3f , g , h , i , j ) .
many genes are either not expressed at all during embryogenesis or their expression is not tissue specific .
several canonical examples of these staining patterns were captured , and then only textual annotation and a low - magnification image were used to document additional occurrences .
a total of 791 genes ( 36.3% of the 2,179 genes successfully assayed ) were not documented by high - resolution images .
these were assigned to one of the following four classes : 362 ( 16.6% ) do not appear to be expressed during embryogenesis ; 21 ( 1% ) are not maternally contributed but are ubiquitously expressed in the developing embryo ; 317 ( 14.5% ) are exclusively maternally expressed ; and 91 ( 4.2% ) show both maternal and ubiquitous zygotic expression .
we used microarray time - course expression profiles as independent measurements to ascertain the accuracy of the captured expression patterns . for the microarray measurements to be truly independent , it was important that no single clone contamination or misidentification event be able to affect the integrity of both the microarray and in situ hybridization result .
existing microarray datasets , such as that reported in , were generated using spotted cdna arrays   derived from the same dgc clone set   that we used for the in situ probes , and were therefore unsuitable as independent controls .
for this reason , we chose to generate a new dataset using affymetrix genechip technology , where the oligonucleotide probes are designed directly from the genome sequence and do not depend on the cdna clone identity .
for the microarray analysis , we divided embryogenesis into 12 1-hour time windows , collected three independent embryo samples for each time window , and hybridized total rna from each sample to the genechip drosophila genome array .
as each embryo sample contained a distribution of different ages , we examined the distribution of morphological stage - specific markers in each sample to correlate the time - course windows with the nonlinear scale of embryonic stages .
as described above , the image data are organized into groups of images associated with a range of embryonic stages .
both the image and the microrray datasets are thus linked by a common time scale of developmental stages .
this facilitates the direct comparison of the in situ staining patterns with microarray expression indexes .
figure 4 shows the comparison of array and image data for a highly unusual gene - expression pattern . in the absence of any additional information on the cdna clone ld43816 ( cg4702 ) , the contrast between the heavy staining seen in late embryos and the earlier highly restricted pattern might suggest the possibility of probe contamination .
however , when stage - specific images are compared with the microarray profile , the expression profile is consistent with the in situ hybridization data .
although high - throughput in situ hybridization is subject to potential sources of error , such as cross - contamination during pcr amplification or probe synthesis , using microarray expression data in parallel helped us avoid erroneous pattern assignment . for a number of reasons , correlating staining patterns and microarray values
first , the intensity of in situ hybridization staining is dependent on the strength of the probe and length of the color reaction .
second , it is not possible to distinguish weak ubiquitous staining from strong staining in a small subset of cells using whole - embryo microarray data . for microarray data , it is broadly accepted that relative comparison of independent measurements for the same gene are reliable , whereas absolute intensities across different genes are not , especially for low expression values .
for all these reasons , the most useful factor in correlating microarray and image data is the relative fluctuation of signal intensity over the course of development .
figure 5 shows 14 examples of distinct expression profiles that exhibit strong correlations between microarray and image data .
the expression patterns of all these genes ( except cg8782 ) have been previously described , providing independent confirmation that each profile is correct .
clear - cut correlations between microarray and in situ hybridization data as seen in figure 5 are possible when the expression pattern exhibits changes over time . for monotonically expressed genes ,
the correlation is rather subjective and relies on absolute intensities of both microrarray and in situ hybridization signals . in 7% of the experiments
, we rejected the observed expression pattern because of an obvious mismatch with the microarray expression profile ; such cases account for approximately one third of the genes whose analysis will need to be repeated .
large - scale production of rna in situ data is prone occasionally to produce false - negative results due to failures in probe production and hybridization .
microarray data are useful to identify experiments where the rna in situ hybridization failed but the given gene is highly expressed .
high absolute microarray - derived gene - expression values , coupled with either a continuous profile across the time course or distinct on / off periods during the time course , is a reliable indication that a gene is expressed .
low expression values , and a lack of consistency among replicate experiments , may indicate that a gene is not transcribed during embryogenesis .
however , if a given gene is active in only a very small subset of cells , the microarray results from a whole - animal experiment may not be sensitive enough to detect its expression .
therefore , even with the microarray data at hand , it is not possible to avoid completely false negatives for low - abundance transcripts . to provide searching capability beyond queries for a specific gene , we rigorously annotated the gene - expression profiles using a controlled vocabulary .
we used human annotation , rather than automated approaches based on pattern - recognition algorithms , because of the overwhelming complexity of annotation .
variation in morphology and incomplete knowledge of the shape and position of various embryonic structures make computational approaches impracticable at present .
moreover , a human annotator does not only take into account the image data , but also integrates other information such as the microarray profile and previously published data into the final assessment of the expression pattern .
in our project , a single person carried out the initial annotation , resulting in a highly consistent dataset .
annotation of gene - expression patterns that change dynamically over time poses a significant challenge .
there is a need to have a specific name not only for the final developed embryonic structures but also for all the developmental intermediates that precede them .
every terminally differentiated structure of the embryo descends from a group of cells within the cellular blastoderm epithelium .
we used this embryological concept to define a set of embryonic structure names that depict a ' path ' describing the development of each organ .
four basic categories of developmental structures , called anlage in statu nascendi , anlage , primordium and organ , are distinguished . at the end of embryogenesis
, organs can be distinguished by their unique morphology and function ( for examples , see figure 6a ) .
traditionally , two types of developmental intermediates that precede the terminally differentiated organ have been defined : anlage and primordium ( for examples , see figure 6a ) .
an anlage is defined as a morphologically indistinct group of contiguous cells , established by lineage tracing , that gives rise to an individual organ .
anlagen for most organs can be distinguished at the late cellular blastoderm or gastrula stage ( stages 5 - 9 ) .
primordia develop from anlagen but an anlage - for example , a group of cells defined by gene expression that will give rise to a subset of an organ - can also be part of a primordium .
individual names are connected by relationships that define the way the respective tissues develop from one another or encompass one another .
many genes whose expression is ultimately restricted to , and required for the determination of , a specific anlage initially appear in a larger area .
this dynamic expression may reflect the working of an underlying molecular network of activating and inhibitory factors which only gradually succeed in directing expression of a given gene to a specific subset of cells which thereby become defined as a distinct anlage .
we propose the term ' anlage in statu nascendi ' ( in statu nascendi can be loosely translated as ' in the process of being formed ' ) for the larger domain from which a specific anlage originates .
they typically appear at the cellular blastoderm stage and resolve into specific anlagen towards the beginning of gastrulation ( examples are given in figure 6a ) . using this naming scheme we are able to describe the development of embryonic structures starting from anlage in statu nascendi at the cellular blastoderm stage through a series of developmental intermediates - anlage and primordia - to a differentiated embryonic structure .
for example , the transcription factor single minded is expressed in the glial cells of the mature embryo .
the origin of this expression pattern can be traced from the mesectoderm anlage in statu nascendi , to the mesectoderm anlage , to the mesectoderm ( or midline primordium ) and , finally , to the mature midline glial cells ( figure 6b ) . in the annotation tool ( figure 2 ) , only those annotation terms that describe structures present within a specific stage range are displayed beneath the images of embryos from that stage .
annotation terms are organized into a hierarchy according to the developmental relationship between them . using the annotation tool
, one can follow and describe the development of each structure through its intermediates by observing the development of the staining pattern and selecting the appropriate annotation terms .
integration of image data with the predefined developmental hierarchy is one of the prime goals of our annotation effort .
one advantage of storing the data in a database is the ability to query the data and compare results in a rigorous manner .
however , this is only possible if the data that are entered into the database are themselves rigorously controlled .
comparisons of biological data are complicated by the lack of standards in both reagents and nomenclature .
we provide a standardized set of in situ expression images prepared using the same hybridization probes , laboratory protocols , and descriptive nomenclature . for the nomenclature we needed an agreed vocabulary of terms to describe the different anatomical features of the drosophila embryo and the different stages of embryonic development .
this was provided to us by the controlled vocabularies of anatomy and development that have been constructed by flybase   over the past few years .
a further advantage in using these vocabularies is that our data will be recorded in a way that is wholly consistent with that used by the flybase curators , who record gene - expression data from the scientific literature .
the flybase controlled vocabularies are organized as a directed acyclic graph ( dag ) . in a dag
the terms are the nodes in the graph and the relationships between terms are the arcs of the graph .
first , the graph is directed , which means that the reciprocal roles of two terms in a relationship are unequal .
thus , the ' parent ' term may be a less specific and the ' child ' term more detailed .
second , unlike strict hierarchies , a child term may have more than one parent terms .
this data structure is the same as that used by the gene ontology ( go ) consortium for terms that are used to annotate gene products .
the first of this is ' is an instance of ' ; for example , the ' anterior spiracle ' is an instance of its parent term ' spiracle ' .
the second is ' part of ; for example , the ' gastric caecum ' is part of the ' foregut ' .
the third is ' develops from ' ; for example , a ' glial cell ' develops from a ' glioblast ' .
the major change that had to be made to the flybase controlled vocabulary to support this project was to name the developmental intermediates that arise during embryogenesis , that is anlagen , primordia , and anlagen in statu nascendi .
our annotation uses a subset of 300 or so of the 5,800 terms in the flybase controlled vocabulary , many of which only apply to later stages of development . we modified the go database schema   for the storage and searching of our gene - expression data . for the management of the terms and their relationships ,
however , the database was extended to support the annotation process itself ; that is , assigning terms to describe the expression patterns .
additional tables were also added to describe when and where a given mrna is expressed , and the images that constitute the evidence for these observations .
we implemented two publicly available tools to search and mine the gene - expression dataset .
it can be utilized to search for the expression pattern of an individual gene of interest , retrieve a list of genes expressed in a given embryonic structure , or set of structures , or all genes expressed at a certain stage of embryonic development .
sets of genes and their corresponding expression profiles can be grouped on the basis of cytological position in the genome , functional go assignments , or the presence of protein domains in the gene sequence .
the results returned by all types of searches can be formatted to display controlled vocabulary annotations exclusively or also show images and microarray profiles of sets of genes side by side ( figure 7 ) .
alternatively , one can explore the dataset by browsing through the controlled vocabulary using a modified version of the amigo gene ontology browser , which we call imago .
once a term from the vocabulary is selected , imago will return a page that lists all genes expressed in a given structure and also all genes expressed in all structures that descend from it .
the embryonic expression patterns of 80% of the 1,388 genes that display restricted expression , and were therefore annotated in our database , are described by a unique set of annotation terms .
this observation illustrates the tremendous diversity of gene - expression patterns during embryogenesis , which range from expression in a single embryonic structure to expression in 36 distinct tissues .
although expression patterns of genes are rarely identical , there is a noticeable similarity among patterns of expression of many genes .
therefore we sought to order these genes on the basis of the similarity of their expression patterns .
furthermore , gene - expression data can be used to quantify the relatedness of the various embryonic structures in terms of similarity in gene expression between them .
we carried out hierarchical clustering of genes and tissues using a method based on binary similarity metrics (; for details see materials and methods ) .
figure 8 shows the result of clustering the 99 differentiated embryonic structures that expressed at least two of the 1,388 genes .
a black dash at the intersection of a row and a column of the matrix occurs whenever the gene corresponding to that row is expressed in the embryonic structure corresponding to that column .
the clustering organizes the embryonic structures in such a way that related structures are close together whereas unrelated ones are widely separated .
for example , components of the nervous system ( figure 8 , green shading ) that are ectoderm derivatives , cluster together and away from mesodermal derivatives , such as muscles ( figure 8 , cyan shading ) . in other words ,
very few of the genes in our dataset are expressed in both muscles and the nervous system , reflecting the physiological separation and different developmental origins of these two tissues . by analogy ,
the genes are organized by the hierarchical clustering so that those with the most similar expression patterns are close together and those with highly divergent patterns are widely separated .
the distribution of clusters in the matrix can be used to identify genes that are expressed in a tissue or set of tissues .
for example , the red rectangle in figure 8 highlights a cluster of genes that are expressed exclusively in the embryonic fat body .
genes expressed in the tracheal system are split into at least two clusters ; genes expressed exclusively in the trachea form a cluster in the middle of the matrix ( figure 8 , blue rectangle ) , and a second cluster includes genes expressed in the trachea and variety of epidermal structures ( figure 8 , magenta rectangle ) .
interestingly , no genes are expressed in both trachea and the cns ( note the gap in cns clusters at the level of the tracheal cluster ) .
the annotation vocabulary subdivides the nervous system into specific subsets based on tissue types ( neurons , glia ) and anatomical position ( brain , ventral nerve cord , lateral cord , sensory nervous system ) .
a cluster of genes that are expressed specifically in the components of the peripheral nervous system and absent from cns can be identified ( figure 8 , yellow rectangle ) .
an increase in the depth of annotation will be required to subdivide the large clusters that correspond to complex organ systems .
filtering of the genes and anatomical structures , the type of clustering algorithm and the distance metric are variables that need to be optimized to address specific questions about the variations in patterns of gene expression .
we used a relatively simple metric to define similarity among the annotation data . in the future it will be interesting to explore more complex similarity metrics that incorporate the distance between annotation terms within the ontology .
clustering of the annotation data and other data - mining approaches will establish sets of co - regulated genes that will provide a starting point for investigating cis - regulatory sequences that may elucidate novel regulatory relationships in development .
systematic rna in situ hybridization is an alternative to mutagenesis screens   to uncover genes involved in embryonic patterning .
figure 9a , b , c , d illustrates one case where conventional mutagenesis failed to identify genes with highly specific expression patterns at the cellular blastoderm stage , most probably because of genetic redundancy . at map position 66e4 ,
three adjacent and highly homologous genes for brachyury / t - box - containing transcription factors are expressed with strikingly similar expression patterns .
thus disruption of any one of these genes might not be sufficient to produce an embryonic phenotype .
conversely , in many cases the expression patterns of duplicated genes have diverged and are largely non - overlapping .
expression data can provide a guide as to which multiple gene knockouts are likely to yield specific phenotypes .
a systematic screening approach also reduces bias in the selection of the types of genes chosen for study .
figure 9e,9f,9g,9h,9i shows five examples of metabolic genes that , contrary to naive expectation , are expressed at cellular blastoderm in domains suggestive of roles in embryonic patterning .
a similar observation was recently reported for the expression of genes isolated specifically from blastoderm - specific cdna libraries .
tight regulation of expression of these genes could be explained by a preferential requirement for certain metabolic pathways in specialized embryonic tissues .
that argument may not be plausible for genes expressed within limited regions of the cellular blastoderm embryo .
it is possible that these gene products are not translated , are otherwise inactive in the tissues where the transcripts appear abundant , or that their restricted expression is simply the result of their proximity to a transcriptional control element of a neighboring gene .
a more interesting possibility is that this expression may reflect yet unknown functions of these genes .
a major advantage of rna in situ hybridization is that this method has sufficient spatial resolution to uncover subcellular localization of mrnas .
figure 9j , l shows an apically localized mrna in the columnar epithelium of the developing hindgut surrounding the migrating pole cells ( figure 9l ) .
this staining is strikingly complementary to that of a basally localized mrna from a different gene that is expressed in the same cells ( figure 9k , m ) .
the transcript of yet another gene , whose expression is shown at high magnification at the pre - cellular blastoderm stage , appears to be localized to a sub - compartment of the nucleus ( figure 9n , o ) .
we also found novel mrnas localized asymmetrically along the anterior - posterior axis of the early pre - blastoderm embryo ( data not shown ) .
overall , we find that about 1% of genes exhibit easily discernible subcellular localization , and thus our dataset can also be useful in identifying aspects of rna localization and trafficking .
the starting material for the production of hybridization probes was the set of cdna clones that comprise the drosophila gene collection .
the cdnas were amplified in 96-well pcr plates using a vector - specific primer set that introduces a promoter for the production of a digoxigenin - labeled antisense rna probe by in vitro transcription .
pcr products were sized to confirm the identity of each clone and that the pcr reaction was successful ( figure 1a ) . the strength of each probe was determined by a dot - blot color reaction ( figure 1b ) .
these data were entered into a relational database and later used as experimental controls when assessing the outcome of each hybridization experiment .
rna probes were hybridized to fixed drosophila embryos   in 96-well plates ( see materials and methods ) .
three genes ( engrailed , hunchback , brinker ) with well - described expression patterns were included in each 96-well plate and used to monitor hybridization efficiency .
after hybridization , each plate was examined to determine the morphology of the embryos , quality of the staining and proportion of wells that showed staining ( figure 1c ) . a plate containing embryos of acceptable morphology , relatively free of staining artifacts and with more than 50% of the wells stained
low - magnification digital images of a group of embryos were taken ( figure 1d ) to provide a permanent record of the hybridization in each well .
low - resolution imaging was insufficient to document highly restricted expression patterns or to identify small subsets of cells .
for that purpose , each slide was examined under higher magnification using a zeiss axiophot optical microscope . at this stage ,
a human annotator carefully examined the entire slide , taking a large number of high - resolution digital photographs that document that gene 's expression pattern ( figure 1e ) .
all images were submitted to the relational database using a web - based annotation tool .
we determined the success of each hybridization experiment by taking into account the results of the agarose gel analysis of pcr products , dot - blot analysis of probes , microarray data ( described below ) , available information from public databases , and the quality of the captured images .
each experiment had two possible outcomes : either the observed expression pattern or the absence thereof was consistent with the available data , or there was a discrepancy indicating failure at some point and that the experiment needs to be repeated .
about 13% of the in situ experiments failed , as a result of either the absence of a pcr product ( 9.2% ) or a poor probe - labeling reaction ( 3.4% ) , which resulted in no detectable staining .
additionally , probes that generated expression patterns inconsistent with previously published data ( 0.3% ) or the microarray expression profile ( 7% ) were rejected as being possibly mislabeled or cross - contaminated .
overall , we obtained useful expression data for 2,179 out of 2,721 ( 80% ) of the genes whose transcript distribution we analyzed .
we captured high - resolution photographs of the 1,388 genes ( 63.7% of the 2,179 successfully asssayed genes ) that exhibited some level of tissue - specific gene expression .
the captured images were ordered according to the developmental stage of the embryos in order to visualize the change of the expression pattern over time .
the duration of developmental stages range from 15 minutes to more than 2 hours ; therefore the stages of development were differentially represented in our embryo collections ( see materials and methods ) .
some consecutive stages , although morphologically distinguishable , differ very little in terms of changes in gene expression , whereas other stage transitions , such as the onset of zygotic transcription or organogenesis , are accompanied by massive changes in gene expression .
we divided the first 16 stages of embryogenesis into six convenient stage ranges ( stages 1 - 3 , 4 - 6 , 7 - 8 , 9 - 10 , 11 - 12 and 13 - 16 ) . each captured image is assigned to a stage range , and for each stage range a number of images are taken so that all stages within the range are represented .
the groups of images assigned to a stage range are arranged in the web - based annotation tool from left to right so that one can follow the pattern through development ( figure 2 ) .
we took , on average , 16 individual images for each gene ; however , the number of images per gene varies from 1 to 80 .
this variability reflects our strategy to document highly dynamic , complex , novel and otherwise notable patterns extensively , while progressively lowering the number of images documenting common or simple expression patterns .
the number and type of images collected for each probe were chosen so as to allow an embryologist to reconstruct the expression pattern as if they were examining the stained embryos under a microscope .
although the in situ hybridization analysis is performed on fixed tissues , the ability to take many snapshots of developmental processes and to order them allows us to reconstruct dynamic developmental events .
for example , we can visualize the progressive segmental proliferation of the fat body ( figure 3a , b , c , d , e ) or follow the dispersal of blood - cell precursors throughout the embryo ( figure 3f , g , h , i , j ) .
many genes are either not expressed at all during embryogenesis or their expression is not tissue specific .
several canonical examples of these staining patterns were captured , and then only textual annotation and a low - magnification image were used to document additional occurrences .
a total of 791 genes ( 36.3% of the 2,179 genes successfully assayed ) were not documented by high - resolution images .
these were assigned to one of the following four classes : 362 ( 16.6% ) do not appear to be expressed during embryogenesis ; 21 ( 1% ) are not maternally contributed but are ubiquitously expressed in the developing embryo ; 317 ( 14.5% ) are exclusively maternally expressed ; and 91 ( 4.2% ) show both maternal and ubiquitous zygotic expression .
we used microarray time - course expression profiles as independent measurements to ascertain the accuracy of the captured expression patterns . for the microarray measurements to be truly independent , it was important that no single clone contamination or misidentification event be able to affect the integrity of both the microarray and in situ hybridization result .
existing microarray datasets , such as that reported in , were generated using spotted cdna arrays   derived from the same dgc clone set   that we used for the in situ probes , and were therefore unsuitable as independent controls .
for this reason , we chose to generate a new dataset using affymetrix genechip technology , where the oligonucleotide probes are designed directly from the genome sequence and do not depend on the cdna clone identity .
for the microarray analysis , we divided embryogenesis into 12 1-hour time windows , collected three independent embryo samples for each time window , and hybridized total rna from each sample to the genechip drosophila genome array .
as each embryo sample contained a distribution of different ages , we examined the distribution of morphological stage - specific markers in each sample to correlate the time - course windows with the nonlinear scale of embryonic stages .
as described above , the image data are organized into groups of images associated with a range of embryonic stages .
both the image and the microrray datasets are thus linked by a common time scale of developmental stages .
this facilitates the direct comparison of the in situ staining patterns with microarray expression indexes .
figure 4 shows the comparison of array and image data for a highly unusual gene - expression pattern . in the absence of any additional information on the cdna clone ld43816 ( cg4702 ) ,
the contrast between the heavy staining seen in late embryos and the earlier highly restricted pattern might suggest the possibility of probe contamination .
however , when stage - specific images are compared with the microarray profile , the expression profile is consistent with the in situ hybridization data .
although high - throughput in situ hybridization is subject to potential sources of error , such as cross - contamination during pcr amplification or probe synthesis , using microarray expression data in parallel helped us avoid erroneous pattern assignment . for a number of reasons , correlating staining patterns and microarray values
first , the intensity of in situ hybridization staining is dependent on the strength of the probe and length of the color reaction .
second , it is not possible to distinguish weak ubiquitous staining from strong staining in a small subset of cells using whole - embryo microarray data . for microarray data
, it is broadly accepted that relative comparison of independent measurements for the same gene are reliable , whereas absolute intensities across different genes are not , especially for low expression values .
for all these reasons , the most useful factor in correlating microarray and image data is the relative fluctuation of signal intensity over the course of development .
figure 5 shows 14 examples of distinct expression profiles that exhibit strong correlations between microarray and image data .
the expression patterns of all these genes ( except cg8782 ) have been previously described , providing independent confirmation that each profile is correct .
clear - cut correlations between microarray and in situ hybridization data as seen in figure 5 are possible when the expression pattern exhibits changes over time . for monotonically expressed genes ,
the correlation is rather subjective and relies on absolute intensities of both microrarray and in situ hybridization signals . in 7% of the experiments
, we rejected the observed expression pattern because of an obvious mismatch with the microarray expression profile ; such cases account for approximately one third of the genes whose analysis will need to be repeated .
large - scale production of rna in situ data is prone occasionally to produce false - negative results due to failures in probe production and hybridization .
microarray data are useful to identify experiments where the rna in situ hybridization failed but the given gene is highly expressed .
high absolute microarray - derived gene - expression values , coupled with either a continuous profile across the time course or distinct on / off periods during the time course , is a reliable indication that a gene is expressed .
low expression values , and a lack of consistency among replicate experiments , may indicate that a gene is not transcribed during embryogenesis
. however , if a given gene is active in only a very small subset of cells , the microarray results from a whole - animal experiment may not be sensitive enough to detect its expression .
therefore , even with the microarray data at hand , it is not possible to avoid completely false negatives for low - abundance transcripts .
to provide searching capability beyond queries for a specific gene , we rigorously annotated the gene - expression profiles using a controlled vocabulary .
we used human annotation , rather than automated approaches based on pattern - recognition algorithms , because of the overwhelming complexity of annotation .
variation in morphology and incomplete knowledge of the shape and position of various embryonic structures make computational approaches impracticable at present .
moreover , a human annotator does not only take into account the image data , but also integrates other information such as the microarray profile and previously published data into the final assessment of the expression pattern . in our project , a single person carried out the initial annotation , resulting in a highly consistent dataset .
annotation of gene - expression patterns that change dynamically over time poses a significant challenge .
there is a need to have a specific name not only for the final developed embryonic structures but also for all the developmental intermediates that precede them .
every terminally differentiated structure of the embryo descends from a group of cells within the cellular blastoderm epithelium .
we used this embryological concept to define a set of embryonic structure names that depict a ' path ' describing the development of each organ .
four basic categories of developmental structures , called anlage in statu nascendi , anlage , primordium and organ , are distinguished . at the end of embryogenesis
, organs can be distinguished by their unique morphology and function ( for examples , see figure 6a ) .
traditionally , two types of developmental intermediates that precede the terminally differentiated organ have been defined : anlage and primordium ( for examples , see figure 6a ) .
an anlage is defined as a morphologically indistinct group of contiguous cells , established by lineage tracing , that gives rise to an individual organ .
anlagen for most organs can be distinguished at the late cellular blastoderm or gastrula stage ( stages 5 - 9 ) .
primordia develop from anlagen but an anlage - for example , a group of cells defined by gene expression that will give rise to a subset of an organ - can also be part of a primordium .
individual names are connected by relationships that define the way the respective tissues develop from one another or encompass one another .
many genes whose expression is ultimately restricted to , and required for the determination of , a specific anlage initially appear in a larger area
. this dynamic expression may reflect the working of an underlying molecular network of activating and inhibitory factors which only gradually succeed in directing expression of a given gene to a specific subset of cells which thereby become defined as a distinct anlage .
we propose the term ' anlage in statu nascendi ' ( in statu nascendi can be loosely translated as ' in the process of being formed ' ) for the larger domain from which a specific anlage originates .
they typically appear at the cellular blastoderm stage and resolve into specific anlagen towards the beginning of gastrulation ( examples are given in figure 6a ) . using this naming scheme we are able to describe the development of embryonic structures starting from anlage in statu nascendi at the cellular blastoderm stage through a series of developmental intermediates - anlage and primordia - to a differentiated embryonic structure .
for example , the transcription factor single minded is expressed in the glial cells of the mature embryo .
the origin of this expression pattern can be traced from the mesectoderm anlage in statu nascendi , to the mesectoderm anlage , to the mesectoderm ( or midline primordium ) and , finally , to the mature midline glial cells ( figure 6b ) . in the annotation tool ( figure 2 ) , only those annotation terms that describe structures present within a specific stage range are displayed beneath the images of embryos from that stage .
annotation terms are organized into a hierarchy according to the developmental relationship between them . using the annotation tool
, one can follow and describe the development of each structure through its intermediates by observing the development of the staining pattern and selecting the appropriate annotation terms .
integration of image data with the predefined developmental hierarchy is one of the prime goals of our annotation effort .
one advantage of storing the data in a database is the ability to query the data and compare results in a rigorous manner .
however , this is only possible if the data that are entered into the database are themselves rigorously controlled .
comparisons of biological data are complicated by the lack of standards in both reagents and nomenclature .
we provide a standardized set of in situ expression images prepared using the same hybridization probes , laboratory protocols , and descriptive nomenclature . for the nomenclature we needed an agreed vocabulary of terms to describe the different anatomical features of the drosophila embryo and the different stages of embryonic development .
this was provided to us by the controlled vocabularies of anatomy and development that have been constructed by flybase   over the past few years .
a further advantage in using these vocabularies is that our data will be recorded in a way that is wholly consistent with that used by the flybase curators , who record gene - expression data from the scientific literature .
the flybase controlled vocabularies are organized as a directed acyclic graph ( dag ) . in a dag
the terms are the nodes in the graph and the relationships between terms are the arcs of the graph .
first , the graph is directed , which means that the reciprocal roles of two terms in a relationship are unequal .
thus , the ' parent ' term may be a less specific and the ' child ' term more detailed .
second , unlike strict hierarchies , a child term may have more than one parent terms .
this data structure is the same as that used by the gene ontology ( go ) consortium for terms that are used to annotate gene products .
the first of this is ' is an instance of ' ; for example , the ' anterior spiracle ' is an instance of its parent term ' spiracle ' .
the second is ' part of ; for example , the ' gastric caecum ' is part of the ' foregut ' .
the third is ' develops from ' ; for example , a ' glial cell ' develops from a ' glioblast ' .
the major change that had to be made to the flybase controlled vocabulary to support this project was to name the developmental intermediates that arise during embryogenesis , that is anlagen , primordia , and anlagen in statu nascendi .
our annotation uses a subset of 300 or so of the 5,800 terms in the flybase controlled vocabulary , many of which only apply to later stages of development .
we modified the go database schema   for the storage and searching of our gene - expression data .
for the management of the terms and their relationships , the core of the go database schema remains essentially unchanged .
however , the database was extended to support the annotation process itself ; that is , assigning terms to describe the expression patterns .
additional tables were also added to describe when and where a given mrna is expressed , and the images that constitute the evidence for these observations .
we implemented two publicly available tools to search and mine the gene - expression dataset .
it can be utilized to search for the expression pattern of an individual gene of interest , retrieve a list of genes expressed in a given embryonic structure , or set of structures , or all genes expressed at a certain stage of embryonic development .
sets of genes and their corresponding expression profiles can be grouped on the basis of cytological position in the genome , functional go assignments , or the presence of protein domains in the gene sequence .
the results returned by all types of searches can be formatted to display controlled vocabulary annotations exclusively or also show images and microarray profiles of sets of genes side by side ( figure 7 ) .
alternatively , one can explore the dataset by browsing through the controlled vocabulary using a modified version of the amigo gene ontology browser , which we call imago .
once a term from the vocabulary is selected , imago will return a page that lists all genes expressed in a given structure and also all genes expressed in all structures that descend from it .
the embryonic expression patterns of 80% of the 1,388 genes that display restricted expression , and were therefore annotated in our database , are described by a unique set of annotation terms .
this observation illustrates the tremendous diversity of gene - expression patterns during embryogenesis , which range from expression in a single embryonic structure to expression in 36 distinct tissues .
although expression patterns of genes are rarely identical , there is a noticeable similarity among patterns of expression of many genes .
therefore we sought to order these genes on the basis of the similarity of their expression patterns .
furthermore , gene - expression data can be used to quantify the relatedness of the various embryonic structures in terms of similarity in gene expression between them .
we carried out hierarchical clustering of genes and tissues using a method based on binary similarity metrics (; for details see materials and methods ) .
figure 8 shows the result of clustering the 99 differentiated embryonic structures that expressed at least two of the 1,388 genes .
a black dash at the intersection of a row and a column of the matrix occurs whenever the gene corresponding to that row is expressed in the embryonic structure corresponding to that column .
the clustering organizes the embryonic structures in such a way that related structures are close together whereas unrelated ones are widely separated .
for example , components of the nervous system ( figure 8 , green shading ) that are ectoderm derivatives , cluster together and away from mesodermal derivatives , such as muscles ( figure 8 , cyan shading ) . in other words ,
very few of the genes in our dataset are expressed in both muscles and the nervous system , reflecting the physiological separation and different developmental origins of these two tissues . by analogy ,
the genes are organized by the hierarchical clustering so that those with the most similar expression patterns are close together and those with highly divergent patterns are widely separated .
the distribution of clusters in the matrix can be used to identify genes that are expressed in a tissue or set of tissues .
for example , the red rectangle in figure 8 highlights a cluster of genes that are expressed exclusively in the embryonic fat body .
genes expressed in the tracheal system are split into at least two clusters ; genes expressed exclusively in the trachea form a cluster in the middle of the matrix ( figure 8 , blue rectangle ) , and a second cluster includes genes expressed in the trachea and variety of epidermal structures ( figure 8 , magenta rectangle ) .
interestingly , no genes are expressed in both trachea and the cns ( note the gap in cns clusters at the level of the tracheal cluster ) .
the annotation vocabulary subdivides the nervous system into specific subsets based on tissue types ( neurons , glia ) and anatomical position ( brain , ventral nerve cord , lateral cord , sensory nervous system ) .
a cluster of genes that are expressed specifically in the components of the peripheral nervous system and absent from cns can be identified ( figure 8 , yellow rectangle ) .
an increase in the depth of annotation will be required to subdivide the large clusters that correspond to complex organ systems .
filtering of the genes and anatomical structures , the type of clustering algorithm and the distance metric are variables that need to be optimized to address specific questions about the variations in patterns of gene expression .
we used a relatively simple metric to define similarity among the annotation data . in the future
it will be interesting to explore more complex similarity metrics that incorporate the distance between annotation terms within the ontology .
clustering of the annotation data and other data - mining approaches will establish sets of co - regulated genes that will provide a starting point for investigating cis - regulatory sequences that may elucidate novel regulatory relationships in development .
systematic rna in situ hybridization is an alternative to mutagenesis screens   to uncover genes involved in embryonic patterning .
figure 9a , b , c , d illustrates one case where conventional mutagenesis failed to identify genes with highly specific expression patterns at the cellular blastoderm stage , most probably because of genetic redundancy . at map position 66e4 ,
three adjacent and highly homologous genes for brachyury / t - box - containing transcription factors are expressed with strikingly similar expression patterns .
thus disruption of any one of these genes might not be sufficient to produce an embryonic phenotype .
conversely , in many cases the expression patterns of duplicated genes have diverged and are largely non - overlapping .
expression data can provide a guide as to which multiple gene knockouts are likely to yield specific phenotypes .
a systematic screening approach also reduces bias in the selection of the types of genes chosen for study .
figure 9e,9f,9g,9h,9i shows five examples of metabolic genes that , contrary to naive expectation , are expressed at cellular blastoderm in domains suggestive of roles in embryonic patterning .
a similar observation was recently reported for the expression of genes isolated specifically from blastoderm - specific cdna libraries .
tight regulation of expression of these genes could be explained by a preferential requirement for certain metabolic pathways in specialized embryonic tissues .
that argument may not be plausible for genes expressed within limited regions of the cellular blastoderm embryo .
it is possible that these gene products are not translated , are otherwise inactive in the tissues where the transcripts appear abundant , or that their restricted expression is simply the result of their proximity to a transcriptional control element of a neighboring gene .
a more interesting possibility is that this expression may reflect yet unknown functions of these genes .
a major advantage of rna in situ hybridization is that this method has sufficient spatial resolution to uncover subcellular localization of mrnas .
figure 9j , l shows an apically localized mrna in the columnar epithelium of the developing hindgut surrounding the migrating pole cells ( figure 9l ) .
this staining is strikingly complementary to that of a basally localized mrna from a different gene that is expressed in the same cells ( figure 9k , m ) .
the transcript of yet another gene , whose expression is shown at high magnification at the pre - cellular blastoderm stage , appears to be localized to a sub - compartment of the nucleus ( figure 9n , o ) .
we also found novel mrnas localized asymmetrically along the anterior - posterior axis of the early pre - blastoderm embryo ( data not shown ) .
overall , we find that about 1% of genes exhibit easily discernible subcellular localization , and thus our dataset can also be useful in identifying aspects of rna localization and trafficking .
the dataset we present here comprises embryonic expression patterns for about one - sixth of all drosophila genes , documented with extensive digital images , controlled vocabulary annotations and microarray profiles .
our ultimate goal is to determine the expression patterns of all genes in the genome .
considering our current production rate , we should be able to finish the first pass through the existing cdna collections that represent about 70% of all drosophila genes in about a year .
we will then repeat our analysis of the 20% or so of genes for which we did not obtain reliable data .
probes for genes that lack a suitable cdna clone , but that show significant expression by microarray analysis , will be generated by genomic pcr so that eventually all drosophila genes will be examined .
we also intend to extend our analysis to two other developmentally active drosophila tissues - imaginal discs and ovaries .
all our data are freely available to the scientific community through interactive web pages ; these pages will continue to develop and will allow for more sophisticated mining of the growing dataset .
similar large - scale gene - expression studies have been carried out in other model organisms including xenopus , mouse , medaka   and caenorhabditis elegans .
our database is , to our knowledge , the first to use non - redundant expressed sequence tag ( est ) collections with the aim of determining and systematically annotating the expression patterns of all genes in an organism .
we intend to link our database to the available public databases containing similar image data in order to allow cross - species comparisons of expression of homologous genes .
the ultimate goal is to create an integrated resource of image oriented gene - expression data analogous to the public repositories of dna sequences .
canton s embryos were collected in 3-h intervals and aged to generate animals 0 - 3 , 3 - 6 , 6 - 9 , 9 - 12 , 12 - 15 and 15 - 18 h old .
the six 3-h embryo collections were mixed in equal proportions to yield a balanced population of embryos representing the first 18 h of embryogenesis .
dna templates were generated by pcr using primers homologous to the vector and purified by g50 column chromatography in 96-well format .
the purified pcr product ( 5 l ) was transcribed in 96-well format by incubation for 2 h at 37c after the addition of 5 l of a polymerase reaction cocktail consisting of 2 u t7 rna polymerase , 4.6 u rnase inhibitor , 10 mm ntps , 3.5 mm digoxigenin-11-utp , 40 mm tris ph 8.0 , 6 mm mgcl2 , 10 mm dtt and 2 mm spermidine .
after treatment with dnase i and na2co3 ph 10.2 , ethanol precipitation was carried out .
pellets were resuspended in 50 l of 50% formamide , 5 mm tris - hcl ph 7.5 , 0.5 mm edta and 0.01% tween 20 .
the digoxigenin - labeled rna probe was quantified by immunological detection using a modified digoxigenin quantification protocol ( roche ) .
a sample of 0.8 l of a 1:300 dilution of the probe was spotted on a positively charged nylon membrane ( roche ) with a 96-well pin tool ( v&p scientific ) and then cross - linked to the membrane by uv irradiation .
the membranes were then treated with anti - digoxigenin - ap fab fragments and the color substrates nbt / bcip .
the quality of each probe was determined by comparing the intensity of individual probe spots to spots containing 3,10 , 30,100 or 300 pg of control probes .
re - hydrated and post - fixed embryos were incubated for 1 h in hybridization buffer ( 50% formamide , 4 ssc , and 0.01% tween 20 ) .
twenty microliters of these embryos were gently placed in each well of a 96-well filter plate ( millipore madv n65 ) with a multi - channel pipette ( brand transferpette-12 ) using wide - orifice 250 l pre - sterilized tips ( rainin ) .
digoxigenin - labeled rna probe ( 200 l of a 1:100 dilution in hybridization buffer with 5% dextran sulfate ) was added and the embryos were incubated overnight at 55c .
gentle vacuum was used to remove the hybridization solution and the embryos were subjected to eight 30-min washes in wash buffer ( 50% formamide , 2 ssc and 0.01% tween 20 ) .
the embryos were treated for 2 h with 5% goat serum ( roche ) and anti - digoxigenin - ap fab fragments ( roche ) . following nine 10-min washes in 0.1% tween 20 in pbs and two rinses in ap buffer ( 50 mm mgcl2 , 100 mm naci , 100 mm tris ph 9.5 , 0.01% tween 20 ) the nbt
embryos were washed six times with ethanol to enhance contrast and stored in 70% glycerol in pbs . the quality of the hybridization signal , the morphology of the embryos and the number of patterns were assessed under a low - power microscope .
low - magnification images were taken using a dissecting microscope ( leica wild m10 ) equipped with a progres 3012 digital camera .
high - resolution images were captured with a spot rt digital camera mounted onto a zeiss axiophot equipped with nomarski optics .
often several focal planes of the same embryo were captured to fully document the spatial distribution of the staining pattern . in many cases embryos
when a whole embryo view was insufficient to visualize the fine aspects of the staining pattern , we captured a higher - magnification image focused on a small part of the embryo .
such higher - resolution images were generally accompanied by corresponding lower - magnification images for orientation purposes .
most images show the embryo with anterior to the left and dorsal side up ; however , the orientation of images captured in the early stages of the project do not consistently follow this rule .
canton s flies were seeded into 12 population cages and aged in the collection cages for three days with fresh food provided every 12 h. in the morning of the fourth day , the flies were allowed to pre - lay retained embryos .
fresh plates were then introduced simultaneously into all 12 cages and embryos were collected for 1 h. the embryos were then transferred into a 25c incubator and aged . at appropriate time points ,
this procedure yielded 12 samples of non - overlapping 1-h collections starting from 30 to 90 min and ending at 11.5 h to 12.5 h post egg laying .
this procedure was carried out for 3 days , yielding three replicates of each time window .
a sampling of each collection was set aside , devitelinized , and stored in methanol at -20c .
these embryos were used to determine the distribution of stages in each collection sample by examination of morphological markers .
these data were then used to construct an approximate time line correlating the embryo collections and embryonic stages ( see figure 4 ) .
total rna was isolated from the 12 embryo samples described above by homogenization with a motorized plastic pellet pestle in ambion rnawiz solution , followed by chloroform extraction and ethanol precipitation .
eight micrograms of total rna were used to generate digoxigenin - labeled fragmented crna using a standard affymetrix amplification and labeling protocol .
crna was hybridized to a genechip drosophila genome array using standard affymetrix equipment and protocols .
we collected 36 genechip array scans and the success of the experiments was determined by the reproducibility of the three independent replicates .
signals from all replicate experiments were averaged and the standard error of the three measurements was calculated .
data were entered into a custom - designed mysql database and graphs of the microarray time - course for all 14,000 genes were generated using custom perl scripts and a gd graphics library .
the absent / present calls generated by affymetrix microarray suite were color - coded ( present = green , absent = red , marginal = blue ) and incorporated into graphs based on dchip - derived data .
the array - based expression profiles were incorporated into the annotation , report , and analysis web pages described below .
we built a multi - platform network consisting of two microsoft windows workstations connected to digital cameras on microscope equipment and a suse linux server running an apache http server and mysql database .
image data and annotations were submitted to the production mysql database through a perl - based annotation tool ( figure 2 ) .
the annotation tool displays microarray data linked to the cdna under investigation as well as a compilation of available information about that gene in the form of external database links , protein domains and go terms ( from flybase ) .
the annotation tool permits the entering of production - level assessments about the quality and identity of the captured images .
several other web - based tools were developed that support the entering of additional data ( figure 1a,1b,1c,1d ) as well as report scripts that summarize the captured data .
periodically , the data from the production database were transferred into a second mysql database that uses a schema modified from that of the go database . in conjunction with the gadfly database and application programming interface ( see ) , this database allows gene - based and anatomy - based searches of the dataset .
the controlled vocabulary used to annotate the gene - expression profiles is a subset of the flybase controlled vocabulary for anatomy and development .
most annotation terms can be found under the ' developing embryonic structure ' branch of this ontology .
we developed a modified version of the amigo gene ontology browser , imago , which incorporates the anatomy ontologies and the image data .
a more concise version of the annotation hierarchy containing only the terms found in the annotation tool can be accessed at .
annotation data were converted into a binary matrix , the rows representing the genes and the columns representing the anatomical structures . when a given gene was expressed in a given anatomical structure
the matrix was loaded into an r statistics package and dissimilarity matrices were calculated for each two rows and each two columns of the dataset .
the distance measure was ( b + c)/(a + b + c ) , where a is the frequency of 11 columns in two rows of binary data , b is the frequency of 10 columns and c is the frequency of 01 columns . using the dissimilarity matrices , anatomical structures and genes were clustered sequentially using hierarchical clustering with a complete linkage agglomeration method .
clustered matrices were exported from r and converted into interactive web pages using a custom perl script .
the binary data were color - coded ; black indicates that the gene is on in a structure , white indicates that expression of the gene is not detected in that structure .
canton s embryos were collected in 3-h intervals and aged to generate animals 0 - 3 , 3 - 6 , 6 - 9 , 9 - 12 , 12 - 15 and 15 - 18 h old .
the six 3-h embryo collections were mixed in equal proportions to yield a balanced population of embryos representing the first 18 h of embryogenesis .
dna templates were generated by pcr using primers homologous to the vector and purified by g50 column chromatography in 96-well format .
the purified pcr product ( 5 l ) was transcribed in 96-well format by incubation for 2 h at 37c after the addition of 5 l of a polymerase reaction cocktail consisting of 2 u t7 rna polymerase , 4.6 u rnase inhibitor , 10 mm ntps , 3.5 mm digoxigenin-11-utp , 40 mm tris ph 8.0 , 6 mm mgcl2 , 10 mm dtt and 2 mm spermidine .
after treatment with dnase i and na2co3 ph 10.2 , ethanol precipitation was carried out .
pellets were resuspended in 50 l of 50% formamide , 5 mm tris - hcl ph 7.5 , 0.5 mm edta and 0.01% tween 20 .
the digoxigenin - labeled rna probe was quantified by immunological detection using a modified digoxigenin quantification protocol ( roche ) .
a sample of 0.8 l of a 1:300 dilution of the probe was spotted on a positively charged nylon membrane ( roche ) with a 96-well pin tool ( v&p scientific ) and then cross - linked to the membrane by uv irradiation .
the membranes were then treated with anti - digoxigenin - ap fab fragments and the color substrates nbt / bcip .
the quality of each probe was determined by comparing the intensity of individual probe spots to spots containing 3,10 , 30,100 or 300 pg of control probes .
re - hydrated and post - fixed embryos were incubated for 1 h in hybridization buffer ( 50% formamide , 4 ssc , and 0.01% tween 20 ) .
twenty microliters of these embryos were gently placed in each well of a 96-well filter plate ( millipore madv n65 ) with a multi - channel pipette ( brand transferpette-12 ) using wide - orifice 250 l pre - sterilized tips ( rainin ) .
digoxigenin - labeled rna probe ( 200 l of a 1:100 dilution in hybridization buffer with 5% dextran sulfate ) was added and the embryos were incubated overnight at 55c .
gentle vacuum was used to remove the hybridization solution and the embryos were subjected to eight 30-min washes in wash buffer ( 50% formamide , 2 ssc and 0.01% tween 20 ) .
the embryos were treated for 2 h with 5% goat serum ( roche ) and anti - digoxigenin - ap fab fragments ( roche ) . following nine 10-min washes in 0.1% tween 20 in pbs and two rinses in ap buffer ( 50 mm mgcl2 , 100 mm naci , 100 mm tris ph 9.5 , 0.01% tween 20 ) the nbt
embryos were washed six times with ethanol to enhance contrast and stored in 70% glycerol in pbs . the quality of the hybridization signal , the morphology of the embryos and the number of patterns were assessed under a low - power microscope .
low - magnification images were taken using a dissecting microscope ( leica wild m10 ) equipped with a progres 3012 digital camera .
high - resolution images were captured with a spot rt digital camera mounted onto a zeiss axiophot equipped with nomarski optics .
often several focal planes of the same embryo were captured to fully document the spatial distribution of the staining pattern . in many cases embryos
when a whole embryo view was insufficient to visualize the fine aspects of the staining pattern , we captured a higher - magnification image focused on a small part of the embryo .
such higher - resolution images were generally accompanied by corresponding lower - magnification images for orientation purposes .
most images show the embryo with anterior to the left and dorsal side up ; however , the orientation of images captured in the early stages of the project do not consistently follow this rule .
canton s flies were seeded into 12 population cages and aged in the collection cages for three days with fresh food provided every 12 h. in the morning of the fourth day , the flies were allowed to pre - lay retained embryos .
fresh plates were then introduced simultaneously into all 12 cages and embryos were collected for 1 h. the embryos were then transferred into a 25c incubator and aged . at appropriate time points ,
this procedure yielded 12 samples of non - overlapping 1-h collections starting from 30 to 90 min and ending at 11.5 h to 12.5 h post egg laying .
this procedure was carried out for 3 days , yielding three replicates of each time window .
a sampling of each collection was set aside , devitelinized , and stored in methanol at -20c .
these embryos were used to determine the distribution of stages in each collection sample by examination of morphological markers .
these data were then used to construct an approximate time line correlating the embryo collections and embryonic stages ( see figure 4 ) .
total rna was isolated from the 12 embryo samples described above by homogenization with a motorized plastic pellet pestle in ambion rnawiz solution , followed by chloroform extraction and ethanol precipitation .
eight micrograms of total rna were used to generate digoxigenin - labeled fragmented crna using a standard affymetrix amplification and labeling protocol .
crna was hybridized to a genechip drosophila genome array using standard affymetrix equipment and protocols .
we collected 36 genechip array scans and the success of the experiments was determined by the reproducibility of the three independent replicates .
signals from all replicate experiments were averaged and the standard error of the three measurements was calculated .
data were entered into a custom - designed mysql database and graphs of the microarray time - course for all 14,000 genes were generated using custom perl scripts and a gd graphics library .
the absent / present calls generated by affymetrix microarray suite were color - coded ( present = green , absent = red , marginal = blue ) and incorporated into graphs based on dchip - derived data .
the array - based expression profiles were incorporated into the annotation , report , and analysis web pages described below .
we built a multi - platform network consisting of two microsoft windows workstations connected to digital cameras on microscope equipment and a suse linux server running an apache http server and mysql database .
image data and annotations were submitted to the production mysql database through a perl - based annotation tool ( figure 2 ) .
the annotation tool displays microarray data linked to the cdna under investigation as well as a compilation of available information about that gene in the form of external database links , protein domains and go terms ( from flybase ) .
the annotation tool permits the entering of production - level assessments about the quality and identity of the captured images .
several other web - based tools were developed that support the entering of additional data ( figure 1a,1b,1c,1d ) as well as report scripts that summarize the captured data .
periodically , the data from the production database were transferred into a second mysql database that uses a schema modified from that of the go database . in conjunction with the gadfly database and application programming interface ( see ) , this database allows gene - based and anatomy - based searches of the dataset .
the controlled vocabulary used to annotate the gene - expression profiles is a subset of the flybase controlled vocabulary for anatomy and development .
most annotation terms can be found under the ' developing embryonic structure ' branch of this ontology .
we developed a modified version of the amigo gene ontology browser , imago , which incorporates the anatomy ontologies and the image data .
a more concise version of the annotation hierarchy containing only the terms found in the annotation tool can be accessed at .
annotation data were converted into a binary matrix , the rows representing the genes and the columns representing the anatomical structures . when a given gene was expressed in a given anatomical structure
the matrix was loaded into an r statistics package and dissimilarity matrices were calculated for each two rows and each two columns of the dataset .
the distance measure was ( b + c)/(a + b + c ) , where a is the frequency of 11 columns in two rows of binary data , b is the frequency of 10 columns and c is the frequency of 01 columns . using the dissimilarity matrices , anatomical structures and genes were clustered sequentially using hierarchical clustering with a complete linkage agglomeration method .
clustered matrices were exported from r and converted into interactive web pages using a custom perl script .
the binary data were color - coded ; black indicates that the gene is on in a structure , white indicates that expression of the gene is not detected in that structure .
we thank audrey huang for helpful comments on the manuscript , terry speed ( university of california , berkeley ) for valuable advice on clustering of binary data , bradley marshall for modification of the amigo interface and ben berman for useful discussions .
trina agbayani and joseph nunoo provided technical assistance in the early stages of this project .
this work was supported by the howard hughes medical institute and by nih grants p50 hg00750 ( to g.r . ) and p41 hg00739 ( to w. gelbart ) .
( a - e ) examples illustrating each step of the high - throughput production of rna in situ patterns . ( a ) photograph of an agarose gel showing pcr products from a single 96-well plate .
( b ) nylon membrane spotted with 96 rna in situ probes and stained to reveal the incorporation of digoxigenin . missing or weak spots indicate a failed probe reaction .
( c ) four wells of a 96-well plate , each containing about 200 embryos .
all image and textual data are entered into a mysql relational database and integrated with microarray data and previously published expression patterns .
screen shot of the web - based tool used to organize and annotate captured images .
the figure shows the categorization of images in six stage ranges , reflecting developmental time , presented left to right .
the annotation terms are similarly arranged from left to right and grouped from top to bottom according to related organ systems .
groups of images at a given stage range will be associated with groups of annotation terms appropriate for that stage range .
( a - e ) series of five embryos stained with a probe ( bgm ) highlighting the fat - body primordium and revealing dynamic aspects of segmental fat - body specification .
( f - j ) series of five embryos stained with a probe ( cg4829 ) visualizing the lamellocyte precursors .
the staining reveals the spreading pattern of lamellocytes across the embryo and the ' hitchhiking ' of migrating cells on the retracting germ band . comparison of image and microarray data for gene cg4702 .
( a ) a microarray expression profile of the gene cg4702 , represented by est clone ld43816 .
consecutive time points representing rna samples from differentially aged 1-h embryo collections are presented on the x - axis , while the y - axis represents the scale of absolute expression indexes as analyzed by dchip analysis software .
error bars represent standard error of the measurements , which were carried out independently on three separate embryo collections ; the number next to each bar is the mean of the three measurements .
the color of the bar reflects the categorization of each measurement on the basis of a statistical analysis performed by the affymetrix microarray suite software package .
green represents present ; red , absent . because of the sensitivity limitations of the genechip measurements and the conservative nature of the software , absent calls do not necessarily imply lack of gene expression .
the secondary x - axis correlates the microarray sample time points with stages of embryogenesis .
( b ) images of six staged embryos illustrating expression during development of the same gene characterized above by microarray analysis .
each image comes from a different stage range ( stages 1 - 3 , 4 - 6 , 7 - 8 , 9 - 10 , 11 - 12 , and 14 - 16 ) .
( a - n ) fourteen examples of correlations between microarray and image data for genes with known expression patterns .
red is absent , green is present , and vertical lines on bars represent error bars of triplicate measurements . on the right
are six representative images , one for each stage range specified in figure 4 , ordered according to developmental time to allow visual correlation with the corresponding array profile .
the most straightforward comparisons occur when gene expression comes on ( e , n ) or is turned off abruptly ( a , b ) , corresponding to the absence or presence of in situ staining respectively . in many cases , the absent / present call misses the expression of genes confined to a small subset of tissues ( c , m ) .
( l ) gene - expression levels increase , followed by an increase in staining intensity that occupies approximately the same proportion of the embryo .
( f ) the increase in microarray intensity reflects an increase in the number of cells in the embryo showing gene expression across time .
( c ) fading expression is indicative of the restriction of gene expression to a smaller subset of cells as development proceeds .
frequently , a microarray profile will show both types of fluctuations , and in that case the visual correlation is rather subjective ( g , h ) , unless accompanied by a clear - cut qualitative change ( d , e , i ) .
( k ) genes transcribed both maternally and zygotically have no ' off ' period during our developmental time course .
( j ) the decrease in abundance of maternal transcript often overlaps with emergence of zygotic transcript , leading to the flattening of the early portion of the microarray profile .
textual annotations using controlled vocabularies . ( a ) general categories of anatomical terms and the developmental relationships between them .
we distinguish four types of anatomical structures : ' anlage in statu nascendi ' , ' anlage ' , ' primordium ' and differentiated ' organs ' .
below each heading are examples of staining patterns that illustrate a specific instance of that category of developmental structure .
anlage in statu nascendi , anlage and primordium become suffixes to the specific name of a structure , such as dorsal ectoderm anlage in statu nascendi , head mesoderm anlage and malpighian tubule primordium .
( b ) embryos at the indicated stages stained with a probe for the gene single minded reveal the developmental origin of the midline glia .
the first four of the 14 genes returned by a query for genes expressed in the ' embryonic optic lobe ' are shown .
the ' gene ' column gives the gene name , gene identifier , est identifier , cytological position and go function assignments , where available .
the gene name serves as a link to access the complete expression report page for that gene .
array profiles and images can be enlarged in a separate window by clicking on the thumbnail image . in the column labeled ' body part '
is a list of all annotation terms that have been assigned to that gene , with the query subject ( in this case , embryonic optic lobe ) highlighted by bold italics .
columns of the matrix represent the 99 annotation terms from the controlled vocabulary that correspond to differentiated organs .
rows of the matrix represent 1,257 genes that are expressed in at least one of those embryonic structures .
a black matrix cell indicates that a gene is expressed in the given structure . both rows and columns
green shading highlights clusters of embryonic structures that are part of the nervous system , cyan shading highlights clusters formed by components of the muscle system .
genes expressed specifically in the embryonic fat body are highlighted by a red rectangle , two separate clusters of genes expressed in the tracheal system are surrounded by blue and magenta rectangles .
a cluster of genes expressed in the peripheral nervous system and not in the central nervous system is enclosed by the yellow rectangle .
( a - d ) three adjacent brachyury / t - box genes - ( a ) cg5093 , ( b ) cg5107 , ( c ) dorsocross - show remarkably similar expression patterns at cellular blastoderm and are located next to each other on the chromosome ( d ) . ( e - i ) expression patterns of five genes with homology to metabolic and detoxification enzymes : ( e ) hydroxyacylglutathione hydrolase , cg9026 ; ( f ) cytochrome p450 , cyp310a ; ( g ) multi - drug resistance gene , mdr49 ; ( h ) xanthine dehydrogenase , rosy ; and ( i ) transketolase , cg8036 . ( j ) dorsal view of a stage-8 embryo stained with a probe that reveals apically localized mrnas ( cg18375 ) within the developing hindgut epithelium , contrasted with basally localized mrna ( cg11207 ) in the same cells ( k ) .
( l ) close - up of ( j ) highlighting the apically localized mrna in the epithelium surrounding the invaginating hindgut pocket with pole cells ( pc ) .
( m ) close - up of ( k ) revealing an equivalent region of an embryo as ( l ) and highlighting the basally localized mrna .
( n ) portion of the dorsal side of a pre - blastoderm embryo stained for mrna ( cg1962 ) that appears to be localized to an unidentified subnuclear compartment .
 as a first step to creating a comprehensive atlas of gene - expression patterns during drosophila embryogenesis , 2,179 genes have been examinded by in situ hybridization to fixed drosophila embryos . of the genes 
 assayed , 63.7% displayed dynamic expression patterns that were documented with 25,690 digital photomicrographs of individual embryos . 
Background
Results and discussion
Overview of the high-throughput 
Documenting expression patterns by digital photography
Microarray data as independent measurements of RNA expression patterns
Textual annotation of gene-expression patterns and assembly of a public database
Systematic analysis of the 
Conclusions
Materials and methods
96-well 
Digital imaging
Microarray analysis
Image data annotation and presentation
Clustering of annotation data
Acknowledgements
Figures and Tables