as of september 2008 ( release 10.3 ) , the ribosomal database project ( rdp ) maintained 33 082 archaeal and 643 916 bacterial small subunit rrna sequences .
of these , 142 511 came from cultured organisms while 534 487 were sequences obtained from environmental samples .
a total of 5534 sequences are from species type - strains ; these sequences help to link taxonomy and phylogeny .
as described in our previous update ( 1 ) , all sequences are tested for anomalies using the pintail program ( 2 ) . slightly fewer than 10% ( 64 290 ) of the sequences
the rdp sequence collection is updated monthly from the international nucleotide sequence database collaboration ( insdc : ddbj , embl and genbank ) . in may 2008 ,
rdp introduced the rdp 10 series of releases with completely new bacterial and archaeal alignments based on a major improvement to the rdp alignment strategy ( table 1 ) .
these new alignments are created using the infernal secondary structure based aligner ( 3 ) , the same aligner used to provide alignments in the rfam database of untranslated rna molecules ( 4 ) . both infernal and rnacad ( 5 ) ( the aligner used in the rdp 9 series of releases ) are stochastic context - free grammar based and provide a high - quality secondary structure aware alignment .
infernal is about 25 times faster and can align approximately 44 near full length 16s rrna sequences per cpu - minute on a 2.66 ghz xeon processor .
for example , when a base is missing on one side of a helix , rnacad disrupts the alignment on the other side of the helix ( it does not allow half base pairs ) , while infernal will allow the half base pair with a penalty .
infernal also correctly aligns some known problem sequences that have been reported with the rnacad - based rdp 9 alignment of a small number of short partial sequences ( 6 ) . 

table 1.characteristics of the new rdp 10 alignment modelsalignment modelnumber of model positionsnumber of base pairs modelednumber of sequencespercentage bases modeled ( % ) bacterial1416431643 91692.1archaeal144343833 08297.3number of positions in alignment modeled as columns of homologues.number of base pairs in alignment model.number of sequences in rdp release 10.3.percentage of bases aligned as model positions in rdp release 10.3 .
characteristics of the new rdp 10 alignment models number of positions in alignment modeled as columns of homologues .
the infernal aligner , like other probabilistic model - based aligners , is trained on a set of representative sequences .
we trained the aligner on a small , hand - curated set of high - quality full - length rrna sequences derived mainly from genome sequencing projects ( 508 for the bacterial model and 79 for the archaeal model ) . in many cases ,
the annotated rrna gene start and stop positions , in the genome records , were found to be incorrect and were adjusted using a combination of the rnammer web server and hand adjustment [ ( 7 ) ; this article also notes the problem in rrna gene annotation ] .
the relatively small training sets needed for model - based aligners is an advantage over nearest neighbor aligners , which require a much larger seed alignment .
it is much easier to maintain reliable hand - adjustment of homology information in the smaller training set .
the second major improvement in rdp 10 over rdp 9 is the former provides an up - to - date , aligned and annotated archaeal data set along with the bacterial data set .
as there are significant differences in the conserved secondary structures of bacterial and archaeal 16s rrna , each data set is provided in a separate alignment to maximize the number of comparable positions .
outgroup sequences are provided in each alignment ( escherichia coli for the archaeal and methanocaldococcus jannaschii for the bacterial alignments ) for use in phylogenetic reconstruction .
in addition , this release incorporates a new phylogenetically consistent higher order bacterial taxonomy based on published taxonomic opinions , including opinions on environmental groups .
( 9 ) with some major modifications from the recent reevaluations to the firmicutes and cyanobacteria proposed by bergey 's trust ( 10,11 ) , along with additional published informal taxonomies for the acidobacteria ( 12 ) , verrucomicrobia ( 13 ) , op11 ( 14 ) and other less - well - studied areas of microbial diversity .
the rdp classifier , which is also available as a standalone program ( 15 ) , can be easily trained on other alternative taxonomies . in addition , all public rdp sequences can be browsed in the taxonomy offered by genbank ( 16 ) .
these improvements have been extended to the myrdp user - account system described in our last update ( 1 ) .
all myrdp user data have been updated to match the new rdp 10 alignments and taxonomy .
as of september 2008 , the myrdp system had 2652 active users with a total of 1 655 828 private sequences .
the research buddy feature has proved quite popular , with over 200 researchers participating in the data sharing .
sequencing ssu rrna genes from environmental samples is a standard method for determining bacterial community composition .
new technologies such as multiplexed pyrosequencing of mixed rrna amplicons now allow in - depth analysis of bacterial rrna composition to be carried out rapidly and inexpensively ( see e.g. 17 ) . with these new sequencing methodologies ,
the new rdp pyrosequencing pipeline offers a collection of tools that automate the data processing and simplify the computationally intensive analysis of large sequencing libraries ( figure 1 ) . 

tools available in the rdp for processing pyrosequencing data . in the initial processing steps ,
raw sequence reads from multiple samples are sorted using sample - specific key ( tag ) sequences .
the mapping between the tag sequence and sample name is designated in a tag file .
. reads with a tag that do not exactly match any tag sequences are put into a separate folder .
four quality filters can be applied in the initial processing step : the maximum edit distance allowed for the forward primer(s ) , the maximum edit distance allowed for the reverse primer(s ) , the number of ambiguity codons ( n 's ) and the minimum sequence length after removing primer sequences . the pipeline contains both taxonomy - based and taxonomy - independent methods for community analysis , and each type of method has advantages .
taxonomy - based methods are often faster and provide classification information about the organisms in a sample
. however , these methods are not always able to correctly identify novel organisms ( organisms not in the preexisting taxonomic framework ) . for taxonomy - independent analysis , standard species - based comparison methods for both  and  ecological diversity measures
are easily applied to clustered data , although divergence - based approaches may yield better resolution ( 18,19 ) .
for taxonomy - based analysis , the rdp classifier provides fast and reliable classification of short sequence reads ( 15,20 ) .
the rdp library compare program can be used to detect differentially represented taxa between samples . and
the rdp sequence match tool can be used to find the closest sequences in the rdp database for each sequence in a sample . for taxonomy - independent alignment , the trimmed reads are aligned using the fast infernal aligner mentioned above .
reads are then clustered into operational taxonomic units at multiple pairwise distances using custom code implementing the complete - linkage clustering algorithm .
in addition , the processed data can be downloaded in formats suitable for common ecological and statistical packages including spade ( http://chao.stat.nthu.edu.tw ) , estimates ( http://viceroy.eeb.uconn.edu/estimates ) and r ( http://www.r-project.org ) .
other options are available to cluster data from multiple samples , to combine alignments , to extract specific sequences from the dataset , to select representative sequences from clustered sequences and to produce comparative metrics among samples
. initial tests of the pyrosequencing pipeline were carried out with roche gs flx data covering a 207-base region of the 16s rrna gene including the v4 variable region and flanked by conserved targets for amplification primers .
further information about the protocol , including primer and key sequences , can be found at the rdp web site .
the pipeline has been extended to work with gs flx and gs 20 data covering other regions of the 16s gene and should have no trouble processing the longer pyrosequencing reads produced by the roche gs flx titanium system .
most of the steps are relatively fast . a typical pyrosequencing run of 350 000 reads requires about 10 cpu - minutes for the initial processing steps with a 2.66 ghz processor .
the rdp classifier can assign approximately 2900 trimmed 207-base reads per cpu - minute . with an alignment model limited to the 207-base region , reads are aligned by infernal at a rate of about 2200 reads per cpu - minute . with a complete 16s rrna model ,
the short reads are aligned at a rate of around 500 reads per cpu - minute .
the rdp complete - linkage cluster tool can cluster a maximum of slightly more than 150 000 unique sequences . in practice , this has been sufficient to cluster over 200 000 reads combined from multiple soil samples and a much higher number of reads from less diverse environments .
speed of the cluster tool is proportional to the square of the number of sequences .
currently , clustering and alignment results are returned to the user through email ; all other analyses are returned online , however , an online interface similar to the rdp 's myrdp space is under development .
this tool displays a color heatmap representation of a symmetric distance matrix between large sets of sequences chosen by the user ( figure 2 ) .
taxa that are phylogenetically incoherent or are misplaced in a hierarchy stand out visually in the representation , as do individual misplaced sequences .
sequences can be selected from the rdp database , from myrdp or an aligned fasta file , or a precalculated distance matrix file uploaded by the user .
the heatmap displays sequences arranged in a predefined taxonomic order . for rdp and myrdp sequences , either the rdp taxonomy or an uploaded user - defined taxonomy
researchers can use pan and zoom features similar to those on google maps to examine specific regions of the heatmap . bounding boxes for each taxon are displayed on mouse - over and the corresponding portions of the taxonomic hierarchy
are rendered upon mouse - over in the tooltips display . to accommodate visually impaired users , the colors in the heatmap display
heatmap images , the underlying distance matrix and the taxonomy are also available for download . 
 figure 2.taxomatic sample screenshot demonstrating a taxonomic anomaly .
the screen is zoomed - in to show a portion of proteobacterial type - strain sequences .
the mouse points to the genus shinella , originally placed in the alphaproteobacteria ( 21 ) , but incorrectly moved to the betaproteobacteria in the taxonomic outline of the bacteria and archaea ( 9 ) .
the screen is zoomed - in to show a portion of proteobacterial type - strain sequences .
the mouse points to the genus shinella , originally placed in the alphaproteobacteria ( 21 ) , but incorrectly moved to the betaproteobacteria in the taxonomic outline of the bacteria and archaea ( 9 ) .
this tool also implements a version of the  self - organizing self - correcting classifier algorithm ( soscc ) of garrity and lilburn ( 22 ) .
soscc is an experimental distance matrix optimization algorithm that can be used to automatically detect and reassign misplaced taxa and sequences in taxonomies with minor inconsistencies .
briefly , the soscc sorts the matrix to place nearest neighbors next to each other .
new taxon boundaries are calculated by expanding each taxon from its centroid sequence to maximize a scoring function based on the numbers of taxon members and nonmembers included in the new boundary . when starting taxomatic , users are given the option of preprocessing a matrix with the soscc , running the algorithm once , or running it in bootstrapping mode ( 100 iterations ) . with bootstrapping
, soscc will generate alignments using a random selection of alignment columns with replacement and perform the soscc optimization on each alignment , keeping track of the updated taxonomy for every sequence in each iteration .
reclassifications are accepted that occur in user - predefined minimum number of bootstraps . with bootstrapping ,
the user is prompted to enter an email address where a link to the results will be sent .
a text file of all machine - generated taxonomic changes is available for download along with the new taxonomy and heatmap images .
this new educational tool for teaching the basics of rrna analysis provides instructors a lesson plan along with individualized lesson material .
it generates a set of unique sequences for each student that can be easily distributed to a classroom .
it provides a set of easy - to - follow instructions for students and an answer key for instructors to help evaluate student performance .
the instructor is presented a simple form that asks about the number of students , the level of difficulty ( the number of sequences to be assigned for each student ) and other information about the class .
the tool then produces a set of sequences for each student modified from existing sequences .
the sequences are randomly selected from a set of well - known genera from both archaea and bacteria that are programmatically  evolved by modifying a small number of bases .
since each student receives a customized set of sequences , there is less chance of students sharing results .
students are asked to analyze the sequences , and the instructor is provided with a key containing the classification for each of the student sequences .
a new genome browser feature added to the rdp hierarchy browser , provides a subset of the rdp database that derives from sequenced bacterial and archaeal genomes .
pages for each genome project list the genome size and number of 16s rrna genes .
these links are automatically updated using the genomic rosetta stone web service from the genomic standards consortium ( 23 ) .
also , sequences from completed genome projects can be found by searching with the genbank project i d from the hierarchy browser .
additional tools are described in our previous update ( 1 ) . over the last year
, the rdp implemented a new user survey system to help obtain user input on directions for the rdp .
each survey asks a single question and is displayed for approximately two weeks as an overlay when users access the rdp web site .
users may either answer the question or decline to answer before continuing to the rdp web site .
a browser cookie is used to keep users from seeing the same survey question twice .
the results of the rdp surveys are available on the rdp web site resources page . on average
in addition to extensive help files , the rdp hosts a collection of short video tutorials demonstrating some of the more complex analysis tasks .
the videos capture the screen as the tasks are performed , while the narrator explains the tasks and the choices available to the researcher .
sequencing ssu rrna genes from environmental samples is a standard method for determining bacterial community composition .
new technologies such as multiplexed pyrosequencing of mixed rrna amplicons now allow in - depth analysis of bacterial rrna composition to be carried out rapidly and inexpensively ( see e.g. 17 ) . with these new sequencing methodologies ,
the new rdp pyrosequencing pipeline offers a collection of tools that automate the data processing and simplify the computationally intensive analysis of large sequencing libraries ( figure 1 ) . 

tools available in the rdp for processing pyrosequencing data . in the initial processing steps ,
raw sequence reads from multiple samples are sorted using sample - specific key ( tag ) sequences .
the mapping between the tag sequence and sample name is designated in a tag file .
reads with a tag that do not exactly match any tag sequences are put into a separate folder .
four quality filters can be applied in the initial processing step : the maximum edit distance allowed for the forward primer(s ) , the maximum edit distance allowed for the reverse primer(s ) , the number of ambiguity codons ( n 's ) and the minimum sequence length after removing primer sequences . the pipeline contains both taxonomy - based and taxonomy - independent methods for community analysis , and each type of method has advantages .
taxonomy - based methods are often faster and provide classification information about the organisms in a sample
. however , these methods are not always able to correctly identify novel organisms ( organisms not in the preexisting taxonomic framework ) . for taxonomy - independent analysis , standard species - based comparison methods for both  and  ecological diversity measures
are easily applied to clustered data , although divergence - based approaches may yield better resolution ( 18,19 ) . for taxonomy - based analysis ,
the rdp classifier provides fast and reliable classification of short sequence reads ( 15,20 ) .
the rdp library compare program can be used to detect differentially represented taxa between samples . and the rdp sequence match tool can be used to find the closest sequences in the rdp database for each sequence in a sample . for taxonomy - independent alignment ,
reads are then clustered into operational taxonomic units at multiple pairwise distances using custom code implementing the complete - linkage clustering algorithm .
in addition , the processed data can be downloaded in formats suitable for common ecological and statistical packages including spade ( http://chao.stat.nthu.edu.tw ) , estimates ( http://viceroy.eeb.uconn.edu/estimates ) and r ( http://www.r-project.org ) .
other options are available to cluster data from multiple samples , to combine alignments , to extract specific sequences from the dataset , to select representative sequences from clustered sequences and to produce comparative metrics among samples
. initial tests of the pyrosequencing pipeline were carried out with roche gs flx data covering a 207-base region of the 16s rrna gene including the v4 variable region and flanked by conserved targets for amplification primers .
further information about the protocol , including primer and key sequences , can be found at the rdp web site .
the pipeline has been extended to work with gs flx and gs 20 data covering other regions of the 16s gene and should have no trouble processing the longer pyrosequencing reads produced by the roche gs flx titanium system .
most of the steps are relatively fast . a typical pyrosequencing run of 350 000 reads requires about 10 cpu - minutes for the initial processing steps with a 2.66 ghz processor .
the rdp classifier can assign approximately 2900 trimmed 207-base reads per cpu - minute . with an alignment model limited to the 207-base region , reads are aligned by infernal at a rate of about 2200 reads per cpu - minute . with a complete 16s rrna model ,
the short reads are aligned at a rate of around 500 reads per cpu - minute .
the rdp complete - linkage cluster tool can cluster a maximum of slightly more than 150 000 unique sequences . in practice , this has been sufficient to cluster over 200 000 reads combined from multiple soil samples and a much higher number of reads from less diverse environments .
speed of the cluster tool is proportional to the square of the number of sequences .
currently , clustering and alignment results are returned to the user through email ; all other analyses are returned online , however , an online interface similar to the rdp 's myrdp space is under development .
this tool displays a color heatmap representation of a symmetric distance matrix between large sets of sequences chosen by the user ( figure 2 ) .
taxa that are phylogenetically incoherent or are misplaced in a hierarchy stand out visually in the representation , as do individual misplaced sequences .
sequences can be selected from the rdp database , from myrdp or an aligned fasta file , or a precalculated distance matrix file uploaded by the user .
the heatmap displays sequences arranged in a predefined taxonomic order . for rdp and myrdp sequences , either the rdp taxonomy or an uploaded user - defined taxonomy
researchers can use pan and zoom features similar to those on google maps to examine specific regions of the heatmap . bounding boxes for each taxon
are displayed on mouse - over and the corresponding portions of the taxonomic hierarchy are highlighted . at higher zoom levels , sequence and organism specific information
are rendered upon mouse - over in the tooltips display . to accommodate visually impaired users , the colors in the heatmap display
heatmap images , the underlying distance matrix and the taxonomy are also available for download . 
 figure 2.taxomatic sample screenshot demonstrating a taxonomic anomaly .
yellow indicates more close sequences and teal more distant , with intermediate distances black . the screen is zoomed - in to show a portion of proteobacterial type - strain sequences .
the mouse points to the genus shinella , originally placed in the alphaproteobacteria ( 21 ) , but incorrectly moved to the betaproteobacteria in the taxonomic outline of the bacteria and archaea ( 9 ) .
the screen is zoomed - in to show a portion of proteobacterial type - strain sequences .
the mouse points to the genus shinella , originally placed in the alphaproteobacteria ( 21 ) , but incorrectly moved to the betaproteobacteria in the taxonomic outline of the bacteria and archaea ( 9 ) .
this tool also implements a version of the  self - organizing self - correcting classifier algorithm ( soscc ) of garrity and lilburn ( 22 ) .
soscc is an experimental distance matrix optimization algorithm that can be used to automatically detect and reassign misplaced taxa and sequences in taxonomies with minor inconsistencies .
briefly , the soscc sorts the matrix to place nearest neighbors next to each other .
new taxon boundaries are calculated by expanding each taxon from its centroid sequence to maximize a scoring function based on the numbers of taxon members and nonmembers included in the new boundary . when starting taxomatic , users are given the option of preprocessing a matrix with the soscc , running the algorithm once , or running it in bootstrapping mode ( 100 iterations ) . with bootstrapping
, soscc will generate alignments using a random selection of alignment columns with replacement and perform the soscc optimization on each alignment , keeping track of the updated taxonomy for every sequence in each iteration .
reclassifications are accepted that occur in user - predefined minimum number of bootstraps . with bootstrapping ,
the user is prompted to enter an email address where a link to the results will be sent .
a text file of all machine - generated taxonomic changes is available for download along with the new taxonomy and heatmap images .
this new educational tool for teaching the basics of rrna analysis provides instructors a lesson plan along with individualized lesson material .
it generates a set of unique sequences for each student that can be easily distributed to a classroom .
it provides a set of easy - to - follow instructions for students and an answer key for instructors to help evaluate student performance .
the instructor is presented a simple form that asks about the number of students , the level of difficulty ( the number of sequences to be assigned for each student ) and other information about the class .
the tool then produces a set of sequences for each student modified from existing sequences .
the sequences are randomly selected from a set of well - known genera from both archaea and bacteria that are programmatically  evolved by modifying a small number of bases .
the changes preserve rrna secondary structure and avoid highly conserved positions . since each student receives a customized set of sequences ,
students are asked to analyze the sequences , and the instructor is provided with a key containing the classification for each of the student sequences .
a new genome browser feature added to the rdp hierarchy browser , provides a subset of the rdp database that derives from sequenced bacterial and archaeal genomes .
pages for each genome project list the genome size and number of 16s rrna genes .
these links are automatically updated using the genomic rosetta stone web service from the genomic standards consortium ( 23 ) .
also , sequences from completed genome projects can be found by searching with the genbank project i d from the hierarchy browser .
over the last year , the rdp implemented a new user survey system to help obtain user input on directions for the rdp . each survey asks a single question and is displayed for approximately two weeks as an overlay when users access the rdp web site .
users may either answer the question or decline to answer before continuing to the rdp web site .
a browser cookie is used to keep users from seeing the same survey question twice .
the results of the rdp surveys are available on the rdp web site resources page . on average
in addition to extensive help files , the rdp hosts a collection of short video tutorials demonstrating some of the more complex analysis tasks .
the videos capture the screen as the tasks are performed , while the narrator explains the tasks and the choices available to the researcher .
the rdp data and analysis services can be found at http://rdp.cme.msu.edu/. the rdp 's mission includes user support .
the rdp staff may also be contacted via fax ( + 1 517 353 8957 attn : rdp ) or regular mail .
department of energy , ( de - fg02 - 99er62848 , de - fg02 - 04er63933 ) ; national science foundation ( dbi-0328255 ) ; national institute of environmental health sciences superfund basic research program ( p42es04911 ) . funding for open access charge : office of science ( ber ) , u.s .
 the ribosomal database project ( rdp ) provides researchers with quality - controlled bacterial and archaeal small subunit rrna alignments and analysis tools . 
 an improved alignment strategy uses the infernal secondary structure aware aligner to provide a more consistent higher quality alignment and faster processing of user sequences . 
 substantial new analysis features include a new pyrosequencing pipeline that provides tools to support analysis of ultra high - throughput rrna sequencing data . 
 this pipeline offers a collection of tools that automate the data processing and simplify the computationally intensive analysis of large sequencing libraries . 
 in addition , a new taxomatic visualization tool allows rapid visualization of taxonomic inconsistencies and suggests corrections , and a new class assignment generator provides instructors with a lesson plan and individualized teaching materials . 
 details about rdp data and analytical functions can be found at http://rdp.cme.msu.edu/. 
DESCRIPTION
New Pyrosequencing Pipeline
New Taxomatic visualization tool
New RDP class Assignment Generator
Analysis tools
RDP user surveys
RDP ACCESS AND CONTACT
FUNDING