<title>Background</title> <p>Gene expression research is a rapidly evolving field with recent advances in technologies aimed at multi-gene expression profiling and high throughput screening. Technologies like high-density DNA microarrays enable one to perform parallel gene expression profiling in the scale of tens of thousands of genes in a single experiment [##REF##9634850##1##,##UREF##0##2##]. Quantitative real-time-PCR, though lacking the scale of microarrays, is a rapid, sensitive and less complex method for gene expression analysis and offers an alternative approach for parallel profiling of multiple targets as well as a time-saving means to validate microarray results.</p> <p>With many different technologies available for gene expression measurement, the need to compare the results obtained from different platforms and technologies and thus the reliability and biological significance of those results becomes evident. Moreover, concerns regarding the reliability and consistency of the microarray technology from different suppliers, different test sites and when using different methods for data processing and normalization have been raised [##REF##14500831##3##, ####REF##15122300##4##, ##UREF##1##5##, ##REF##16585533##6##, ##REF##16417622##7####16417622##7##]. To address those concerns, scientists from the US Food and Drug Administration (FDA) established the MicroArray Quality Control (MAQC) consortium to evaluate the performance of several microarray platforms as well as three quantitative gene expression assays [##REF##16964225##8##, ####REF##16964226##9##, ##REF##16964227##10##, ##REF##16964228##11##, ##REF##16964229##12##, ##REF##17061323##13####17061323##13##]. The microarray platforms were from Affymetrix (AFX), Agilent Techonologies (one-color protocol (AG1) or two-color protocol (AGL)), Applied Biosystems (ABI), GE Healthcare (GEH), Illumina (ILM), Eppendorf (EPP) and the National Cancer Institute (NCI), and the three quantitative assays were TaqMan<sup>® </sup>Gene Expression Assay (Applied Biosystems, Foster City, CA), Standardized (Sta) <italic>RT</italic>-PCR™ (Gene Express, Inc., Toledo, OH) and QuantiGene<sup>® </sup>(Panomics, Inc., Fremont, CA).</p> <p>Reports from the Phase 1 study of the MAQC project, which profiled two standardized reference RNA samples, contain important findings on the performance of different expression measurement technologies and give insights into the level of cross-platform comparability among different technologies [##REF##16964225##8##, ####REF##16964226##9##, ##REF##16964227##10##, ##REF##16964228##11##, ##REF##16964229##12##, ##REF##17061323##13####17061323##13##]. The comprehensive data sets generated from this MAQC effort showed that great inter-site and cross-platform consistency can be achieved among different technologies [##REF##16964225##8##,##REF##16964229##12##]. Importantly, the selection criteria used to define differentially expressed genes has a substantial impact on the overlap of the resulting gene lists, with gene lists generated by fold change ranking being more reproducible than those obtained by <italic>t</italic>-test <italic>P </italic>value ranking. With these findings, the MAQC Consortium recommends fold change ranking using a nonstringent P-value cutoff for gene selection. Another important goal attained by this project is to generate a thoroughly characterized reference data set against which new modifications in the existing microarray platforms and other expression measurement technologies can be compared and validated, and laboratory performance can be assessed. This was accomplished by providing the community with two commercially available high-quality human reference RNA samples that can be used as a tool for calibration and quality control as well as for performance assessment and validation of assays. The two RNA samples used in the MAQC project were the Stratagene Universal Human Reference RNA (comprised of RNA from ten different cell lines) and the Ambion Human Brain Reference RNA. Extremely large lots of these two reference RNAs were produced under stringent quality-control procedures. This has allowed researchers to assess the performance of their assays over time using the same RNA samples from identical manufacturing lots and to compare their results with the MAQC data set.</p> <p>The platforms evaluated in the MAQC project can be categorized into either hybridization-based or PCR-based technologies. Different platforms of microarray and QuantiGene assays belong to hybridization-based technology. For microarrays, RNA samples are labeled with a tag (biotin or a fluorophore) followed by hybridization to immobilized gene-specific probes and fluorophore-based detection. QuantiGene is a sandwich nucleic acid hybridization system that detects RNA directly [##REF##16545767##14##]. Targets are captured through joint hybridization of multiple probes, and the complex is detected by signal amplification through a branched DNA amplifier and chemiluminescence signal production. TaqMan Gene Expression Assays and Sta<italic>RT</italic>-PCR are PCR-based techniques. Sta<italic>RT</italic>-PCR is a competitive end-point PCR-based assay. A standardized mixture of internal standard (SMIS) competitive templates is added to the reverse transcribed products prior to PCR. The individual endpoint Sta<italic>RT</italic>-PCR products are then separated by size and quantified by high-throughput microfluidic electrophoresis [##REF##14970455##15##]. The TaqMan assay is based on real-time PCR using a fluorescent dye to monitor the amplification of target genes by DNA polymerase. It employs a target-specific, dual-labeled, fluorogenic hybridization probe with a quencher on the 3' end to be hydrolyzed by the 5' to 3' exonuclease activity of Taq polymerase during the extension step [##REF##8908518##16##].</p> <p>Real-time PCR is widely considered the gold standard for gene expression measurement due to its high assay specificity, high detection sensitivity and wide linear dynamic range. In addition to the TaqMan assay, the SYBR<sup>® </sup>Green PCR assay is another commonly used real-time PCR technique which is employed by half of all real-time PCR users [##UREF##2##17##]. Despite its widespread use, this technique was surprisingly not included as part of the MAQC project. SYBR Green PCR is widely used because of the ease in designing the assays and its relatively low setup and running costs. Unlike TaqMan fluorescent probes, SYBR Green dye intercalates into double-stranded DNA to monitor the amplification of target gene specifically initiated by gene-specific primers. One drawback of SYBR Green assays, however, is that the dye is non-specific and can generate false positive signals if non-specific products or primer-dimers are present in the assay. Those problems can be addressed by carefully designing the primers and validating the PCR products with dissociation curve analysis immediately after PCR. In addition, other approaches have been practiced to further increase the specificity of SYBR Green detection, such as a "hot start" strategy using a DNA polymerase that requires heat activation, or acquisition of fluorescence signals at a temperature slightly below the melting temperature of the desired amplicon but above which nonspecific primer-dimer related products will denature and produce minimal signals [##REF##9631186##18##,##REF##11846613##19##].</p> <p>In the present study, we have evaluated the performance of SuperArray's SYBR Green real-time PCR assays in profiling the same two reference RNA samples analyzed by the MAQC Consortium. Using the MAQC data sets available from the public database [##REF##16964225##8##,##REF##16964229##12##,##UREF##3##20##], we conducted similar analyses for the RT<sup>2 </sup>Profiler PCR Arrays and compared our expression profiling results with those generated from the three quantitative technologies (TaqMan, Sta<italic>RT-</italic>PCR and QuantiGene) as well as from five of the commercial microarray platforms (AFX, AG1, ABI, GEH and ILM) examined in the MAQC project [##REF##16964225##8##,##REF##16964229##12##].</p>
<title>Methods</title> <title>Materials</title> <p>Sample A (Universal Human Reference RNA) and Sample B (Human Brain Reference RNA), were purchased from Stratagene (Cat# 740000 lot#1130623; La Jolla, CA) and Ambion (Cat# 6050 lot#105P055201A; Austin, TX), respectively. Both of these reference RNA samples are from the identical manufacturing lots as those used in the MAQC study [##REF##16964225##8##,##REF##16964229##12##]. Reverse transcription kits (Cat# C-01) and SYBR Green real-time PCR master mixes (Cat# PA-012 and Cat# PA-011) were from SuperArray Bioscience (Frederick, MD). The Human Drug Metabolism RT<sup>2 </sup>Profiler™ PCR Array (Cat# APH-002), that was used for inter-site and inter-instrument comparison, and a custom RT<sup>2 </sup>Profiler PCR Array (Table ##TAB##0##1##), that was used for cross-platform comparison, were designed and manufactured at SuperArray with the primer sets for the specified genes pre-dispensed into a 96-well PCR plate.</p> <title>Cross-platform comparison</title> <p>The custom PCR Array designed for cross-platform comparison was run in six technical replicates for each of the two MAQC reference RNAs. For each custom PCR array, one microgram (μg) of RNA was reverse transcribed in a 20-μL reaction volume into first-strand cDNA using SuperArray's ReactionReady™ First Strand cDNA Synthesis Kit (Cat# C-01) containing random primers following the instructions provided in the user's manual. After mixing the cDNA with RT<sup>2 </sup>SYBR Green/ROX qPCR Master Mix (Cat# PA-012, SuperArray), 25 μL of the mixture containing cDNA synthesized from 9 ng total RNA was dispensed to each well of PCR Arrays. This amount of sample input is similar to the 10 ng total RNA sample input per reaction for TaqMan and Sta<italic>RT</italic>-PCR Assays but lower than the 500 ng total RNA input per reaction for QuantiGene performed in the MAQC phase 1 study. Real-time PCR was performed on an ABI 7500 Real-Time PCR System (Applied Biosystems, Foster City, CA) using the following cycling parameters: 10 min at 95°C (heat activation step); 40 cycles of 15 sec at 95°C, 1 min at 60°C. Dissociation curve analyses were performed using the instrument's default setting immediately after each PCR run.</p> <title>Inter-site comparison</title> <p>The two MAQC reference RNAs were analyzed on the Human Drug Metabolism RT<sup>2 </sup>Profiler™ PCR Array (Cat# APH-002) at two different locations with cDNA synthesis and PCR procedures performed as described above. PCR Arrays were performed on an ABI 7500 Real-Time PCR System at Site 1 while the arrays were run on an ABI 7000 at Site 2, with both sites using SuperArray's RT<sup>2 </sup>SYBR Green/ROX qPCR Master Mix (Cat# PA-012). Five replicate arrays were run for each sample at each site.</p> <title>Data normalization and analyses</title> <p>The threshold cycle number (C<sub>T</sub>) for each PCR reaction is determined by setting the same threshold value across all PCR Arrays. For data normalization in the custom PCR Arrays, <italic>POLR2A </italic>was selected as the reference endogenous control gene since it was used as the normalizer in the TaqMan Assay in the MAQC study [##REF##16964225##8##]. <italic>POLR2A </italic>was measured on each array plate in triplicate assays. The comparative C<sub>T </sub>method was used to calculate relative quantification of gene expression as described previously [##REF##11846609##21##]. The relative amount of transcripts for each gene in Sample A and Sample B was normalized to the reference gene <italic>POLR2A </italic>and calculated as follows: ΔC<sub>T </sub>is the log<sub>2 </sub>difference between the gene and the reference gene, and is obtained by subtracting the average C<sub>T </sub>of <italic>POLR2A </italic>from the C<sub>T </sub>value of the gene on a per array basis; the log<sub>2 </sub>fold change between the two samples was obtained using the formula: ΔΔC<sub>T </sub>= the average Δ C<sub>T </sub>of Sample B – the average Δ C<sub>T </sub>of Sample A, and their fold difference = 2<sup>-ΔΔ </sup>C<sub>T</sub>. For cross-platform comparison, normalized data for both Sample A and Sample B from the other gene expression analysis technologies were directly obtained from published results [##REF##16964225##8##,##REF##16964229##12##] and from the database accessible from the MAQC website [##UREF##3##20##]. For each gene, the fold change between the two samples was generated by calculating the ratio of the average of the normalized signals for all sample B replicates to the average of the normalized signals for all sample A replicates. The sample B/sample A (B/A) fold changes (log<sub>2</sub>) for all genes common between the RT<sup>2 </sup>Profiler PCR Arrays and another platform were compared and subjected to bivariate regression analysis, and Pearson correlation coefficients (R) were computed for each cross-platform comparison. For inter-site and cross-instrument comparison, data normalization in the Human Drug Metabolism RT<sup>2 </sup>Profiler™ PCR Array was carried out as instructed in the user's manual using the mean C<sub>T </sub>of five housekeeping genes as the reference endogenous control for each array plate. The ΔΔC<sub>T </sub>and fold-change values between the two RNA samples for each gene on the array plate were obtained and compared between the two sites and across different real-time PCR thermal cyclers.</p> <title>Sensitivity detection and differentially expressed genes (DEG) determination</title> <p>PCR Array quantification is determined by C<sub>T </sub>numbers. A gene is considered absent when the average C<sub>T </sub>exceeds 35. The C<sub>T </sub>is marked as 35 for the Δ C<sub>T </sub>calculation when the signal is below the limit of quantitation (this is referred to as the limit of detection (LOD) in the MAQC study [##REF##16964225##8##]). A list of DEGs between the two reference RNA samples was identified using the cut-off criteria of a <italic>P </italic>value less than 0.05 as assessed by an unpaired <italic>t</italic>-test with a mean difference greater than or equal to 2-fold.</p>
<title>Results</title> <title>Assay Performance of SYBR Green Real-time PCR</title> <p>To assess the performance of SYBR Green real-time PCR, the same two reference RNA samples of the identical manufacturing lots as the MAQC study [##REF##16964225##8##,##REF##16964229##12##] were analyzed using SYBR Green RT<sup>2 </sup>Profiler PCR Arrays from SuperArray Bioscience. Sample A was Universal Human Reference RNA from Stratagene and Sample B was Human Brain Reference RNA from Ambion. In MAQC phase 1 study, 1297 genes were selected for cross-platform comparisons between microarrays and the quantitative platforms [##REF##16964225##8##]. Among these 1297 genes, 997, 244 and 205 genes were assessed by TaqMan, QuantiGene and Sta<italic>RT</italic>-PCR assays, respectively. The gene list for the custom RT<sup>2 </sup>Profiler PCR Array in this study was designed to overlap with the maximum possible number of genes for which MAQC data are available from the three quantitative platforms in the MAQC project (Table ##TAB##0##1##). A total of 90 genes were selected, among which 86 genes overlapped with TaqMan data, 76 genes overlapped with QuantiGene data, and 57 genes overlapped with Sta<italic>RT</italic>-PCR data. In addition, these 90 selected genes overlapped with data available for 89 genes on the AFX and ABI, 86 on the AG1, 88 on the GEH, and 87 on the ILM platforms. The custom PCR Array was run in six technical replicates for each of the two MAQC reference RNAs (Samples A and B). For cross-platform comparisons between SYBR Green PCR Arrays and other gene expression analysis platforms evaluated in the MAQC study, data from the other technologies were obtained from published results [##REF##16964225##8##,##REF##16964229##12##] and from the database accessible from the MAQC website [##UREF##3##20##]. The comparison of performance metrics between SYBR Green PCR Arrays and the other three quantitative platforms assessed in the MAQC study is summarized in Additional file ##SUPPL##0##1##.</p> <title>Assay precision</title> <p>The precision of the SuperArray's SYBR Green real-time PCR Arrays is assessed by the coefficient of variation (CV) and standard deviation (SD) of the replicate C<sub>T </sub>measurements (n = 6 for each assay) from both Samples A and B (Figure ##FIG##0##1## and Table ##TAB##1##2##). The average CV for the 184 mean C<sub>T </sub>values generated from all assays on the custom PCR Arrays is 0.73%. All assays on PCR Arrays have an average C<sub>T </sub>value showing a CV below 5% with 95% of the C<sub>T </sub>values having a CV of less than 2% (Figure ##FIG##0##1##). The replicate measurements for C<sub>T </sub>values below 30 show an average standard deviation within 0.20 cycle (Table ##TAB##1##2##). As noted in Figure ##FIG##0##1## and Table ##TAB##1##2##, both CV and SD tend to increase with increasing C<sub>T </sub>values (i.e. a decreasing amount of transcripts); this trend has also been observed for both TaqMan and Sta<italic>RT</italic>-PCR [##REF##16964225##8##]. The above precision assessment also includes variations from the entire process of reverse transcription-PCR as each replicate array was performed on cDNA synthesized from individual replicate reverse transcription reactions. To make a comparison with the other three quantitative technologies examined in the MAQC project, the C<sub>T </sub>values obtained from PCR Arrays were transformed from a decreasing copy number scale to an increasing copy number scale applied in the MAQC study [##REF##16964225##8##]. Using the same assumption as for TaqMan PCR where a C<sub>T </sub>value of 35 corresponds to five transcript molecules, the C<sub>T </sub>value for 6000 transcript molecules is extrapolated to be 24.78. This value is calculated to be 12.55 (log<sub>2 </sub>6000) on the common MAQC transformed log<sub>2 </sub>scale. After data transformation, the CVs for all 184 assays on PCR Arrays range from 0.18% to 74.36% with a median of 0.89%, and those for assays detecting &gt; 6000 transcript copies (n = 70) range from 0.19% to 3.16% with a median of 0.57%.</p> <title>Detection sensitivity</title> <p>PCR Array quantification is determined by C<sub>T </sub>numbers. A gene is considered absent when the average C<sub>T </sub>exceeds 35. Among the 90 genes that were assayed with SYBR Green PCR Arrays, seven genes are considered absent in sample B with the average C<sub>T </sub>&gt; 35. These genes are <italic>FOXA1</italic>, <italic>ABCC2</italic>, <italic>APOB</italic>, <italic>APOH</italic>, <italic>MMP1</italic>, <italic>RAD51 </italic>and <italic>TFF1</italic>. All of these genes were considered to be either absent or expressed at low levels as measured by TaqMan and QuantiGene [##REF##16964225##8##]. <italic>FOXA1 </italic>was also noted to be absent by Sta<italic>RT</italic>-PCR while the other six genes were not included in the measurements by this method. All genes are present in Sample A at a level above the limit of quantitation (referred to as the limit of detection (LOD) in the MAQC study [##REF##16964225##8##]) of PCR Arrays with the average C<sub>T </sub>values smaller than 35. Hence, 83 out of the 90 selected genes (92%) are present in both Sample A and Sample B.</p> <title>Assay range</title> <p>The assay range is indicated by the difference in signals on a log<sub>10 </sub>scale between the highest and the lowest expression as described previously [##REF##16964225##8##]. The assay range for the SYBR Green PCR Arrays is 8.6 with C<sub>T </sub>values ranging from 6.5 for 18S rRNA to 35 for weakly expressed genes.</p> <title>Inter-site reproducibility</title> <p>Inter-site comparison of the performance of SYBR Green PCR Arrays was carried out using the Human Drug Metabolism RT<sup>2 </sup>Profiler™ PCR Array (Cat# APH-002) from SuperArray Bioscience. For inter-site comparison, the two MAQC reference RNAs were analyzed on the PCR Array at two different locations. PCR Arrays were performed on an ABI 7500 Real-Time PCR System at Site 1 while the arrays were run on an ABI 7000 at Site 2. Five replicate arrays were run for each sample at each site. The average C<sub>T </sub>value for each assay was compared between the two sites (Figure ##FIG##1##2A## and ##FIG##1##2B##). The results show a high correlation between C<sub>T </sub>values obtained from the two sites with R = 0.969 and 0.973 for Sample A and Sample B, respectively (Figure ##FIG##1##2A## and ##FIG##1##2B##). Moreover, the inter-site comparison of fold-change results obtained from these data shows a correlation coefficient of 0.976 (Figure ##FIG##1##2C##). Since the two test sites used two different models of real-time PCR thermal cyclers from Applied Biosystems for the above comparison, we investigated if the use of different real-time PCR instruments could contribute to the differences in the C<sub>T </sub>and fold-change results. We compared the gene expression results obtained using three different real-time PCR thermal cycler models from different manufacturers (ABI 7500, Stratagene Mx3000P™ and BioRad iCycler iQ™) and found that the correlations observed among different models of real-time PCR instruments are similar to those between the two test sites (data provided in Additional file ##SUPPL##1##2##).</p> <title>Cross-platform Comparisons with Other Technologies</title> <p>To evaluate the concordance of fold changes between SYBR Green PCR Arrays and other technologies evaluated in the MAQC study, we performed regression analyses of fold differences in sample B compared to sample A for all genes common between the custom RT<sup>2 </sup>Profiler PCR Arrays and another platform. In addition, a list of differentially expressed genes (DEGs) was identified for each platform between the two reference RNA samples using the cut-off criteria of a <italic>P </italic>value less than 0.05 by an unpaired <italic>t</italic>-test with a mean difference greater than or equal to 2-fold, and the lists of DEGs from different platforms were compared.</p> <title>Fold-change correlation between PCR Arrays and other quantitative platforms</title> <p>SYBR Green RT<sup>2 </sup>Profiler™ PCR Arrays display high concordance with TaqMan, QuantiGene and Sta<italic>RT</italic>-PCR in measuring fold differences between Sample A and Sample B. Data from regression analysis show that the correlation coefficient R and slope for RT<sup>2 </sup>Profiler PCR Arrays versus TaqMan are 0.97 and 0.99, respectively; for RT<sup>2 </sup>Profiler PCR Arrays versus QuantiGene are 0.93 and 0.75, respectively; and for RT<sup>2 </sup>Profiler PCR Arrays versus Sta<italic>RT</italic>-PCR are 0.91 and 0.98, respectively (Figure ##FIG##2##3## and Table ##TAB##2##3##). RT<sup>2 </sup>Profiler PCR Arrays are shown to be best correlated with TaqMan assays (R = 0.97). When these results are compared with the MAQC data sets, similar fold-change correlations versus QuantiGene and Sta<italic>RT</italic>-PCR are noted for both RT<sup>2 </sup>Profiler PCR Arrays and TaqMan (Table ##TAB##2##3##). Fold-change results between Sample A and Sample B from all four quantitative platforms and the lists of differentially expressed genes (DEGs) generated using the pre-set criteria (fold change ≥ 2, <italic>P </italic>&lt; 0.05) are compared. PCR Arrays display a high percentage of cross-platform overlap with the other quantitative platforms, ranging from 81% to 93%.</p> <title>Fold-change correlation between PCR Arrays and microarray platforms</title> <p>Results from regression analysis showed a good linear correlation in the log<sub>2 </sub>fold change data between SYBR Green PCR Arrays and the five microarray platforms (AFX, AG1, ABI, GEH and ILM) selected for this study (Figure ##FIG##3##4## and Table ##TAB##3##4##; see Additional file ##SUPPL##2##3## for the individual scatter plot for each comparison). The correlation coefficients and linear slopes for the comparison between PCR Arrays and different microarray platforms are as follows: 0.95 and 0.62, respectively, for AFX; 0.94 and 0.78, respectively, for AG1; 0.90 and 0.61, respectively, for ABI; 0.86 and 0.56, respectively, for GEH; and 0.92 and 0.60, respectively, for ILM. The above results from these cross-platform comparisons with microarrays are very similar to those obtained from TaqMan as seen in the MAQC project (Table ##TAB##3##4##). The overlap in the lists of DEGs between PCR Arrays and each of the five microarrays is also high, yielding a 73% to 90% range.</p> <title>Discordant gene analysis</title> <p>Comparisons between the fold-change results of the SYBR Green PCR Arrays and those of the other platforms reveal discordance in a few genes (Table ##TAB##4##5##). We define a gene to be discordant if the gene exhibits changes in the opposite direction with PCR Arrays and another platform being compared, and at least one of these two platforms indicates the gene to be differentially expressed (i.e. a twofold or greater change with a p-value less than 0.05). By these criteria, two genes, <italic>FURIN </italic>and <italic>RB1</italic>, are found discordant between PCR Arrays and the other quantitative platforms (Table ##TAB##4##5##). TaqMan shows a fold change of -43.98 for <italic>FURIN </italic>but PCR Arrays indicate a fold change of 1.16 for this gene. Sta<italic>RT</italic>-PCR, QuantiGene and the five microarray platforms show a fold change ranging from -1.49 and 1.04 for <italic>FURIN</italic>. Hence, no difference in the expression of <italic>FURIN </italic>between Samples A and B is observed with any platforms except TaqMan.</p> <p>The other discordant gene, <italic>RB1</italic>, exhibits a fold change of 1.73 with PCR Arrays but a fold change of -3.09 with QuantiGene. TaqMan and Sta<italic>RT</italic>-PCR indicate fold changes of -1.92 and -1.59, respectively, for <italic>RB1</italic>. All of the five microarray platforms show negative fold changes with four of the platforms indicating a twofold or greater change. Interestingly, the <italic>RB1 </italic>gene was originally indicated by PCR Arrays to be absent (C<sub>T </sub>&gt; 35) in both samples A and B. This finding was in contrast to the results from the other three quantitative platforms where the gene was considered to be present and moderately to highly expressed in both RNA samples [##REF##16964225##8##]. This discrepancy was later found to arise from the probing location of the primers for <italic>RB1 </italic>in PCR Arrays being based on a former version of the RefSeq accession (NM 000321.1) which had been revised to the current RefSeq release (NM 000321.2) on June 9, 2006. The revised RefSeq accession revealed a two-base mismatch (from C-G to G-C) with the former version in the region where one of the <italic>RB1 </italic>primers for PCR Arrays happened to recognize. Upon repeating the assays using the <italic>RB1 </italic>primer with the revised sequence, the <italic>RB1 </italic>gene is now considered to be present with an average C<sub>T </sub>value of around 23–25 in both samples. Results generated from this new <italic>RB1 </italic>assay show a fold change of -1.75 for this gene, which is in agreement with TaqMan and Sta<italic>RT</italic>-PCR, and have replaced the data obtained from the old <italic>RB1 </italic>assay for the rest of the data analyses in this study.</p> <p>Six other discordant genes besides <italic>RB1 </italic>are noted between SYBR Green PCR Arrays and the five microarray platforms (Table ##TAB##4##5##). Of those six discordant genes, one gene with AFX, four with ABI, two with AG1, and one with GEH, display changes in the opposite direction when compared to the RT<sup>2 </sup>Profiler PCR Array. <italic>BAG1 </italic>exhibits a fold change of 1.66 with PCR Arrays but a fold change of -2.89 with AFX while the other platforms indicate the gene to be similarly expressed in both RNA samples with a minimal fold change from -1.97 to 1.85. <italic>CDK5R1 </italic>and <italic>IGFBP5 </italic>are shown to be discordant between ABI and PCR Arrays, with the directions of fold-change observed by ABI for these two genes to be opposite to those reported by all other platforms. <italic>ABCD1 </italic>and <italic>BAG4 </italic>are discordant within the five microarray platforms while the three quantitative platforms that have measured these two genes, the RT<sup>2 </sup>Profiler PCR Array, TaqMan and QuantiGene, show fold-change values in a uniform direction. <italic>JAK2 </italic>displays a fold change of -1.15 by AG1 but 2.11 by PCR Arrays. All other platforms show the same direction of fold-change as PCR Arrays; however, like AG1, all of them indicate no significant difference in <italic>JAK2 </italic>expression between the two RNA samples with a fold change smaller than two.</p>
<title>Discussion</title> <p>Although SYBR Geen PCR is a popular gene expression technique used by about half of the real-time PCR users, it was surprisingly not evaluated in the MAQC study. Therefore, in this study, we have assessed the performance of SYBR Green RT<sup>2 </sup>Profiler PCR Arrays and compared our expression profiling results of those two reference samples with the MAQC results obtained from three other traditional quantitative platforms including TaqMan assays, QuantiGene and Sta<italic>RT</italic>-PCR as well as five commercial microarrays.</p> <p>The present study demonstrates SYBR Green RT<sup>2 </sup>Profiler PCR Arrays to be a quantitative platform with high inter-run and inter-laboratory reproducibility. The average CV for the C<sub>T </sub>values generated from all assays on the custom PCR Array is found to be 0.73% with replicate measurements for C<sub>T </sub>values below 30 within 0.20 cycle average standard deviation, demonstrating a good inter-run reproducibility. When compared with the results from the other three quantitative platforms studied in the MAQC study (Additional file ##SUPPL##0##1##), the transformed data based on the corresponding universal MAQC scale give a median CV for all assays on PCR Arrays of 0.89% and that for assays detecting &gt; 6000 transcript copies of 0.57%. These respective values were reported to be 3.46% and 2.42% for TaqMan, 6.26% and 3.82% for Sta<italic>RT</italic>-PCR, and 2.16% and 2.12% for QuantiGene [##REF##16964225##8##]. As seen with TaqMan assays and Sta<italic>RT-</italic>PCR [##REF##16964225##8##], a trend of increasing CV and SD is observed with increasing C<sub>T </sub>values (i.e. decreasing amount of transcripts) which is attributable to the stochastic nature of the sample loading of transcript molecules which influences the magnitude of CV [##REF##16964225##8##]. High level of inter-site reproducibility is also demonstrated for SYBR Green PCR Arrays by inter-site comparison of C<sub>T </sub>values and fold-change results leading to correlation coefficients of 0.97 and 0.98, respectively.</p> <p>Results obtained from SYBR Green PCR Arrays show that 83 out of the 90 selected genes (92%) are considered to be present in both samples A and B, which is similar to the values reported in the MAQC study for the detection sensitivity of the other three quantitative platforms [##REF##16964225##8##]. Eighty-six percent (86%), 94% and 91% of the tested genes were above the respective LOD of the TaqMan assay (857 out of 997 tested genes), Sta<italic>RT</italic>-PCR (193 out of 205 tested genes) and QuantiGene (223 out of 244 tested genes) in both samples A and B [##REF##16964225##8##]. The assay range of PCR Arrays is 8.6 on a log<sub>10 </sub>scale, which is comparable to the assay range of 8.1 for TaqMan assay reported in the MAQC project [##REF##16964225##8##] and wider than those of the other two quantitative platforms in the MAQC study, with Sta<italic>RT</italic>-PCR and QuantiGene having an assay range of 6.8 and 4.1, respectively [##REF##16964225##8##].</p> <p>Cross-platform comparisons of gene profiling results of the two MAQC reference RNA samples illustrate a remarkably good correlation between SYBR Green RT<sup>2 </sup>Profiler PCR Arrays and other technologies tested in the MAQC studies. Specifically, PCR Arrays and the other two PCR-based methods, TaqMan and Sta<italic>RT</italic>-PCR, exhibit an exceedingly high concordance with values for their correlation coefficients and linear slopes close to 1. This result demonstrates that these three methods report very similar fold changes in gene expression between the two MAQC samples. Although high correlation coefficients are observed between PCR Arrays and the hybridization-based techniques such as QuantiGene and the microarrays, the values for the linear slope are lower, ranging from 0.56 to 0.78. These results are consistent with a compression effect on log<sub>2 </sub>fold change computed from the hybridization-based techniques which was also observed when comparisons between TaqMan PCR and QuantiGene or microarray platforms were made in the MAQC studies [##REF##16964225##8##,##REF##16964229##12##].</p> <p>SYBR Green real-time PCR Arrays demonstrate a good concordance in the differentially expressed gene list with the three quantitative technologies and five microarray platforms examined in the MAQC projects. Great overlaps in the list of DEGs are noted for PCR Arrays and TaqMan as well as the other quantitative platforms, ranging from 81% to 93%. The list of DEGs generated by PCR Arrays is also highly comparable with the five microarray platforms, with overlaps ranging from 73% to 90%. However, disparities in the expression results are observed for two genes between PCR Arrays and quantitative platforms, and for six genes in addition to <italic>RB1 </italic>between PCR Arrays and the five microarray platforms (Table ##TAB##4##5##). One possible cause for the disparities was experimentally investigated and found due to the accuracy of sequence information provided by the NCBI RefSeq database. As the design of the primers and probes for gene expression measurement is usually based on the gene sequence information from the RefSeq and non-RefSeq databases, any inaccuracies in those databases or the presence of previously unknown SNPs or splice variants, will potentially affect the accuracy of the assays. This scenario was clearly illustrated by the SYBR Green assay for <italic>RB1 </italic>gene in this study where the discovery of a two-base mismatch in one of the <italic>RB1 </italic>primers was made with the current RefSeq accession. Since the RefSeq database is frequently being updated to improve the accuracy of its gene sequence information, it is important to have the sequences of the primers and probes checked periodically against the most updated version of the RefSeq database in order to ensure the accuracy of the assays.</p> <p>Because we have limited access to the information on the exact sequences of the primers and probes used by other technologies and platforms, it is difficult to investigate further all of the potential causes of the discordances between platforms by performing experiments. Another possible explanation for the discordance may be due to a difference in the interrogative regions [##REF##16964225##8##]. The MAQC study provides the information on the approximate regions being probed in individual assays for all tested platforms in the form of the distance from the most 3' location of each assay to the 3' end of the gene [##REF##16964229##12##]. Comparisons of the detection regions between different technologies are listed in Table ##TAB##5##6## and shown in Figure ##FIG##4##5##. <italic>FURIN </italic>is found to be differentially expressed by TaqMan assays [##REF##16964225##8##] but not by other platforms; this appears to be due to a difference in the regions being probed, with the TaqMan assay interrogating a region that is closer to the 5' end of the gene than those of other platforms [##REF##16964225##8##] (Table ##TAB##5##6## and Figure ##FIG##4##5##). The same explanation could also be suggested for <italic>RB1</italic>, <italic>JAK2</italic>, <italic>BAG1 </italic>and <italic>BAG4</italic>. For <italic>RB1 </italic>and <italic>JAK2</italic>, the locations being probed for PCR Arrays are closer to the 5' end of these genes than those of other platforms. Similarly, the discordance against other technologies in the fold-change results for <italic>BAG1 </italic>with AFX, and <italic>BAG4 </italic>with ABI and AG1, might be due to the fact that these platforms interrogate a region closer to the 3' end of these two genes than all other platforms.</p> <p>The discrepancies in the expression results for the remaining three genes (<italic>ABCD1</italic>, <italic>CDK5R1 </italic>and <italic>IGFBP5</italic>) cannot simply be explained by the difference in probe locations. Interestingly, while these three genes display discordance among the microarray platforms, all four quantitative platforms show comparable results. This has led to the suggestion that disagreements between microarray platforms may be due to cross-hybridization of the probes on the arrays with other targets [##REF##16964225##8##]. As in the case of <italic>RB1</italic>, the underlying reason for the discordance caused by different detection regions among technologies and platforms may be associated with the degree of accuracy in the sequence information being varied at different regions due to the continuous discoveries of previously unknown SNPs and spliced variants. Hence, even if the primers or probes from different platforms recognize the same region, there is a possibility that they may detect different spliced variants or transcripts with different SNPs. Again, frequently updating the primer and probe design with the most updated releases of RefSeq and non-RefSeq databases is essential for the success of all of these technologies.</p> <p>Disagreements between different platforms may also arise from low detection signals for some genes. Among the discordant genes noted in Table ##TAB##4##5##, <italic>BAG4 </italic>and <italic>CDK5R1 </italic>are considered by all the five microarray platforms to be either absent or having relatively low expression in at least one of the two RNA samples. This trend with discordance occurring more frequently with low expressers was also noted in the MAQC study [##REF##16964225##8##].</p>
<title>Conclusion</title> <p>In summary, SYBR Green real-time PCR Arrays produce gene profiling differences between the two MAQC reference RNA samples that are highly concordant with those generated by other quantitative gene expression analysis and microarray platforms. PCR Arrays deliver results comparable to those of high-density microarrays. Moreover, it yields results similar to those of TaqMan Gene Expression Assays, a widely accepted method for validating microarray results, and other more complicated and more expensive quantitative methods tested by the MAQC project. Hence, SYBR Green PCR Array is a quantitative platform suitable for microarray data validation.</p>
<p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0"/>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p> <title>Background</title> <p>The MicroArray Quality Control (MAQC) project evaluated the inter- and intra-platform reproducibility of seven microarray platforms and three quantitative gene expression assays in profiling the expression of two commercially available Reference RNA samples (<bold><italic>Nat Biotechnol </italic></bold>24:1115-22, 2006). The tested microarrays were the platforms from Affymetrix, Agilent Technologies, Applied Biosystems, GE Healthcare, Illumina, Eppendorf and the National Cancer Institute, and quantitative gene expression assays included TaqMan<sup>® </sup>Gene Expression PCR Assay, Standardized (Sta) <italic>RT</italic>-PCR™ and QuantiGene<sup>®</sup>. The data showed great consistency in gene expression measurements across different microarray platforms, different technologies and test sites. However, SYBR<sup>® </sup>Green real-time PCR, another common technique utilized by half of all real-time PCR users for gene expression measurement, was not addressed in the MAQC study. In the present study, we compared the performance of SYBR Green PCR with TaqMan PCR, microarrays and other quantitative technologies using the same two Reference RNA samples as the MAQC project. We assessed SYBR Green real-time PCR using commercially available RT<sup>2 </sup>Profiler™ PCR Arrays from SuperArray, containing primer pairs that have been experimentally validated to ensure gene-specificity and high amplification efficiency.</p> <title>Results</title> <p>The SYBR Green PCR Arrays exhibit good reproducibility among different users, PCR instruments and test sites. In addition, the SYBR Green PCR Arrays have the highest concordance with TaqMan PCR, and a high level of concordance with other quantitative methods and microarrays that were evaluated in this study in terms of fold-change correlation and overlap of lists of differentially expressed genes.</p> <title>Conclusion</title> <p>These data demonstrate that SYBR Green real-time PCR delivers highly comparable results in gene expression measurement with TaqMan PCR and other high-density microarrays.</p>
<title>Authors' contributions</title> <p>EA designed and carried out the cross-platform comparative study, analyzed the results, and drafted the manuscript. YS and QZ prepared the materials for the experiments in this study. JW prepared the purified PCR products and carried out the standard curve experiments, and performed the experiments for the inter-site and inter-instrument comparative study. BN, SLD and LG participated in designing and carrying out the experiments for the inter-site comparative study. JY conceived the study, participated in its design and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.</p> <title>Supplementary Material</title>
<title>Acknowledgements</title> <p>This document has been reviewed in accordance with United States Food and Drug Administration (FDA) policy and approved for publication. Approval does not signify that the contents necessarily reflect the position or opinions of the FDA nor does mention of trade names or commercial products constitute endorsement or recommendation for use. The findings and conclusions in this report are those of the author(s) and do not necessarily represent the views of the FDA.</p>
<fig position="float" id="F1"><label>Figure 1</label><caption><p><bold>Assay precision of SYBR Green RT<sup>2 </sup>Profiler PCR Arrays.</bold> The plot shows the coefficient of variation for each average C<sub>T </sub>value. A total of 184 average C<sub>T </sub>measurements were obtained from Sample A and Sample B. Each average C<sub>T </sub>value and its coefficient of variation were calculated from the result of 6 replicate assays.</p></caption></fig> <fig position="float" id="F2"><label>Figure 2</label><caption><p><bold>Inter-site comparison of RT<sup>2 </sup>Profiler PCR Arrays.</bold> Threshold cycle measurements and fold-change results have been obtained using the two MAQC reference RNAs analyzed on the Human Drug Metabolism RT<sup>2 </sup>Profiler PCR Array (APH-002) using different real-time PCR thermal cyclers at two different sites. Five replicate arrays were run for each sample at each site, and the average C<sub>T </sub>value for each assay is compared between the two sites in panels A and B. The results show a high correlation between C<sub>T </sub>values obtained from the two sites. Panel C shows the inter-site comparison of fold-change results obtained from these data, indicating a correlation coefficient of 0.976.</p></caption></fig> <fig position="float" id="F3"><label>Figure 3</label><caption><p><bold>Cross-platform comparison between SYBR Green RT<sup>2 </sup>Profiler PCR Arrays and the three quantitative platforms.</bold> The concordance of fold-changes between the PCR Arrays and the three quantitative platforms was evaluated by regression analysis of fold differences in sample B compared to sample A. Data were normalized against <italic>POLR2A </italic>for RT<sup>2 </sup>Profiler PCR Arrays and TaqMan, and against beta-actin for Sta<italic>RT</italic>-PCR. The sample B/sample A (B/A) fold changes (log<sub>2</sub>) for each gene common between RT<sup>2 </sup>Profiler PCR Arrays and another platform were subjected to bivariate analysis. The dashed line on each graph represents the ideal slope of 1.0. The solid lines show a linear regression fit.</p></caption></fig> <fig position="float" id="F4"><label>Figure 4</label><caption><p><bold>Cross-platform comparison between SYBR Green RT<sup>2 </sup>Profiler PCR Arrays and microarray platoforms.</bold> The concordance of fold-changes between the PCR Arrays and microarray platforms was evaluated by regression analysis of fold differences in sample B compared to sample A. Data were normalized against <italic>POLR2A </italic>for RT<sup>2 </sup>Profiler PCR Arrays. The sample B/sample A (B/A) fold changes (log<sub>2</sub>) for each gene common between RT<sup>2 </sup>Profiler PCR Arrays and another platform were subjected to bivariate analysis. The dashed line on the graph represents the ideal slope of 1.0. Each solid line represents the linear regression fit. The numbers in brackets indicate the number of common genes between RT<sup>2 </sup>Profiler PCR Arrays and each microarray platform. The individual scatter plot for each comparison is provided in Additional file ##SUPPL##2##3##.</p></caption></fig> <fig position="float" id="F5"><label>Figure 5</label><caption><p><bold>Comparison of the probing locations for the discordant genes between RT<sup>2 </sup>Profiler PCR Arrays and other gene expression measurement platforms in the MAQC phase 1 study.</bold> The diagram illustrates the most 3' interrogative locations of the assays of different platforms for the eight discordant genes discussed in the text and shown in Table 6. The black lines represent, from left to right, the 5' to 3' position of the genes, each indicated with the length of the transcript. The assay location of each platform is indicated by a letter above the black line (A = RT<sup>2 </sup>Profiler PCR Array; B = TaqMan; C = Sta<italic>RT</italic>-PCR; D = QuantiGene; E = AFX; F = ABI; G = AG1; H = GEH; and I = ILM). Assays with discordant results compared to those of PCR Arrays are highlighted in grey.</p></caption></fig>
<table-wrap position="float" id="T1"><label>Table 1</label><caption><p>Gene list of the custom SYBR Green RT<sup>2 </sup>Profiler PCR Array showing the overlaps with the other three quantitative gene analysis technologies</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>Probes present in all three quantitative platforms</bold></td><td align="center"><bold>Gene Symbol</bold></td><td align="center"><bold>TaqMan and QuantiGene</bold></td><td align="center"><bold>Gene Symbol</bold></td><td align="center"><bold>TaqMan and Sta<italic>RT</italic>-PCR</bold></td><td align="center"><bold>Gene Symbol</bold></td></tr></thead><tbody><tr><td align="center">1</td><td align="center"><italic>ABCD2</italic></td><td align="center">42</td><td align="center"><italic>ABCC2</italic></td><td align="center">72</td><td align="center"><italic>ANXA1</italic></td></tr><tr><td align="center">2</td><td align="center"><italic>ADM</italic></td><td align="center">43</td><td align="center"><italic>ABCD1</italic></td><td align="center">73</td><td align="center"><italic>ARHGDIB</italic></td></tr><tr><td align="center">3</td><td align="center"><italic>AES</italic></td><td align="center">44</td><td align="center"><italic>ABCG5</italic></td><td align="center">74</td><td align="center"><italic>ATP1B2</italic></td></tr><tr><td align="center">4</td><td align="center"><italic>ANXA5</italic></td><td align="center">45</td><td align="center"><italic>AFP</italic></td><td align="center">75</td><td align="center"><italic>CDK8</italic></td></tr><tr><td align="center">5</td><td align="center"><italic>BAG1</italic></td><td align="center">46</td><td align="center"><italic>APC</italic></td><td align="center">76</td><td align="center"><italic>DAP </italic></td></tr><tr><td align="center">6</td><td align="center"><italic>BRCA2</italic></td><td align="center">47</td><td align="center"><italic>APOB</italic></td><td align="center">77</td><td align="center"><italic>ERCC5</italic></td></tr><tr><td align="center">7</td><td align="center"><italic>CCNA2</italic></td><td align="center">48</td><td align="center"><italic>APOH</italic></td><td align="center">78</td><td align="center"><italic>GSTP1</italic></td></tr><tr><td align="center">8</td><td align="center"><italic>CDK9</italic></td><td align="center">49</td><td align="center"><italic>BAG4</italic></td><td align="center">79</td><td align="center"><italic>GSTT1</italic></td></tr><tr><td align="center">9</td><td align="center"><italic>CDKN1A</italic></td><td align="center">50</td><td align="center"><italic>CCL20</italic></td><td align="center">80</td><td align="center"><italic>NTRK3</italic></td></tr><tr><td align="center">10</td><td align="center"><italic>CYP1B1</italic></td><td align="center">51</td><td align="center"><italic>CDK5R1</italic></td><td align="center">81</td><td align="center"><italic>PCNA</italic></td></tr><tr><td align="center">11</td><td align="center"><italic>DAD1</italic></td><td align="center">52</td><td align="center"><italic>CHEK1</italic></td><td align="center">82</td><td align="center"><italic>PPP3CA</italic></td></tr><tr><td align="center">12</td><td align="center"><italic>DPP4</italic></td><td align="center">53</td><td align="center"><italic>CHGA</italic></td><td align="center">83</td><td align="center"><italic>PTCH </italic></td></tr><tr><td align="center">13</td><td align="center"><italic>FADD</italic></td><td align="center">54</td><td align="center"><italic>COL1A1</italic></td><td align="center">84</td><td align="center"><italic>TP53</italic></td></tr><tr><td align="center">14</td><td align="center"><italic>FGF9</italic></td><td align="center">55</td><td align="center"><italic>CSNK2A2</italic></td><td/><td/></tr><tr><td align="center">15</td><td align="center"><italic>FOXA1</italic></td><td align="center">56</td><td align="center"><italic>DRD5</italic></td><td align="center"><bold>House Keeping Genes</bold></td><td align="center"><bold>Gene Symbol</bold></td></tr><tr><td align="center">16</td><td align="center">FURIN</td><td align="center">57</td><td align="center">EDN1</td><td align="center">85</td><td align="center">B2M</td></tr><tr><td align="center">17</td><td align="center"><italic>G6PD</italic></td><td align="center">58</td><td align="center">EGFR</td><td align="center">86</td><td align="center"><italic>ACTB</italic></td></tr><tr><td align="center">18</td><td align="center"><italic>ICAM1</italic></td><td align="center">59</td><td align="center"><italic>EIF2AK2</italic></td><td align="center">87</td><td align="center"><italic>GAPDH</italic></td></tr><tr><td align="center">19</td><td align="center"><italic>IGF2R</italic></td><td align="center">60</td><td align="center"><italic>ERBB4</italic></td><td align="center">88</td><td align="center"><italic>HPRT1</italic></td></tr><tr><td align="center">20</td><td align="center"><italic>IGFBP2</italic></td><td align="center">61</td><td align="center"><italic>GFAP</italic></td><td align="center">89</td><td align="center"><italic>POLR2A</italic></td></tr><tr><td align="center">21</td><td align="center"><italic>IGFBP5</italic></td><td align="center">62</td><td align="center"><italic>IGF2</italic></td><td align="center">90</td><td align="center"><italic>RPL13A</italic></td></tr><tr><td align="center">22</td><td align="center"><italic>IL8</italic></td><td align="center">63</td><td align="center"><italic>IGFBP1</italic></td><td/><td/></tr><tr><td align="center">23</td><td align="center"><italic>INPPL1</italic></td><td align="center">64</td><td align="center"><italic>JAK2</italic></td><td/><td/></tr><tr><td align="center">24</td><td align="center"><italic>JUN</italic></td><td align="center">65</td><td align="center"><italic>JUNB</italic></td><td/><td/></tr><tr><td align="center">25</td><td align="center"><italic>KCNS3</italic></td><td align="center">66</td><td align="center"><italic>KCNC1</italic></td><td/><td/></tr><tr><td align="center">26</td><td align="center"><italic>KDR</italic></td><td align="center">67</td><td align="center"><italic>MIF</italic></td><td/><td/></tr><tr><td align="center">27</td><td align="center"><italic>KIT</italic></td><td align="center">68</td><td align="center"><italic>MMP1</italic></td><td/><td/></tr><tr><td align="center">28</td><td align="center"><italic>LDLR</italic></td><td align="center">69</td><td align="center"><italic>RAD51</italic></td><td/><td/></tr><tr><td align="center">29</td><td align="center"><italic>MAP2K6</italic></td><td align="center">70</td><td align="center"><italic>STAT4</italic></td><td/><td/></tr><tr><td align="center">30</td><td align="center"><italic>MAP3K14</italic></td><td align="center">71</td><td align="center"><italic>TFF1</italic></td><td/><td/></tr><tr><td align="center">31</td><td align="center"><italic>MX2</italic></td><td/><td/><td/><td/></tr><tr><td align="center">32</td><td align="center"><italic>MYB</italic></td><td/><td/><td/><td/></tr><tr><td align="center">33</td><td align="center"><italic>MYC</italic></td><td/><td/><td/><td/></tr><tr><td align="center">34</td><td align="center"><italic>PTGS2</italic></td><td/><td/><td/><td/></tr><tr><td align="center">35</td><td align="center"><italic>RAD52</italic></td><td/><td/><td/><td/></tr><tr><td align="center">36</td><td align="center"><italic>RARA</italic></td><td/><td/><td/><td/></tr><tr><td align="center">37</td><td align="center"><italic>RB1</italic></td><td/><td/><td/><td/></tr><tr><td align="center">38</td><td align="center"><italic>SELE</italic></td><td/><td/><td/><td/></tr><tr><td align="center">39</td><td align="center"><italic>SLC2A1</italic></td><td/><td/><td/><td/></tr><tr><td align="center">40</td><td align="center"><italic>SOD1</italic></td><td/><td/><td/><td/></tr><tr><td align="center">41</td><td align="center"><italic>TYMS</italic></td><td/><td/><td/><td/></tr></tbody></table></table-wrap> <table-wrap position="float" id="T2"><label>Table 2</label><caption><p>The average standard deviation for different C<sub>T </sub>value ranges and the percentage of genes in each group (percent frequency)</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>C<sub>T </sub>Values</bold></td><td align="center"><bold>Ave SD</bold></td><td align="center"><bold>Frequency (%)</bold></td></tr></thead><tbody><tr><td align="center">10–25</td><td align="center">0.11</td><td align="center">45</td></tr><tr><td align="center">25–30</td><td align="center">0.19</td><td align="center">41</td></tr><tr><td align="center">30–35</td><td align="center">0.40</td><td align="center">11</td></tr><tr><td align="center">≥ 35</td><td align="center">0.96</td><td align="center">3</td></tr><tr><td align="center">Not Detectable</td><td align="center">0</td><td align="center">0</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T3"><label>Table 3</label><caption><p>Fold-change correlation between the four different quantitative gene expression analysis platforms</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>Correlation (R) </bold></td><td align="center"><bold>TaqMan</bold></td><td align="center"><bold>QuantiGene</bold></td><td align="center"><bold>Sta<italic>RT</italic>-PCR</bold></td></tr><tr><td align="center"><bold>(Number of genes in comparison)</bold></td><td/><td/><td/></tr></thead><tbody><tr><td align="center"><bold>RT<sup>2 </sup>Profiler PCR Array</bold></td><td align="center">0.97 (86)</td><td align="center">0.93 (76)</td><td align="center">0.91 (57)</td></tr><tr><td align="center"><bold>TaqMan</bold></td><td/><td align="center">0.90* (181)</td><td align="center">0.94* (92)</td></tr><tr><td align="center"><bold>QuantiGene</bold></td><td/><td/><td align="center">0.92* (53)</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T4"><label>Table 4</label><caption><p>Fold-change correlations between SYBR Green RT<sup>2 </sup>Profiler PCR Arrays or TaqMan assays and the five microarray platforms</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>Correlation (R) </bold></td><td align="center"><bold>AFX</bold></td><td align="center"><bold>AG1</bold></td><td align="center"><bold>ABI</bold></td><td align="center"><bold>GEH</bold></td><td align="center"><bold>ILM</bold></td></tr><tr><td align="center"><bold>(Number of genes in comparison)</bold></td><td/><td/><td/><td/><td/></tr></thead><tbody><tr><td align="center"><bold>PCR Array</bold></td><td align="center">0.95 (89)</td><td align="center">0.94 (86)</td><td align="center">0.90 (89)</td><td align="center">0.86 (88)</td><td align="center">0.92 (87)</td></tr><tr><td align="center"><bold>TaqMan*</bold></td><td align="center">0.92 (451–472)</td><td align="center">0.91 (532–595)</td><td align="center">0.85 (523–567)</td><td align="center">0.85 (660–670)</td><td align="center">0.91 (484–516)</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T5"><label>Table 5</label><caption><p>Comparison of fold-change results on the discordant genes between SYBR Green PCR Arrays and other platforms</p></caption><table frame="hsides" rules="groups"><thead><tr><td/><td align="center"><bold>RT<sup>2 </sup>Profiler PCR Array</bold></td><td align="center"><bold>TaqMan</bold></td><td align="center"><bold>Sta<italic>RT</italic>-PCR</bold></td><td align="center"><bold>QuantiGene</bold></td><td align="center"><bold>AFX</bold></td><td align="center"><bold>ABI</bold></td><td align="center"><bold>AG1</bold></td><td align="center"><bold>GEH</bold></td><td align="center"><bold>ILM</bold></td></tr></thead><tbody><tr><td align="left"><bold><italic>FURIN</italic></bold></td><td align="center">1.16</td><td align="center"><bold><underline>-43.98</underline></bold></td><td align="center">-1.49</td><td align="center">-1.42</td><td align="center">-1.21</td><td align="center">1.04</td><td align="center">-1.38</td><td align="center">N/A</td><td align="center">-1.12</td></tr><tr><td align="left"><bold><italic>RB1</italic></bold></td><td align="center">1.73*</td><td align="center">-1.92</td><td align="center">-1.59</td><td align="center"><bold><underline>-3.09</underline></bold></td><td align="center"><bold><underline>-2.23</underline></bold></td><td align="center">-1.30</td><td align="center"><bold><underline>-4.06</underline></bold></td><td align="center"><bold><underline>-2.14</underline></bold></td><td align="center"><bold><underline>-2.14</underline></bold></td></tr><tr><td align="left"><bold><italic>ABCD1</italic></bold></td><td align="center">-5.44</td><td align="center">-7.11</td><td align="center">N/A</td><td align="center">-3.83</td><td align="center">-1.45</td><td align="center"><bold><underline>2.21</underline></bold></td><td align="center">-8.25</td><td align="center"><bold><underline>2.15</underline></bold></td><td align="center">-2.41</td></tr><tr><td align="left"><bold><italic>BAG1</italic></bold></td><td align="center">1.66</td><td align="center">-1.06</td><td align="center">1.85</td><td align="center">-1.97</td><td align="center"><bold><underline>-2.89</underline></bold></td><td align="center">-1.00</td><td align="center">1.12</td><td align="center">-1.01</td><td align="center">1.18</td></tr><tr><td align="left"><bold><italic>BAG4</italic></bold></td><td align="center">2.66</td><td align="center">1.01</td><td align="center">N/A</td><td align="center">1.96</td><td align="center">1.30</td><td align="center"><bold><underline>-2.25</underline></bold></td><td align="center"><bold><underline>-2.25</underline></bold></td><td align="center">1.13</td><td align="center">1.51</td></tr><tr><td align="left"><bold><italic>CDK5R1</italic></bold></td><td align="center">45.53</td><td align="center">28.92</td><td align="center">N/A</td><td align="center">21.55</td><td align="center">18.11</td><td align="center"><bold><underline>-1.09</underline></bold></td><td align="center">1.56</td><td align="center">2.11</td><td align="center">14.26</td></tr><tr><td align="left"><bold><italic>IGFBP5</italic></bold></td><td align="center">-1.68</td><td align="center">-2.69</td><td align="center">-1.98</td><td align="center">-2.16</td><td align="center">-2.68</td><td align="center"><bold><underline>4.11</underline></bold></td><td align="center">-3.26</td><td align="center">-2.42</td><td align="center">-2.37</td></tr><tr><td align="left"><bold><italic>JAK2</italic></bold></td><td align="center">2.11</td><td align="center">1.31</td><td align="center">N/A</td><td align="center">1.25</td><td align="center">1.06</td><td align="center">1.11</td><td align="center"><bold><underline>-1.15</underline></bold></td><td align="center">1.99</td><td align="center">1.06</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T6"><label>Table 6</label><caption><p>Comparison of the probing locations for the discordant genes between RT<sup>2 </sup>Profiler PCR Arrays and other gene expression measurement systems in the MAQC study</p></caption><table frame="hsides" rules="groups"><thead><tr><td/><td align="center"><bold>Gene Length (Bases)</bold></td><td align="center"><bold>RT<sup>2 </sup>Profiler PCR Array</bold></td><td align="center"><bold>TaqMan</bold></td><td align="center"><bold>Sta<italic>RT-</italic>PCR</bold></td><td align="center"><bold>QuantiGene</bold></td><td align="center"><bold>AFX</bold></td><td align="center"><bold>ABI</bold></td><td align="center"><bold>AG1</bold></td><td align="center"><bold>GEH</bold></td><td align="center"><bold>ILM</bold></td></tr></thead><tbody><tr><td align="center"><bold><italic>FURIN</italic></bold></td><td align="center">4180</td><td align="center">2060</td><td align="center"><bold><underline>4115</underline></bold></td><td align="center">1382</td><td align="center">2048</td><td align="center">65</td><td align="center">1</td><td align="center">632</td><td align="center">N/A</td><td align="center">184</td></tr><tr><td align="center"><bold><italic>RB1</italic></bold></td><td align="center">4740</td><td align="center">4268</td><td align="center">2068</td><td align="center">1742</td><td align="center"><bold><underline>2053</underline></bold></td><td align="center"><bold><underline>46</underline></bold></td><td align="center">171</td><td align="center"><bold><underline>119</underline></bold></td><td align="center"><bold><underline>1322</underline></bold></td><td align="center"><bold><underline>1471</underline></bold></td></tr><tr><td align="center"><bold><italic>ABCD1</italic></bold></td><td align="center">3616</td><td align="center">1139</td><td align="center">2317</td><td align="center">N/A</td><td align="center">2292</td><td align="center">104</td><td align="center"><bold><underline>565</underline></bold></td><td align="center">314</td><td align="center"><bold><underline>355</underline></bold></td><td align="center">102</td></tr><tr><td align="center"><bold><italic>BAG1</italic></bold></td><td align="center">3858</td><td align="center">3143</td><td align="center">3319</td><td align="center">2675</td><td align="center">2750</td><td align="center"><bold><underline>148</underline></bold></td><td align="center">3381</td><td align="center">2597</td><td align="center">2614</td><td align="center">2718</td></tr><tr><td align="center"><bold><italic>BAG4</italic></bold></td><td align="center">2182</td><td align="center">941</td><td align="center">1618</td><td align="center">N/A</td><td align="center">924</td><td align="center">584</td><td align="center"><bold><underline>52</underline></bold></td><td align="center"><bold><underline>281</underline></bold></td><td align="center">1774</td><td align="center">802</td></tr><tr><td align="center"><bold><italic>CDK5R1</italic></bold></td><td align="center">3870</td><td align="center">2823</td><td align="center">3597</td><td align="center">N/A</td><td align="center">2905</td><td align="center">41</td><td align="center"><bold><underline>2948</underline></bold></td><td align="center">2782</td><td align="center">3403</td><td align="center">689</td></tr><tr><td align="center"><bold><italic>IGFBP5</italic></bold></td><td align="center">6316</td><td align="center">4845</td><td align="center">5198</td><td align="center">5519</td><td align="center">5074</td><td align="center">411</td><td align="center"><bold><underline>4868</underline></bold></td><td align="center">418</td><td align="center">5882</td><td align="center">4740</td></tr><tr><td align="center"><bold><italic>JAK2</italic></bold></td><td align="center">5097</td><td align="center">4761</td><td align="center">1409</td><td align="center">N/A</td><td align="center">2216</td><td align="center">36</td><td align="center">612</td><td align="center"><bold><underline>1164</underline></bold></td><td align="center">316</td><td align="center">323</td></tr></tbody></table></table-wrap>
<supplementary-material content-type="local-data" id="S1"><caption><title>Additional file 1</title><p>Comparison of performance metrics among the four quantitative platforms. The table shows the performance metrics of SYBR Green RT<sup>2 </sup>Profiler PCR Array, TaqMan PCR, Sta<italic>RT</italic>-PCR and QuantiGene.</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="S2"><caption><title>Additional file 2</title><p>Correlations between real-time PCR instruments for the raw C<sub>T </sub>values and fold-change results between the two MAQC reference RNA samples analyzed on the Human Drug Metabolism RT<sup>2</sup>Profiler PCR Array (APH-002). The scatter plots show the correlation comparison among three different models of real-time PCR instruments for the raw C<sub>T </sub>and fold-change results generated from the two MAQC reference RNA samples on the Human Drug Metabolism RT<sup>2</sup>Profiler PCR Arrays.</p></caption></supplementary-material> <supplementary-material content-type="local-data" id="S3"><caption><title>Additional file 3</title><p>The concordance of fold changes between SYBR Green-based RT<sup>2</sup>Profiler PCR Array and microarray platforms. The individual scatter plots for the comparison between the RT<sup>2</sup>Profiler PCR Array and each of the five microarrays are provided for the data presented in Figure ##FIG##3##4## and Table ##TAB##3##4## of the manuscript.</p></caption></supplementary-material>
<table-wrap-foot><p>A total of 184 average C<sub>T </sub>measurements were obtained from Sample A and Sample B. Each average C<sub>T </sub>value and its standard deviation were calculated from the result of 6 replicate assays.</p></table-wrap-foot> <table-wrap-foot><p>*Correlation R values derived from the data provided by MAQC studies [##REF##16964225##8##]</p></table-wrap-foot> <table-wrap-foot><p>*The average correlation R values and the number of genes in comparison for three sites are derived from the data provided by MAQC studies [##REF##16964229##12##].</p></table-wrap-foot> <table-wrap-foot><p>Fold-change values for the above platforms other than RT<sup>2 </sup>Profiler PCR Arrays are derived from the data provided by MAQC studies [##REF##16964225##8##,##REF##16964229##12##]. A positive value for fold change indicates a higher expression while a negative value indicates a lower expression in Sample B when compared with Sample A. "N/A" means the gene was not included in the indicated platform. Discordant fold-change values compared to RT<sup>2 </sup>PCR Arrays are underlined and in bold. *The fold-change value for <italic>RB1 </italic>gene from the PCR Array using the corrected sequence is -1.75 (see text for details).</p></table-wrap-foot> <table-wrap-foot><p>The most 3' interrogative locations of the above assays are indicated by the distance to the 3' end of the corresponding gene. The probing locations of the assays for technologies other than RT<sup>2 </sup>Profiler PCR Arrays are available from the supplementary information provided by the MAQC study [##REF##16964225##8##,##REF##16964229##12##]. Assays with discordant results compared to those of PCR Arrays are underlined and in bold.</p></table-wrap-foot>
<graphic xlink:href="1471-2164-9-328-1"/> <graphic xlink:href="1471-2164-9-328-2"/> <graphic xlink:href="1471-2164-9-328-3"/> <graphic xlink:href="1471-2164-9-328-4"/> <graphic xlink:href="1471-2164-9-328-5"/>
<media xlink:href="1471-2164-9-328-S1.ppt" mimetype="application" mime-subtype="vnd.ms-powerpoint"><caption><p>Click here for file</p></caption></media> <media xlink:href="1471-2164-9-328-S2.ppt" mimetype="application" mime-subtype="vnd.ms-powerpoint"><caption><p>Click here for file</p></caption></media> <media xlink:href="1471-2164-9-328-S3.ppt" mimetype="application" mime-subtype="vnd.ms-powerpoint"><caption><p>Click here for file</p></caption></media>
[{"surname": ["Schena", "Shalon", "Davis", "Brown"], "given-names": ["M", "D", "RW", "PO"], "article-title": ["Quantitative monitoring of gene expression patterns with a complementary DNA microarray"], "source": ["Science (New York, NY)"], "year": ["1995"], "volume": ["270"], "fpage": ["467"], "lpage": ["470"]}, {"surname": ["Marshall"], "given-names": ["E"], "article-title": ["Getting the noise out of gene arrays"], "source": ["Science (New York, NY)"], "year": ["2004"], "volume": ["306"], "fpage": ["630"], "lpage": ["631"]}, {"surname": ["Knudtson", "Adams", "Grove", "Hollingshead", "Hunter", "Shipley"], "given-names": ["KL", "PS", "DS", "DJ", "TC", "GL"], "article-title": ["The ABRF NARG Real-time PCR Survey 2007: Taking the pulse of the quantitative PCR field"], "year": ["2007"]}, {"article-title": ["The MicroArray Quality Control Study"]}]
BMC Genomics. 2008 Jul 11; 9:328