Service evaluation to establish the sensitivity, specificity and additional value of broad-range 16S rDNA PCR for the diagnosis of infective endocarditis from resected endocardial material in patients from eight UK and Ireland hospitals
Infective endocarditis (IE) is a rare but severe disease in Europe, and diagnosis is established using the modified Duke criteria . Where surgically excised endocardial material is available, microbiological infection of the endocardium can be demonstrated using histopathological methods  and microbiological culture . In cases where endocardial material is not available, blood culture is the ‘gold standard’ test for the diagnosis of IE and is used alongside echocardiographic findings, serology and other clinical features consistent with IE . In recent times, broad-range bacterial polymerase chain reaction (PCR) assays have been applied to resected heart valve material, and most of the published studies show that this technique can detect the causative organism of IE in a greater number of cases than the traditional histopathological and culture-based methods . Establishing the aetiology of IE is critical for the optimal management of patients. Culture-based methods have been shown to lack both sensitivity and specificity, either due to previous antibiotic therapy or because of fastidious and difficult to culture pathogens, such as Bartonella species, Tropheryma whipplei , Coxiella burnetii , Legionella species, Mycoplasma species and the HACEK group of organisms . PCR-based testing of valve material is particularly important for establishing the aetiology of culture-negative cases of IE, but may also be positive in cases of previously treated IE . For more than 10 years, broad-range 16S rDNA PCR has been performed as part of the routine investigation of endocardial specimens in the Clinical Microbiology Laboratory at Great Ormond Street Hospital (GOSH). We present here the results of a clinical case-note review of 151 patients, from eight UK and Ireland hospitals, whose endocardial specimens were referred to the Microbiology Laboratory at GOSH for broad-range 16S rDNA PCR over a 12-year period. This service evaluation aimed to determine the sensitivity and specificity of broad-range 16S rDNA for diagnosing IE and to establish the additional diagnostic value of performing 16S rDNA PCR on culture-negative heart valve material in IE cases. 

Patients From January 2000 until December 2011, a total of 169 endocardial specimens from 151 patients from eight UK and Ireland hospitals were referred to the Microbiology Laboratory at GOSH for broad-range 16S rDNA PCR. This assay is performed as part of the routine microbiological investigation of selected endocardial specimens and the PCR results were used in patient management. One hundred and sixteen patients had a final diagnosis of IE. The proportion of male patients was 68 % and the mean patient age was 51 years (range 1–84). The proportion of patients with native valve IE was 64 %. Samples were from a highly selected group of patients chosen through local diagnostic pathways and was not a representative sample of all endocardial material sent to the laboratories. Neither antimicrobial therapy, type or duration, or timing of blood cultures before endocardial tissue was obtained was recorded. Clinical and microbiological data For this service evaluation, the following clinical and microbiological data were collected from the patients’ notes: Was an organism grown from either the valve or from blood cultures? Did any other laboratory tests indicate the presence of infection (e.g. serological and histopathological analyses)? Was the clinical diagnosis IE? Cultures Samples were submitted to culture in local laboratories according to local standards in Clinical Pathology Accreditation (CPA)-accredited laboratories as part of the routine microbiological investigations. The definition of a positive culture for this study is either culture-positive endocardial tissue or blood culture-positive with a clinically determined, significant organism. DNA extraction and broad-range PCR DNA extraction and broad-range 16S rDNA PCR was performed as previously described , with the following modifications. An additional bead-beating step was performed during DNA extraction and the PCR reaction was carried out using MolTaq 16S DNA polymerase and buffers (VH Bio, Gateshead, UK). Amplicon sequencing Sequencing reactions and analysis were performed as previously described . Mixed sequences were resolved by cloning the amplicon using the TOPO TA Cloning Kit (Life Technologies). Study design The study was registered as a Clinical Audit at GOSH on 4th July 2012 (audit number 1105) and did not require ethical approval. The referring laboratories also registered the study as a clinical audit or case note-review in accordance with local policies. This service evaluation was designed to investigate the following: Sensitivity of 16S rDNA PCR for detecting an organism in cases of culture-proven IE. Additional diagnostic value of 16S rDNA PCR in cases of culture-negative endocarditis. PPV, NPV, sensitivity and specificity of the PCR, using clinical diagnosis of IE as the reference standard. Description of the aetiology of IE from a large UK series of culture-negative cases. 

From January 2000 until December 2011, a total of 169 endocardial specimens from 151 patients from eight UK and Ireland hospitals were referred to the Microbiology Laboratory at GOSH for broad-range 16S rDNA PCR. This assay is performed as part of the routine microbiological investigation of selected endocardial specimens and the PCR results were used in patient management. One hundred and sixteen patients had a final diagnosis of IE. The proportion of male patients was 68 % and the mean patient age was 51 years (range 1–84). The proportion of patients with native valve IE was 64 %. Samples were from a highly selected group of patients chosen through local diagnostic pathways and was not a representative sample of all endocardial material sent to the laboratories. Neither antimicrobial therapy, type or duration, or timing of blood cultures before endocardial tissue was obtained was recorded. 

For this service evaluation, the following clinical and microbiological data were collected from the patients’ notes: Was an organism grown from either the valve or from blood cultures? Did any other laboratory tests indicate the presence of infection (e.g. serological and histopathological analyses)? Was the clinical diagnosis IE? 

Samples were submitted to culture in local laboratories according to local standards in Clinical Pathology Accreditation (CPA)-accredited laboratories as part of the routine microbiological investigations. The definition of a positive culture for this study is either culture-positive endocardial tissue or blood culture-positive with a clinically determined, significant organism. 

DNA extraction and broad-range 16S rDNA PCR was performed as previously described , with the following modifications. An additional bead-beating step was performed during DNA extraction and the PCR reaction was carried out using MolTaq 16S DNA polymerase and buffers (VH Bio, Gateshead, UK). 

Sequencing reactions and analysis were performed as previously described . Mixed sequences were resolved by cloning the amplicon using the TOPO TA Cloning Kit (Life Technologies). 

The study was registered as a Clinical Audit at GOSH on 4th July 2012 (audit number 1105) and did not require ethical approval. The referring laboratories also registered the study as a clinical audit or case note-review in accordance with local policies. This service evaluation was designed to investigate the following: Sensitivity of 16S rDNA PCR for detecting an organism in cases of culture-proven IE. Additional diagnostic value of 16S rDNA PCR in cases of culture-negative endocarditis. PPV, NPV, sensitivity and specificity of the PCR, using clinical diagnosis of IE as the reference standard. Description of the aetiology of IE from a large UK series of culture-negative cases. 

Patients with no IE diagnosis Thirty-five patients were not diagnosed with IE, of which 32 were PCR-negative, valve culture-negative and blood culture-negative. The remaining three patients were PCR-positive (one was also culture-positive). The organisms detected were Micrococcus luteus and Propionibacterium acnes (two patients). Sensitivity of 16S rDNA PCR for detecting organisms in culture-positive IE Forty-seven patients with a final diagnosis of IE were either blood culture- or valve culture-positive (culture-proven IE). Thirty-five of these patients were also 16S rDNA PCR-positive. PCR and culture identified the same organism in 29 of these patients (concordant results, organisms listed in Fig. ) and different organisms in six (discordant results, organisms listed in Table ). Twelve patients with positive cultures were 16S rDNA PCR-negative (Table ); organisms detected by culture only are shown in Fig. . The sensitivity of 16S rDNA PCR in culture-proven IE is up to 75 % in this series. Sensitivity and specificity of 16S rDNA PCR in patients with clinical diagnosis of IE Table shows the 16S rDNA PCR results in all 151 patients. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the 16S rDNA PCR were calculated using the clinical diagnosis of IE as the reference standard. The values obtained are as follows: sensitivity = 67 %; specificity = 91 %; PPV = 96 % and NPV = 46 %. Additional value of broad-range 16S rDNA PCR in culture-negative IE Sixty-nine patients had a final clinical diagnosis of IE but no significant organism was grown from blood or valve tissue (culture-negative IE). Forty-three of these patients were positive by 16S rDNA PCR on valve tissue; therefore, the PCR assay has provided additional diagnostic value in 62 % of culture-negative IE cases. The organisms identified in these patients are shown in Fig. . The remaining 26 culture-negative IE patients were also PCR-negative; however, two of these had organisms seen on Gram stain or by histopathological stains, and one patient had positive serology for Bartonella quintana . 

Thirty-five patients were not diagnosed with IE, of which 32 were PCR-negative, valve culture-negative and blood culture-negative. The remaining three patients were PCR-positive (one was also culture-positive). The organisms detected were Micrococcus luteus and Propionibacterium acnes (two patients). 

Forty-seven patients with a final diagnosis of IE were either blood culture- or valve culture-positive (culture-proven IE). Thirty-five of these patients were also 16S rDNA PCR-positive. PCR and culture identified the same organism in 29 of these patients (concordant results, organisms listed in Fig. ) and different organisms in six (discordant results, organisms listed in Table ). Twelve patients with positive cultures were 16S rDNA PCR-negative (Table ); organisms detected by culture only are shown in Fig. . The sensitivity of 16S rDNA PCR in culture-proven IE is up to 75 % in this series. 

Table shows the 16S rDNA PCR results in all 151 patients. The sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of the 16S rDNA PCR were calculated using the clinical diagnosis of IE as the reference standard. The values obtained are as follows: sensitivity = 67 %; specificity = 91 %; PPV = 96 % and NPV = 46 %. 

Sixty-nine patients had a final clinical diagnosis of IE but no significant organism was grown from blood or valve tissue (culture-negative IE). Forty-three of these patients were positive by 16S rDNA PCR on valve tissue; therefore, the PCR assay has provided additional diagnostic value in 62 % of culture-negative IE cases. The organisms identified in these patients are shown in Fig. . The remaining 26 culture-negative IE patients were also PCR-negative; however, two of these had organisms seen on Gram stain or by histopathological stains, and one patient had positive serology for Bartonella quintana . 

This service evaluation has demonstrated that 16S rDNA PCR detects an organism in the majority (75 %) of cases of culture-proven IE. The most frequently detected organism was Streptococcus spp., particularly the Streptococcus mitis group. Further identification of the species within this group is problematic due to the high level of similarity in 16S rDNA sequences. Twelve culture-positive IE cases were PCR-negative, and coagulase-negative staphylococci (CNS) were the most frequently detected organism in this group. PCR may have failed to detect the causative organism in these cases because resection was performed some time after the blood cultures were taken. False-positive culture results are also a possibility. In six cases that were positive by culture, the PCR identification was discordant (Table ). Five of these patients would appear to have discrepant results because of inaccurate identification of the organism by phenotypic methods. However, patient 76 would appear to have truly discordant results, but the Streptococcus spp. identified by PCR appears to be the most likely cause of IE, and the organisms grown on culture are more likely to be contaminants. The sensitivity, specificity, PPV and NPV of the 16S rDNA PCR were calculated using clinical IE as the reference standard. The sensitivity (67 %) and NPV (46 %) demonstrate that PCR does not detect an organism in all clinically diagnosed cases of IE; this could be due to treated IE, sample taken late in infection, fungal IE or bacterial species that are not detected by this 16S rDNA PCR. However, the high specificity (91 %) and PPV (96 %) are likely to be biased because the clinical diagnosis of IE in some cases may have been partially based on the positive PCR result. The 16S rDNA PCR assay has provided additional diagnostic value in 43/69 (62 %) of culture-negative IE cases. In addition to this, we have provided data on the causative organism in culture-negative IE cases from this series of UK and Ireland patients. These data were not previously available from any other published studies. The most frequently detected organism in culture-negative IE was Streptococcus spp., but no single species predominated. A wide range of bacterial species were detected by 16S rDNA PCR, including a number of unusual and fastidious organisms, such as Bartonella spp., Coxiella spp. and HACEK organisms, which is in agreement with recent data from other countries . However, what is particularly striking is that three patients had IE caused by Tropheryma whipplei ; this is consistent with other European studies, which have also reported relatively high numbers of patients with this rare organism . Such cases are unlikely to meet major criteria for IE and will only be diagnosed by PCR, because, unlike Bartonella spp. and Coxiella spp., serological tests are not available. A previous study has already demonstrated that specific PCR assays for Tropheryma whipplei , Bartonella spp. and Coxiella burnetii are more sensitive than broad-range 16S rDNA for diagnosing culture-negative IE from blood samples  and are particularly important for diagnosing culture and serology-negative IE when valvular material is not available. The data from our series indicate that a specific PCR assay for Streptococcus spp. would also be valuable. In conclusion, all explanted heart valves sent for routine clinical microbiology investigations should be examined by PCR when cultures are negative, as this increases the diagnostic yield. The impact of positive 16S rDNA PCR results in cases of culture-negative IE and the potential cost savings associated with this (e.g. by rationalising antibiotics) have not been addressed, as they are outside the scope of this service evaluation. However, this type of analysis is important for understanding the real benefit of what is perceived to be an expensive laboratory investigation. 

