<title>Background</title> <p>Although systematic reviews are a valuable tool in the synthesis of evidence, they should be interpreted with caution [##REF##11566835##1##]. The sharp rise in the number of systematic reviews published over the past decades has led to a concomitant increase in discordant results and conclusions between reviews on the same research question [##REF##9164400##2##, ####REF##11295917##3##, ##REF##11154541##4##, ##REF##8606325##5####8606325##5##]. This has caused disputes between researchers and created difficulties for decision-makers in selecting appropriate health care interventions. Among other things, discordance between reviews may be caused by differences in primary study selection [##UREF##0##6##] due to variations in literature search strategies, selection criteria, and the application of selection criteria [##REF##9164400##2##].</p> <p>The Institute for Quality and Efficiency in Health Care (Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen, IQWiG) conducted a systematic review on the effectiveness and safety of negative pressure wound therapy (NPWT) versus conventional wound therapy in patients with acute or chronic wounds. The NPWT technique aims to accelerate wound healing by placing a foam dressing in the wound and applying controlled subatmospheric pressure [##REF##9188971##7##]. The German-language full review and a rapid report on studies subsequently published are available on the IQWiG website [##UREF##1##8##,##UREF##2##9##]. In addition, an English-language journal article has been published [##REF##18283145##10##].</p> <p>An additional retrospective analysis was conducted in order to compare different systematic reviews on NPWT regarding their agreement in primary study selection. The review methodologies were also compared.</p>
<title>Methods</title> <p>For the IQWiG review and rapid report, 4 bibliographic databases (MEDLINE, EMBASE, The Cochrane Library, and CINAHL) were searched to identify systematic reviews and primary studies on NPWT versus conventional wound therapy in patients with acute or chronic wounds. All databases were searched from inception to May 2005 (review) and between May 2005 and December 2006 (rapid report).</p> <p>The multi-source search strategy and literature screening are described in detail elsewhere [##UREF##1##8##]. Eligible primary studies were randomised controlled trials (RCTs), as well as non-randomised controlled trials (non-RCTs) with a concurrent control group. Studies were classified as non-randomised if allocation concealment was viewed as inadequate [##UREF##3##11##]. Quasi-randomised studies were therefore classified as non-randomised. The intervention was categorised as NPWT if a medical device system identical or comparable to the vacuum-assisted closure (V.A.C.<sup>®</sup>) system was used. Studies were considered to be eligible only if publicly accessible full-text articles or other comprehensive study information (e.g. clinical study reports provided by manufacturers) were available.</p> <p>For the present analysis, an identical and sufficiently large primary study pool, i.e. the pool of studies that could potentially be identified by all reviews, was required to ensure comparability between reviews. As a preliminary analysis showed that early reviews merely included 2 to 4 primary studies, only reviews published in or after December 2004 were considered.</p> <p>Eligible reviews had to include data from completed primary studies on NPWT. Reviews were classified as systematic reviews (as opposed to narrative reviews) if multiple sources were searched (at least MEDLINE and The Cochrane Library), and the search strategy (including the search date) was documented [##UREF##4##12##].</p> <p>Primary studies were eligible for inclusion only if they had been published before June 2004 and if the entry date of a study in a database preceded the date of the literature search of any systematic review analysed.</p> <p>The methodology and primary study selection between reviews were compared, and the overall agreement in study selection between reviews was reported.</p> <p>Only a summary of the reviews' quality assessment of primary studies and their conclusions on the effectiveness of NPWT is presented here, as the main focus of this paper was to compare the agreement in primary study selection between reviews.</p>
<title>Results</title> <p>The flow charts of the selection of systematic reviews and primary studies are presented in Figures ##FIG##0##1## and ##FIG##1##2##. Sixteen primary studies published before June 2004 were assessed in the present analysis [##REF##11156090##13##, ####REF##7837756##14##, ##REF##12467816##15##, ##REF##14534844##16##, ##REF##12142596##17##, ##REF##9523602##18##, ##REF##14758212##19##, ##UREF##5##20##, ##REF##15082354##21##, ##REF##11189545##22##, ##REF##14974959##23##, ##REF##12146992##24##, ##REF##15168289##25##, ##REF##12496568##26##, ##REF##12625392##27##, ##REF##15168277##28####15168277##28##]. A total of 5 eligible systematic reviews (the IQWiG review and 4 other systematic reviews) published between December 2004 and July 2006 were analysed [##UREF##6##29##, ####UREF##7##30##, ##REF##16802559##31##, ##UREF##8##32####8##32##]. Details on all reviews identified are shown in Table ##TAB##0##1##; the main reason for exclusion was failure to qualify as a systematic review.</p> <p>The methods applied in the reviews included are presented in Tables ##TAB##1##2## and ##TAB##2##3##. Regarding bibliographic databases, all reviews used MEDLINE, EMBASE, and The Cochrane Library, but the nursing database CINAHL was used only by IQWiG. The search terms applied varied between reviews. Regarding study design, the IQWiG review [##UREF##1##8##], as well as the reviews by Costa 2005 [##UREF##7##30##] and Pham 2006 [##REF##16802559##31##] considered both RCTs and non-RCTs, while the reviews by Samson 2004 [##UREF##6##29##] and OHTAC 2006 [##UREF##8##32##] took only RCTs into account.</p> <p>As the comparison of systematic reviews based on published information showed numerous inconsistencies, we decided to contact the authors of the other reviews for clarification (this was not initially planned). We received responses from all authors approached (or from other researchers at the publishing institutions). After reviewing the responses, it became clear that reporting styles for excluded studies differed between reviews. For example, the response by OHTAC stated that "it must be noted that we do not routinely cite or analyse studies that have been excluded from our EBAs (evidence-based analyses)" [personal communication]. It consequently became apparent that some studies we had initially classified as "not identified by other reviews" had actually been identified but excluded, and subsequently not reported. We therefore changed the classification of studies not cited in reviews to "not reported". In addition, the authors of reviews corrected or clarified published information (their comments are included in Tables ##TAB##3##4##, ##TAB##4##5##, ##TAB##5##6##); in this context we thank them for generously providing information.</p> <p>Details of the primary study selection are presented according to the study classification by IQWiG in Tables ##TAB##3##4## (5 RCTs), ##TAB##4##5## (7 non-RCTs), and ##TAB##5##6## (3 non-RCTs and 1 RCT excluded by IQWiG, but included by at least one other review).</p> <p>The reviews included between 4 and 13 eligible primary studies published before June 2004. With regard to RCTs, the overall agreement in primary study selection between reviews was 96% (24 of 25 options) (Table ##TAB##4##5##).</p> <p>More variations were noted concerning the selection of non-RCTs; the agreement between reviews considering both RCTs and non-RCTs was 57% (12 of 21 options). Of the 9 mismatches, according to published information and the information provided by authors or institutions, 7 were due to different inclusion criteria (e.g. language criteria), and 2 were due to variations in study classification (Table ##TAB##4##5##).</p> <p>Four studies (3 non-RCTs and 1 RCT) were excluded by IQWiG but included by at least one other review. The reasons for exclusion were as follows: the study included historical controls (2 non-RCTs [##REF##11156090##13##,##REF##12496568##26##]); the intervention applied was not comparable to the NPWT technique (1 non-RCT [##REF##7837756##14##]); or an additional intervention was applied that may have affected the study outcomes (1 RCT [##REF##14758212##19##]) (Table ##TAB##5##6##). Substantial variations in study selection were shown between reviews.</p> <p>Only the IQWiG review included a meta-analysis (changes in wound size), which indicated an advantage in favour of NPWT. However, only a few trials with small sample sizes were analysed.</p> <p>The overall quality of the primary studies was assessed in 3 of 5 reviews, and was in general classified as poor. All reviews concluded that the evidence base on NPWT was insufficient (Table ##TAB##6##7##).</p>
<title>Discussion</title> <p>An analysis of 5 systematic reviews on NPWT showed differences (which mainly concerned non-RCTs) in the citation and selection of primary studies.</p> <p>We would like to emphasize that by presenting these differences, we are not implying that the 4 other reviews identified were of inferior quality compared with the IQWiG review. Variations in the number of primary studies identified and selected are not surprising, as the reviews used different search strategies, literature sources, and inclusion criteria. After correspondence with the authors of the other reviews, many differences regarding the citation of primary studies could be attributed to different reporting styles (citation or non-citation) for excluded studies, not to the non-detection of studies in the literature searches.</p> <p>Most differences in study selection resulted from variations in inclusion and exclusion criteria. For example, due to language restrictions, studies published in German were selected by IQWiG, but not by other reviews. Opinions on the relevance of language bias differ; a study published in 1997 comparing English and German-language publications concluded that English-language bias may be introduced in systematic reviews if they include only trials reported in English [##REF##9251637##33##]. In contrast, a more recent publication noted that, for conventional medicinal interventions, language restrictions did not appear to bias estimates of effectiveness [##REF##14670218##34##]. Moreover, for German-language publications on RCTs, it has been reported that German medical journals no longer play a role in the dissemination of trial results [##REF##16824217##35##].</p> <p>The inclusion criteria for primary study design were also inconsistent; 3 reviews (including the IQWiG review) considered both RCTs and non-RCTs, and 2 reviews considered only RCTs. The non-RCTs included in our analysis were non-randomised controlled intervention studies. However, there are many different study types that can be seen as non-RCTs (e.g., classical observational studies). The inclusion of non-RCTs in systematic reviews is inconsistent and controversial [##UREF##9##36##, ####REF##9793791##37##, ##REF##14499048##38##, ##REF##16052184##39##, ##REF##11134917##40####11134917##40##]. The validity of systematic reviews including non-RCTs may be affected by the differing susceptibility of RCTs and non-RCTs to selection bias [##REF##16052184##39##], although it has been suggested that under certain conditions, estimates of effectiveness of non-RCTs may be valid if confounding is controlled for [##REF##11134917##40##].</p> <p>RCTs with adequately concealed allocation prevent selection bias and consequent distortions of treatment effects [##UREF##10##41##], and systematic reviews including RCTs represent the highest level of evidence for therapeutic interventions [##UREF##11##42##]. However, the quality and quantity of RCTs in surgical research is limited [##REF##12065273##43##], and it has therefore been proposed not to base this type of research on RCTs alone [##UREF##9##36##,##REF##16485067##44##]. Indeed, for some topics, non-RCTs are the only evidence available [##REF##16919159##45##].</p> <p>As for NPWT, although this treatment is widely applied in clinical practice, particularly in chronic wounds, at the time the IQWiG systematic review on NPWT was being planned only few RCTs were available; moreover, these were of poor quality [##UREF##6##29##]. However, there has been a recent increase in published RCTs, and as several of them are ongoing, more publications can be expected in the near future. One HTA agency has already changed its policy from including both RCTs and non-RCTs in systematic reviews on NPWT to one of including solely RCTs [##UREF##8##32##]. We agree with other researchers that non-RCTs should only be performed when RCTs are infeasible or unethical [##REF##14499048##38##], and that systematic reviews including non-RCTs should only be conducted when RCTs are not available [##REF##16052184##39##]. However, we emphasize that this should not be generalized to recommend excluding all kinds of non-randomised studies from systematic reviews on any topic and for any outcome of interest.</p> <p>The type of non-RCT considered also differed: IQWiG's precondition for inclusion was the existence of a concurrent control group; studies with a historical control group were excluded, as systematic bias may arise from time trends in the outcomes of study participants [##REF##14499048##38##].</p> <p>Moreover, variations in the classification of study design were noted between reviews. For example, David Sampson, one of the other review authors, stated: "In general, our definition of randomized trials was probably more inclusive than yours. We decided to be inclusive due to the small number of potentially relevant studies available at that time. Our goal was to evaluate the quality of a larger pool of included studies rather than exclude more studies, based on quality concerns, to create a smaller pool of included studies" [personal communication].</p> <p>As subjective factors are involved in the preparation of systematic reviews, inter-author variation is inevitable [##UREF##12##46##]. The evaluation of inter-author variation has shown that differences particularly affect the classification of study design [##UREF##12##46##,##UREF##13##47##]. One study showed that this was the case even when specific instructions and definitions were provided [##UREF##13##47##]. However, a recent analysis of the reproducibility of systematic reviews showed that, where authors were provided with guidelines for review preparation (including an algorithm to ensure that study designs were defined in a standardised manner), the overall reproducibility between reviews was good [##REF##18053295##48##]. This finding emphasizes the relevance of standard reporting guidelines. The CONSORT statement on improving the quality of reporting for RCTs has been available for over a decade [##REF##8773637##49##], and a revised version was published in 2001 [##REF##11308435##50##]. In contrast, guidelines for non-RCTs are more recent [##REF##14998794##51##,##REF##17938396##52##]. The introduction of uniform reporting standards for non-RCTs may improve the future quality of reporting and lead to a closer agreement in the primary study citation and selection of systematic reviews.</p> <p>Even though the reviews analysed included different numbers and types of studies, all reviews reached similar conclusions. This may be explained by the fact that the overall quality of the data on NPWT is poor.</p>
<title>Conclusion</title> <p>The citation and selection of primary studies differ between systematic reviews on NPWT, primarily with regard to non-RCTs. These differences arise from variations in review methodology and inter-author classification of study design, as well as from different reporting styles for excluded studies. Uniform methodological and reporting standards need to be applied to ensure comparability between reviews as well as the validity of their conclusions.</p>
<p>This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/2.0"/>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p> <title>Background</title> <p>Primary study selection between systematic reviews is inconsistent, and reviews on the same topic may reach different conclusions. Our main objective was to compare systematic reviews on negative pressure wound therapy (NPWT) regarding their agreement in primary study selection.</p> <title>Methods</title> <p>This retrospective analysis was conducted within the framework of a systematic review (a full review and a subsequent rapid report) on NPWT prepared by the Institute for Quality and Efficiency in Health Care (IQWiG).</p> <p>For the IQWiG review and rapid report, 4 bibliographic databases (MEDLINE, EMBASE, The Cochrane Library, and CINAHL) were searched to identify systematic reviews and primary studies on NPWT versus conventional wound therapy in patients with acute or chronic wounds. All databases were searched from inception to December 2006.</p> <p>For the present analysis, reviews on NPWT were classified as eligible systematic reviews if multiple sources were systematically searched and the search strategy was documented. To ensure comparability between reviews, only reviews published in or after December 2004 and only studies published before June 2004 were considered.</p> <p>Eligible reviews were compared in respect of the methodology applied and the selection of primary studies.</p> <title>Results</title> <p>A total of 5 systematic reviews (including the IQWiG review) and 16 primary studies were analysed. The reviews included between 4 and 13 primary studies published before June 2004. Two reviews considered only randomised controlled trials (RCTs). Three reviews considered both RCTs and non-RCTs. The overall agreement in study selection between reviews was 96% for RCTs (24 of 25 options) and 57% for non-RCTs (12 of 21 options). Due to considerable disagreement in the citation and selection of non-RCTs, we contacted the review authors for clarification (this was not initially planned); all authors or institutions responded. According to published information and the additional information provided, most differences between reviews arose from variations in inclusion criteria or inter-author study classification, as well as from different reporting styles (citation or non-citation) for excluded studies.</p> <title>Conclusion</title> <p>The citation and selection of primary studies differ between systematic reviews on NPWT, particularly with regard to non-RCTs. Uniform methodological and reporting standards need to be applied to ensure comparability between reviews as well as the validity of their conclusions.</p>
<title>Competing interests</title> <p>The authors declare that they have no competing interests.</p> <title>Authors' contributions</title> <p>StL and FP initiated the study. FP coordinated the study and conducted the literature search. StL, FP, and StS screened and analysed the retrievals. NM and FP drafted the manuscript. All authors interpreted the data and made an intellectual contribution to the manuscript. All authors reviewed and approved the final version.</p> <title>Pre-publication history</title> <p>The pre-publication history for this paper can be accessed here:</p> <p><ext-link ext-link-type="uri" xlink:href="http://www.biomedcentral.com/1471-2288/8/41/prepub"/></p>
<title>Acknowledgements</title> <p>All work on this analysis was funded by IQWiG, an independent non-profit and non-government organisation that evaluates the quality and efficiency of health care services in Germany. IQWiG receives its commissions from the Federal Joint Committee (the decision-making body of the self-administration of the German health care services) as well as from the Federal Ministry of Health, and also undertakes projects and research work on its own initiative. All work on this study was supported by IQWiG within the framework of a systematic review on NPWT performed by IQWiG. Three authors (FP, NM, StL) are IQWiG full-time employees; one author (StS) works as an external expert for IQWiG.</p>
<fig position="float" id="F1"><label>Figure 1</label><caption><p>Flow chart of the review selection.</p></caption></fig> <fig position="float" id="F2"><label>Figure 2</label><caption><p>Flow chart of the study selection.</p></caption></fig>
<table-wrap position="float" id="T1"><label>Table 1</label><caption><p>Identified pool of potentially relevant reviews</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="center"><bold>No</bold></td><td align="left"><bold>Publication</bold></td><td align="center"><bold>Documentation</bold>*</td><td align="center"><bold>Multiple sources</bold><sup>†</sup></td><td align="center"><bold>Included</bold><sup>‡</sup></td><td align="left"><bold>Reason for exclusion</bold></td></tr></thead><tbody><tr><td align="center">1</td><td align="left">Andros 2006 [##REF##17007488##53##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Consensus statement</td></tr><tr><td align="center">2</td><td align="left">Brem 2006 [##REF##16799388##54##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Guidelines</td></tr><tr><td align="center">3</td><td align="left">Costa/MUHC TAU 2005 [##UREF##7##30##]<sup>§</sup></td><td align="center">+</td><td align="center">+</td><td align="center">+</td><td align="left">-</td></tr><tr><td align="center">4</td><td align="left">Evans 2001 [##REF##11279736##55##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Systematic review published before 12/2004</td></tr><tr><td align="center">5</td><td align="left">Fleck 2006 [##REF##17199763##56##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Consensus statement</td></tr><tr><td align="center">6</td><td align="left">Fisher 2003 [##UREF##14##57##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Narrative review</td></tr><tr><td align="center">7</td><td align="left">Gray 2004 [##REF##15867737##58##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Systematic review published before 12/2004</td></tr><tr><td align="center">8</td><td align="left">Hayes Inc. 2003 [##UREF##15##59##]</td><td/><td/><td align="center">-</td><td align="left">Not publicly accessible; published before 12/2004</td></tr><tr><td align="center">9</td><td align="left">Higgins 2003 [##UREF##16##60##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Systematic review published before 12/2004</td></tr><tr><td align="center">10</td><td align="left">Mayer 2002 [##UREF##17##61##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Not publicly accessible; published before 12/2004</td></tr><tr><td align="center">11</td><td align="left">Mendonca 2006 [##REF##17199762##62##]</td><td align="center">-</td><td align="center">+</td><td align="center">-</td><td align="left">Search date not reported</td></tr><tr><td align="center">12</td><td align="left">OHTAC 2004 [##UREF##18##63##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Update available: OHTAC 2006</td></tr><tr><td align="center">13</td><td align="left">OHTAC 2006 update [##UREF##8##32##]</td><td align="center">+</td><td align="center">+</td><td align="center">+</td><td align="left">-</td></tr><tr><td align="center">14</td><td align="left">Pham/ASERNIP-S 2003 [##UREF##19##64##]</td><td align="center">+</td><td align="center">+</td><td align="center">-</td><td align="left">Update available: Pham 2006</td></tr><tr><td align="center">15</td><td align="left">Pham/ASERNIP-S 2006 update [##REF##16802559##31##]</td><td align="center">+</td><td align="center">+</td><td align="center">+</td><td align="left">-</td></tr><tr><td align="center">16</td><td align="left">Samson/AHRQ 2004 [##UREF##6##29##]</td><td align="center">+</td><td align="center">+</td><td align="center">+</td><td align="left">-</td></tr><tr><td align="center">17</td><td align="left">Shirakawa 2005 [##REF##16301393##65##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Narrative review</td></tr><tr><td align="center">18</td><td align="left">Suess 2006 [##REF##17118227##66##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Narrative review</td></tr><tr><td align="center">19</td><td align="left">Turina 2006 [##REF##16895501##67##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Narrative review</td></tr><tr><td align="center">20</td><td align="left">Ubbink 2006 [##REF##16768278##68##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Narrative review</td></tr><tr><td align="center">21</td><td align="left">Whelan 2005 [##REF##15821461##69##]</td><td align="center">-</td><td align="center">-</td><td align="center">-</td><td align="left">Article on mechanisms of wound healing</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T2"><label>Table 2</label><caption><p>Systematic reviews on NPWT: Requirements for primary studies and publications</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="left"><bold>Interventions</bold></td><td align="left"><bold>Wound types</bold></td><td align="left"><bold>Clinical outcomes</bold></td><td align="left"><bold>Clinical study design</bold></td><td align="left"><bold>Sample size restrictions</bold></td><td align="left"><bold>Type of study information considered</bold></td><td align="left"><bold>Prespecified search for HTAs/SRs</bold></td><td align="left"><bold>Language restrictions</bold></td></tr></thead><tbody><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]</td><td align="left">a) NPWT vs. other wound healing interventions<break/>b) NPWT + standard care vs. standard wound care alone<break/>c) NPWT vs. sham intervention</td><td align="left"><italic>Chronic wounds:</italic><break/>- pressure ulcers<break/>- metabolic disorders (e.g., diabetes mellitus)<break/>- vascular insufficiency<break/>- inflammatory disorders<break/>- malignancies<break/>- infections<break/>- miscellaneous (e.g., burns)<break/><italic>Other types of wounds:</italic><break/>- acute wounds<break/>- traumatic wounds<break/>- subacute wounds<break/>- dehisced wounds<break/>- partial thickness burns<break/>- diabetic ulcers<break/>- pressure ulcers<break/>- flaps<break/>- grafts</td><td align="left"><italic>Primary outcomes:</italic><break/>- incidence of complete wound closure<break/>- time to complete closure<break/>- adverse events<break/><italic>Secondary outcomes:</italic><break/>- facilitating surgical closure<break/>- need for debridement<break/>- infections<break/>- pain<break/>- activities of daily living<break/>- quality of life<break/>- improved cosmesis<break/>- change in wound size*<break/>- transcutaneous oxygen tension*</td><td align="left">RCT</td><td align="left">None</td><td align="left">Articles</td><td align="center">-</td><td align="left">Abstracts published in English; articles without abstracts were reviewed if title indicated that articles met inclusion criteria; non-English articles were reviewed if English abstract indicated that articles met inclusion criteria.</td></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005 </bold>[##UREF##7##30##]<sup>†</sup></td><td align="left">NPWT vs. other treatment alternatives</td><td align="left">Not prespecified in detail</td><td align="left">Not prespecified in detail ("clinical effectiveness")</td><td align="left">RCT<break/>Non-RCT (clinical comparative studies)</td><td align="left">≥ 9 patients in either arm<sup>‡</sup></td><td align="left">Articles</td><td align="center">+</td><td align="left">Articles published in English or French</td></tr><tr><td align="left"><bold>IQWiG 2006 </bold>[##UREF##1##8##]</td><td align="left">NPWT vs.<break/>a) conventional wound therapy<break/>b) another type of NPWT</td><td align="left">Acute or chronic wounds</td><td align="left">- wound healing time<break/>- wound recurrence<break/>- revision operations<break/>- amputations<break/>- mortality<break/>- disease-related quality of life<break/>- activities of everyday life<break/>- pain<break/>- time spent in hospital<break/>- dressing changes<break/>- debridement procedures<break/>- adverse events<break/>- scar formation<break/>- subjective cosmetic results</td><td align="left">RCT<break/>Non-RCT with a concurrent control group (clinical controlled trials, comparative cohort studies, case control studies)</td><td align="left">None</td><td align="left">Articles<break/>Unpublished data provided by manufacturers<sup>§</sup></td><td align="center">+</td><td align="left">Language restrictions were not specified in the IQWiG review.<sup>||</sup></td></tr><tr><td align="left"><bold>Pham/ASERNI P-S 2006 update </bold>[##REF##16802559##31##]<sup>¶|</sup></td><td align="left">NPWT vs. conventional methods</td><td align="left"><italic>Particular wound types</italic>**<break/>- pressure ulcers and leg ulcers<break/>- diabetic foot ulcers and wounds<break/>- skin grafts<break/>- chronic wounds and complex/severe wounds<break/>- sternal wounds</td><td align="left">Not prespecified in detail ("efficacy and safety outcomes")</td><td align="left">RCT<break/>Non-RCT (other controlled or comparative studies and case series with consecutive patients)</td><td align="left">None</td><td align="left">Articles<break/>Conference abstracts<sup>†† </sup>Manufacturer's information<sup>††</sup></td><td align="center">-</td><td align="left">Searches were conducted without language restriction. English abstracts from non-English articles were included if they met the inclusion criteria and included efficacy and safety data.<sup>‡‡</sup></td></tr><tr><td align="left"><bold>OHTAC 2006 (update) </bold>[##UREF##8##32##]<sup>§§</sup></td><td align="left">NPWT vs. standard care</td><td align="left"><italic>Wounds, including</italic><break/>- Pressure ulcers<break/>- diabetic ulcers<break/>- sternal wounds<break/>- skin grafts</td><td align="left">Not prespecified in detail ("Is negative pressure wound therapy effective for healing wounds...?")</td><td align="left">RCT</td><td align="left">≥ 20 patients</td><td align="left">Articles<break/>("peer-reviewed, published")</td><td align="center">+</td><td align="left">Articles published in English</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T3"><label>Table 3</label><caption><p>Systematic reviews on NPWT: Search strategies</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="left"><bold>Search terms</bold></td><td align="center" colspan="5"><bold>Literature sources</bold></td><td align="center"><bold>Search date</bold>*</td></tr><tr><td/><td/><td colspan="5"><hr/></td><td/></tr><tr><td/><td/><td align="center"><bold>MEDLINE</bold></td><td align="center"><bold>EMBASE</bold></td><td align="center"><bold>The Cochrane Library</bold></td><td align="center"><bold>CINAHL</bold></td><td align="left"><bold>Others</bold></td><td/></tr></thead><tbody><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]</td><td align="left"><italic>Vacuum-assisted closure:</italic><sup>†</sup><break/>- "topical negative pressure"<break/>- "sub-atmospheric pressure therapy" (also "subatmospheric")<break/>- "sub-atmospheric pressure dressing" (also "subatmospheric")<break/>- "vacuum sealing"<break/>- "vacuum assisted closure"<break/>- "negative pressure dressing"<break/>- "negative pressure therapy"<break/>- "foam suction dressing"<break/>- "vacuum compression"<break/>- "vacuum pack"<break/>- "sealed surface wound suction"<break/>- "sealing aspirative therapy"<break/><italic>Wounds:</italic><break/>- "wound*"<break/>- "ulcer*"<break/>- "decubit*"<break/>- "incision*"<break/>- "dressing"<break/>- "free flap"<break/>- "skin graft*"<break/>- "skin transplantation"<break/>- "degloving injuries"<break/>- "degloving injury"</td><td align="center">+<break/>MEDLINE via PubMed</td><td align="center">+</td><td align="center">+<break/>CENTRAL</td><td align="center">-</td><td align="left">-<break/>Manufacturers<sup>‡</sup></td><td align="center">6/2004<sup>§</sup></td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005</bold>[##UREF##7##30##]</td><td align="left">"vacuum" or "vacuum-assisted" or "VAC" or "negative pressure" or "suction dressing" or "subatmospheric" or "sub-atmospheric" or "subatmospheric pressure" or "NPWT" and "wound healing"<sup>||</sup></td><td align="center">+<break/>PubMed</td><td align="center">+</td><td align="center">+<break/>CDSR</td><td align="center">-</td><td align="left">-<break/>HTA agencies (CHSPR, MCHP, ICES, INAHTA)<break/>- Screening of reference lists of primary studies and secondary publications</td><td align="center">3/2005</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>IQWiG 2006 </bold>[##UREF##1##8##]</td><td align="left">Search strategies according to databases (published on pages 114 to 130 of the IQWiG review [##UREF##1##8##])</td><td align="center">+<break/>Ovid MEDLINE, Ovid MEDLINE In-Process and Other Non-Indexed Citations</td><td align="center">+<break/>Ovid EMBASE</td><td align="center">+<break/>CENTRAL; CDSR; DARE; HTA</td><td align="center">+<break/>Ovid CINAHL</td><td align="left">-<break/>Trial registries (ClinicalTrials.gov, National Research Register)<break/>- Manufacturers<sup>¶</sup><break/>- Authorities<break/>- Conference proceedings<break/>- Authors of articles and conference abstracts<break/>- Screening of reference lists of secondary publications</td><td align="center">5/2005</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>Pham/ASERNIP-S 2006 update </bold>[##REF##16802559##31##]</td><td align="left">(vacuum or suction) and (wound healing), (vacuum assisted or vacuum-assisted) and (wound or closure), topical negative pressure, (subatmospheric or sub-atmospheric) and pressure</td><td align="center">+<break/>MEDLINE; PREMEDLINE; PubMed</td><td align="center">+</td><td align="center">+<break/>The Cochrane Library</td><td align="center">-</td><td align="left">-<break/>Current Contents<break/>- Trial registries (ClinicalTrials.gov, National Research Register)<break/>- The York (UK) Centre for Reviews and Dissemination<break/>- Grey literature reports<break/>- Relevant online journals<break/>- Vacuum therapy website (vacuumtherapy.co.uk)<break/>- The Internet</td><td align="center">10/2004 New RCTs: 7/2005**</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>OHTAC 2006 (update) </bold>[##UREF##8##32##]</td><td align="left">-<break/>wound healing<break/>- foot ulcer or skin ulcer or varicose ulcer or leg ulcer<break/>- wounds, non penetrating<break/>- chronic and ulcer or wound<break/>- leg or foot arterial or diabetic and ulcer or wound<break/>- suction<break/>- pressure<break/>- vacuum<break/>- vacuum assisted closure or V.A.C. therapy<break/>- negative pressure<break/>- topical negative pressure<break/>- subatmospheric pressure therapy</td><td align="center">+<break/>MEDLINE, MEDLINE In-Process and Non-Indexed Citations</td><td align="center">+</td><td align="center">+<break/>CDSR</td><td align="center">-</td><td align="left">-<break/>HTA agencies (INAHTA)<break/>- Vacuum therapy website (vacuumtherapy.co.uk)</td><td align="center">3/2006</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T4"><label>Table 4</label><caption><p>Overview of primary study selection: comparison of trials included as RCTs by IQWiG</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="center"><bold>Search date</bold></td><td align="center" colspan="5"><bold>Primary study* (database entry date)</bold><sup>†</sup></td><td align="left"><bold>Personal communication with review authors or other researchers at the publishing institutions</bold></td></tr><tr><td/><td/><td colspan="5"><hr/></td><td/></tr><tr><td/><td/><td align="center"><bold>Joseph 2000 </bold>[##UREF##5##20##]</td><td align="center"><bold>Ford 2002 </bold>[##REF##12142596##17##]</td><td align="center"><bold>Wanner 2003 </bold>[##REF##12625392##27##]</td><td align="center"><bold>Eginton 2003 </bold>[##REF##14534844##16##]</td><td align="center"><bold>Moues 2004 </bold>[##REF##14974959##23##]</td><td/></tr><tr><td/><td/><td align="center">(CIN: 2000-08; C)</td><td align="center">(M: 2002-07-27; E; C)</td><td align="center">(M: 2003-03-11; E; C)</td><td align="center">(M: 2003-10-10; E; C)</td><td align="center">(M: 2004-02-21; E; C; CIN)</td><td/></tr></thead><tbody><tr><td align="left"><bold><underline>Reviews considering RCTs and non-RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005 </bold>[##UREF##7##30##]</td><td align="center">3/2005</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT<sup>‡</sup></td><td align="center">RCT</td><td align="left"><bold>Eginton 2003</bold>. <italic>PC (V. Costa)</italic>: "We classified the study as a crossover design. If I had to discern between RCT and non-RCT, I would consider it an RCT."</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>IQWiG 2006 </bold>[##UREF##1##8##]</td><td align="center">5/2005</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="left">-</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>Pham/ASERNIP-S 2006 update/</bold>[##REF##16802559##31##]</td><td align="center">10/2004 (RCTs/non-RCTs) 7/2005 (RCTs)</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="left">-</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold><underline>Reviews considering RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]</td><td align="center">6/2004</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="left">-</td></tr><tr><td colspan="8"/></tr><tr><td align="left"><bold>OHTAC 2006 </bold>[##UREF##8##32##]</td><td align="center">3/2006</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">Not reported (PC: excluded)</td><td align="center">RCT</td><td align="left"><bold>Eginton 2003</bold>. <italic>PC (Medical Advisory Secretariat)</italic>: "This citation was retrieved from the literature search, but was excluded as only 10 patients were enrolled. The exclusion was not documented in the HTA."</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T5"><label>Table 5</label><caption><p>Overview of primary study selection: comparison of trials included as non-RCTs by IQWiG</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="center"><bold>Search date</bold></td><td align="center" colspan="7"><bold>Primary study* (Database entry date)</bold><sup>†</sup></td><td align="left"><bold>Personal communication with review authors or other researchers at the publishing institutions</bold></td></tr><tr><td/><td/><td colspan="7"><hr/></td><td/></tr><tr><td/><td/><td align="center"><bold>Genecov 1998 </bold>[##REF##9523602##18##]</td><td align="center"><bold>McCallon 2000 </bold>[##REF##11189545##22##]</td><td align="center"><bold>Doss 2002 </bold>[##REF##12467816##15##]</td><td align="center"><bold>Scherer 2002 </bold>[##REF##12146992##24##]</td><td align="center"><bold>Kamolz 2004 </bold>[##REF##15082354##21##]</td><td align="center"><bold>Schrank 2004 </bold>[##REF##15168289##25##]<sup>‡</sup></td><td align="center"><bold>Wild 2004 </bold>[##REF##15168277##28##]<sup>‡</sup></td><td/></tr></thead><tbody><tr><td/><td/><td align="center">(M: 1998-04-02; E; C)</td><td align="center">(M: 2001-02-24; C; CIN)</td><td align="center">(M: 2002-12-07; E; C)</td><td align="center">(M: 2002-07-31; E)</td><td align="center">(M: 2004-04-15; E; CIN)</td><td align="center">(M: 2004-05-29; E; C)</td><td align="center">(M: 2004-05-29; E)</td><td/></tr><tr><td align="left"><bold><underline>Reviews considering RCTs and non-RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005 </bold>[##UREF##7##30##]</td><td align="center">3/2005</td><td align="center">Non-RCT</td><td align="center">Excluded: reason not stated in review (PC: sample size too small)</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="center">Not reported (PC: excluded)</td><td align="center">Not reported (not applicable<sup>§</sup>)</td><td align="center">Not reported (not applicable<sup>§</sup>)</td><td align="left"><bold>McCallon 2000</bold>. <italic>PC (V. Costa)</italic>: "Did not meet our inclusion criteria (Appendix 1 of the report), i.e., &lt; 9 patients per study arm. This study had 5 patients in each study arm." <bold>Kamolz 2004</bold>. <italic>PC (V. Costa)</italic>: "Did not meet our inclusion criteria, i.e., did not report clinical outcomes."</td></tr><tr><td colspan="10"/></tr><tr><td align="left"><bold>IQWiG 2006 </bold>[##UREF##1##8##]</td><td align="center">5/2005</td><td align="center">Non-RCT</td><td align="center">Non-RCT: (allocation was based on alterna-tion)</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="left"><bold>Kamolz 2004</bold>. IQWiG: The primary outcome was not a clinical but a surrogate outcome. "The perfusion of both hands was measured using the technique of dynamic laser-fluorescence-videography" [##REF##15082354##21##]. IQWiG included this study because the outcome "pain" was reported in the results section ("All patients tolerated the V.A.C. application without major reports of pain and discomfort" [##REF##15082354##21##]), although the method of pain measurement was unclear.</td></tr><tr><td colspan="10"/></tr><tr><td align="left"><bold>Pham/ASERNIP-S 2006 update/</bold>[##REF##16802559##31##]<sup>||</sup></td><td align="center">10/2004 (RCTs/non-RCTs) 7/2005 (RCTs)</td><td align="center">RCT</td><td align="center">RCT</td><td align="center">Non-RCT</td><td align="center">Non-RCT</td><td align="center">Not reported (PC: excluded)</td><td align="center">Not reported (PC: excluded)</td><td align="center">Not reported (PC: excluded)</td><td align="left"><bold>Genecov 1998</bold>. <italic>PC (C. Perera)</italic>: "Allocation not stated, assumed that a valid method of randomisation had been utilised (critical appraisal in the full accelerated systematic review drew attention to this)."<break/><bold>McCallon 2000</bold>. <italic>PC (C. Perera)</italic>: "As McCallon et al described this study as an RCT, the authors of the systematic review chose to classify it in the same way, despite the fact that patients were randomised based on alteration."<break/><bold>Kamolz 2004</bold>. <italic>PC (C. Perera)</italic>: "Regarding the Kamolz study, treatment with VAC was focused upon the period immediately following trauma and thus these were not considered to be chronic, non-healing wounds which were the focus of this review and the manuscript."<break/><bold>Schrank 2004; Wild 2004</bold>. <italic>PC (C. Perera)</italic>: "Regarding the Wild and Schrank studies, these were not published in English, however you are correct that these studies were published within the search dates. Had these studies been landmark RCTs, they would have been translated and included in the review."</td></tr><tr><td colspan="10"/></tr><tr><td align="left"><bold><underline>Reviews considering only RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]</td><td align="center">6/2004</td><td align="center">Excluded: no outcomes of interest (RCT)</td><td align="center">RCT</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Excluded, as the trial was a non-RCT</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="left"><bold>Genecov 1998</bold>. <italic>PC (D. Samson)</italic>: "This study was not a parallel groups or crossover randomized trial, but it was a within-subjects experimental design in which each participant served as his/her own control by receiving Opsite wound dressing and vacuum-assisted closure to separate wounds or wound areas. Since our review was focused on the primary outcome of progress to full wound healing and this study addressed only biopsy findings, this trial was excluded for reporting a non-relevant outcome."<break/><bold>McCallon 2000</bold>. <italic>PC (D. Samson)</italic>: "Rather than excluding a marginal study like this based on quality concerns, our review selected an inclusive pool of randomized controlled trials, then evaluated study quality, noting that this trial ...used an allocation method that was probably inadequate to be considered true randomization (p. 57)."</td></tr><tr><td colspan="10"/></tr><tr><td align="left"><bold>OHTAC 2006 </bold>[##UREF##8##32##]</td><td align="center">3/2006</td><td align="center">Excluded: &lt; 20 patients (RCT)</td><td align="center">Excluded: &lt; 20 patients (RCT)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="center">Not reported (not applicable<sup>¶</sup>)</td><td align="left"><bold>Genecov 1998</bold>. <italic>PC (Medical Advisory Secretariat)</italic>: "...the Genecov study is a case series of ten subjects and was incorrectly referred to as a randomized controlled trial (RCT). The study was excluded so how it was classified is not of particular relevance."<break/><bold>McCallon 2000</bold>. <italic>PC (Medical Advisory Secretariat)</italic>: "... excluded based on the information reported in the abstract; there were less than 20 patients and the study was designated as an RCT by MEDLINE. We would not have retrieved the full text to further examine the study to determine how the randomization process was conducted given its exclusion based on number of subjects."</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T6"><label>Table 6</label><caption><p>Overview of primary study selection: comparison of trials excluded by IQWiG but included by at least one other review</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="center"><bold>Search date</bold></td><td align="center" colspan="4"><bold>Primary study* (Database entry date)</bold><sup>†</sup></td><td align="left"><bold>Personal communication with review authors or other researchers at the publishing institutions</bold></td></tr><tr><td/><td/><td colspan="4"><hr/></td><td/></tr><tr><td/><td/><td align="left"><bold>Davydov 1994 </bold>[##REF##7837756##14##]<sup>‡</sup></td><td align="left"><bold>Catarino 2000 </bold>[##REF##11156090##13##]</td><td align="left"><bold>Song 2003 </bold>[##REF##12496568##26##]</td><td align="left"><bold>Jeschke 2004 </bold>[##REF##14758212##19##]</td><td/></tr><tr><td/><td/><td align="left">(M: 1994-09-01; C)</td><td align="left">(M: 2001-01-13)</td><td align="left">(M: 2002-12-24; E)</td><td align="left">(M: 2004-02-06; E; C)</td><td/></tr></thead><tbody><tr><td align="left"><bold><underline>Reviews considering RCTs and non-RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005 </bold>[##UREF##7##30##]</td><td align="center">3/2005</td><td align="left">Not reported (not applicable<sup>§</sup>)</td><td align="left">Non-RCT</td><td align="left">Non-RCT</td><td align="left">Not reported (PC: excluded)</td><td align="left"><bold>Jeschke 2004</bold>. <italic>PC (V. Costa)</italic>: "Considered not eligible. Although negative pressure was used in one group, we considered that the main intervention studied was the Integra grafting and not vacuum-assisted closure. Moreover, since the group using VAC was a combined intervention (Integra + VAC), we were not sure if this would influence the results making it not an adequate estimate of the results with VAC alone. For these reasons the study was considered ineligible."</td></tr><tr><td colspan="7"/></tr><tr><td align="left"><bold>IQWiG 2006 </bold>[##UREF##1##8##]</td><td align="center">5/2005</td><td align="left">Excluded: not NPWT (non-RCT)<sup>||</sup></td><td align="left">Excluded: historical control (non-RCT)</td><td align="left">Excluded: historical control (non-RCT)</td><td align="left">Excluded: outcomes in the test group possibly affected by the additional intervention (RCT)</td><td align="left"><bold>Davydov 1994</bold>. A translation of the full text of this Russian-language article showed that the intervention was not a technique comparable to NPWT. Consequently, IQWiG did not include this study. No reference to a randomised allocation was found.<break/><bold>Jeschke 2004</bold>. NPWT was applied in combination with fibrin glue-anchored Integra in the test group receiving NPWT, but not in the control group receiving standard therapy; therefore the outcomes in the test group may have been affected by the additional intervention. Consequently, IQWiG did not include this study</td></tr><tr><td colspan="7"/></tr><tr><td align="left"><bold>Pham/ASERNIP-S 2006 update/</bold>[##REF##16802559##31##]<sup>¶</sup></td><td align="center">10/2004 (RCTs/non-RCTs) 7/2005 (RCTs)</td><td align="left">RCT</td><td align="left">Non-RCT</td><td align="left">Non-RCT</td><td align="left">RCT</td><td align="left"><bold>Davydov 1994</bold>. <italic>PC (C. Perera)</italic>: "Allocation not stated, assumed that a valid method of randomisation had been utilised (critical appraisal in the full accelerated systematic review drew attention to this)"<break/><bold>Jeschke 2004</bold>. <italic>PC (C. Perera)</italic>: "Agree with IQWiG comments regarding additional intervention. Suggest that this RCT was included due to a paucity of RCT evidence on this indication (skin grafts), and as the other included RCT for skin grafts had only a 7 day follow up."</td></tr><tr><td colspan="7"/></tr><tr><td align="left"><bold><underline>Reviews considering only RCTs</underline></bold></td><td/><td/><td/><td/><td/><td/></tr><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]<bold>(6/2004; RCT)</bold></td><td align="center">6/2004</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (PC: not identified)</td><td align="left"><bold>Jeschke 2004</bold>. <italic>PC (D. Samson)</italic>: "This study did not appear in our literature search, probably because it was not yet entered onto an electronic database by the date of our last search update."</td></tr><tr><td colspan="7"/></tr><tr><td align="left"><bold>OHTAC </bold>[##UREF##8##32##]<bold>(3/2006; RCT)</bold></td><td align="center">3/2006</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (not applicable**)</td><td align="left">Not reported (PC: excluded)</td><td align="left"><bold>Jeschke 2004</bold>. <italic>PC (Medical Advisory Secretariat)</italic>: "...was included in the literature search results, but there were only twelve patients in the study so it was excluded. The exclusion was not documented in the HTA."</td></tr></tbody></table></table-wrap> <table-wrap position="float" id="T7"><label>Table 7</label><caption><p>Overall quality assessment of primary studies and main conclusions of systematic reviews on negative pressure wound therapy</p></caption><table frame="hsides" rules="groups"><thead><tr><td align="left"><bold>Systematic review</bold></td><td align="left"><bold>Quality assessment conducted: yes/no and outcome</bold>*</td><td align="left"><bold>Main conclusion (direct quote)</bold></td></tr></thead><tbody><tr><td align="left"><bold>Samson/AHRQ 2004 </bold>[##UREF##6##29##]</td><td align="left">Yes. 6× poor in quality</td><td align="left">"The body of evidence is insufficient to support conclusions about the effectiveness of vacuum-assisted closure in the treatment of wounds."</td></tr><tr><td align="left"><bold>Costa/MUHC TAU 2005/</bold>[##UREF##7##30##]</td><td align="left">No</td><td align="left">"Consequently, we agree with the conclusions of the previous technology assessment reports and systematic reviews [##UREF##6##29##,##REF##11279736##55##,##UREF##14##57##,##UREF##16##60##,##UREF##18##63##,##UREF##19##64##] that there is insufficient evidence to recommend the routine use of this technology."</td></tr><tr><td align="left"><bold>IQWiG </bold>[##UREF##1##8##]</td><td align="left">Yes. 17× poor in quality</td><td align="left">"There are at present no results of adequate reliability which provide proof of the superiority of NPWT in comparison with conventional therapy and which would justify broad use of this method outside clinical trial settings."</td></tr><tr><td align="left"><bold>Pham/ASERNIP-S 2006 update </bold>[##REF##16802559##31##]</td><td align="left">No</td><td align="left">"There is a paucity of high-quality RCTs on TNP for wound management with sufficient sample size and adequate power to detect any differences between TNP and standard dressings.".</td></tr><tr><td align="left"><bold>OHTAC </bold>[##UREF##8##32##]</td><td align="left">Yes. 1× moderate; 3× low; 2× very low overall quality</td><td align="left">"Based on the evidence to date, the clinical effectiveness of NPWT to heal wounds is unclear."</td></tr></tbody></table></table-wrap>
<table-wrap-foot><p>*The literature search strategy was documented in detail (including search strategy and search date).</p><p><sup>†</sup>Multiple sources used (at least MEDLINE and The Cochrane Library).</p><p><sup>‡</sup>Criteria fulfilled: detailed documentation of the literature search; use of multiple sources; publication in or after December 2004.</p><p><sup>§</sup>Costa 2007 [##UREF##20##70##] was not classified as an update, as no update of the literature search was performed.</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); MUHC TAU: McGill University Health Centre Technology Assessment Unit; NPWT: negative pressure wound therapy; OHTAC: Ontario Health Technology Advisory Committee.</p></table-wrap-foot> <table-wrap-foot><p>*"Considered to be of less clinical importance" [##UREF##6##29##].</p><p><sup>†</sup>Costa also considered economic outcomes.</p><p><sup>‡</sup>One crossover study involving 7 patients was also included.</p><p><sup>§</sup>Unpublished data from primary studies were only to be considered in the review if comprehensive study information (e.g. a clinical study report) was available.</p><p><sup>||</sup>Additional information (IQWiG): An English-language title was required. No language restrictions were otherwise posed. If an English-language title or abstract indicated the potential relevance of a foreign-language text, the text was obtained and translated.</p><p><sup>¶</sup>Personal communication (C. Perera, ASERNIP-S): "This publication draws from an accelerated systematic review which was published in 2003 and is accessible at <ext-link ext-link-type="uri" xlink:href="http://www.surgeons.org/AM/Template.cfm?Section=ASERNIP_S_Publications&amp;CONTENTID=14159&amp;TEMPLATE=/CM/ContentDisplay.cfm"/>. This review contains the full methodological details, including search strategies and inclusion/exclusion criteria. An accelerated systematic review uses the same methodology as a full systematic review, but may restrict the types of studies considered in order to produce the review in a shorter time period than the full systematic review. For example, accelerated reviews generally only include comparative studies and not case series, unless safety outcomes were inadequately described in the comparative evidence."</p><p>**Wound types listed in the results section, not in the methods.</p><p><sup>††</sup>"Conference abstracts and manufacturer's information were included if they contained relevant safety and efficacy data." [##REF##16802559##31##]</p><p><sup>‡‡</sup>Information according to [##REF##16802559##31##]. Additional information: "Searches for the review were conducted without language restriction in the first instance; however, included studies were limited to those published in English. An exception to this would be if there was a paucity of English language evidence, or if a landmark RCT was published in a non-English language, in which case the studies would then be translated and included." (Personal communication: C. Perera, ASERNIP-S).</p><p><sup>§§</sup>OHTAC also considered economic outcomes.</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures-Surgical; HTA: health technology assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); MUHC TAU: McGill University Health Centre Technology Assessment Unit; NPWT: negative pressure wound therapy; OHTAC: Ontario Health Technology Advisory Committee; RCT: randomised controlled trial; SR: systematic review.</p></table-wrap-foot> <table-wrap-foot><p>*End of search period.</p><p><sup>† </sup>"The intersection of the vacuum-assisted closure terms and wound terms served as the initial pool of references. These were cross-referenced with the terms for randomized trials compiled by the Cochrane Collaboration...." For further details, please see Appendix A [##UREF##6##29##].</p><p><sup>‡</sup>Request for "lists of published, randomized, controlled trials (RCTs), published abstracts of RCTs within the past 2 years, and published articles on study design, or protocols of any RCTs (published or in press)" [##UREF##6##29##].</p><p><sup>§</sup>CENTRAL: 2003 ("through issue number 4", [##UREF##6##29##]).</p><p><sup>|| </sup>"Health technology agencies databases were also searched for technology assessment reports, systematic reviews and economic studies with the keywords 'vacuum', 'subatmospheric pressure', and 'sub-atmospheric pressure' used individually" [##UREF##7##30##].</p><p><sup>¶</sup>Unpublished data from primary studies were only to be considered in the review if comprehensive study information (e.g. a clinical study report) was available.</p><p>** "Updated searches were performed in July 2005 to include any new RCTs" [##REF##16802559##31##].</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; CDSR: Cochrane Database of Systematic Reviews; CENTRAL: Cochrane Central Register of Controlled Trials; CHSPR: Centre for Health Services and Policy Research; DARE: Database of Abstracts of Reviews of Effects; CINAHL: Cumulative Index to Nursing and Allied Health Literature; EMBASE: Excerpta Medica Database; HTA: health technology assessment; CRD: Centre for Reviews and Dissemination; INAHTA: International Network of Agencies for Health Technology Assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); MCHP: Manitoba Centre for Health Policy; MUHC TAU: McGill University Health Centre Technology Assessment Unit; MEDLINE: Medical Literature Analysis and Retrieval System Online; NPWT: negative pressure wound therapy; OHTAC: Ontario Health Technology Advisory Committee; RCT: randomised controlled trial; VAC: vacuum-assisted closure.</p></table-wrap-foot> <table-wrap-foot><p>*Unless otherwise noted, the language of publication (abstract and full text) is English.</p><p><sup>†</sup>Databases containing primary studies (entry date in database: yyyy-mm-dd).</p><p><sup>‡ </sup>"Crossover; first treatment selected randomly"[##UREF##7##30##].</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; C: The Cochrane Library; CIN: CINAHL; E: EMBASE; HTA: health technology assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); M: MEDLINE; MUHC TAU: McGill University Health Centre Technology Assessment Unit; OHTAC: Ontario Health Technology Advisory Committee; PC: personal communication; RCT: randomised controlled trial.</p></table-wrap-foot> <table-wrap-foot><p>*Unless otherwise noted, the language of publication (abstract and full text) is English. For this analysis, all studies not classified as randomised trials in the systematic reviews were classified as non-RCTs by IQWiG.</p><p><sup>†</sup>Databases containing primary studies (entry date: yyyy-mm-dd).</p><p><sup>‡</sup>German full text.</p><p><sup>§</sup>Review did not consider non-English or non-French full-text publications.</p><p><sup>||</sup>Where authors had classified studies as RCTs, the studies were also classified as RCTs in the Pham review, regardless of the methods used to randomise patients. Where the method of randomisation was described, this was included in the critical appraisal section of the full systematic review, which is published on the ASERNIP-S website [personal communication: C. Perera, ASERNIP-S].</p><p><sup>¶</sup>Review did not consider non-RCTs.</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; C: The Cochrane Library; CIN: CINAHL; E: EMBASE; HTA: health technology assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); M: MEDLINE; MUHC TAU: McGill University Health Centre Technology Assessment Unit; OHTAC: Ontario Health Technology Advisory Committee; PC: personal communications; RCT: randomised controlled trial.</p></table-wrap-foot> <table-wrap-foot><p>*Unless otherwise noted, the language of publication (abstract and full text) is English. For this analysis, all studies not classified as randomised trials in the systematic reviews were classified as non-RCTs by IQWiG. Studies not selected by any review are not listed in this table.</p><p><sup>†</sup>Databases containing primary studies (entry date: yyyy-mm-dd).</p><p><sup>‡</sup>Russian full text.</p><p><sup>§</sup>Review did not consider non-English or non-French full-text publications.</p><p><sup>||</sup>Study type not stated in the IQWiG review.</p><p><sup>¶</sup>Where authors had classified studies as RCTs, the studies were also classified as RCTs in the Pham review, regardless of the methods used to randomise patients. Where the method of randomisation was described, this was included in the critical appraisal section of the full systematic review, which is published on the ASERNIP-S website [personal communication: C. Perera, ASERNIP-S]</p><p>**Review did not consider non-RCTs.</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; C: The Cochrane Library; CIN: CINAHL; E: EMBASE; HTA: health technology assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); M: MEDLINE; MUHC TAU: McGill University Health Centre Technology Assessment Unit; NPWT: negative pressure wound therapy; OHTAC: Ontario Health Technology Advisory Committee; PC: personal communication; RCT: randomised controlled trial; VAC: vacuum-assisted closure.</p></table-wrap-foot> <table-wrap-foot><p>*Numbers refer to all primary studies included in the reviews.</p><p>AHRQ: Agency for Healthcare Research and Quality; ASERNIP-S: Australian Safety and Efficacy Register of New Interventional Procedures – Surgical; HTA: health technology assessment; IQWiG: Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (Institute for Quality and Efficiency in Health Care); MUHC TAU: McGill University Health Centre Technology Assessment Unit; NPWT: negative pressure wound therapy; OHTAC: Ontario Health Technology Advisory Committee; RCT: randomised controlled trial; TNP: topical negative pressure.</p></table-wrap-foot>
<graphic xlink:href="1471-2288-8-41-1"/> <graphic xlink:href="1471-2288-8-41-2"/>
[{"surname": ["Bland", "Rodgers", "Fayter", "Sowden", "Lewin"], "given-names": ["M", "M", "D", "A", "R"], "source": ["Agreement in primary study selection between systematic reviews"], "year": ["2006"], "publisher-name": ["York, UK, Centre for Reviews and Dissemination, University of York"]}, {"source": ["Negative pressure wound therapy Final report (German version)"], "year": ["2006"], "publisher-name": ["Cologne, Germany, Institute for Quality and Efficiency in Health Care (IQWiG)"]}, {"source": ["Negative pressure wound therapy Rapid report (German version)"], "year": ["2007"], "publisher-name": ["Cologne, Germany, Institute for Quality and Efficiency in Health Care (IQWiG)"]}, {"surname": ["J\u00fcni", "Altman", "Egger", "Egger M, Davey Smith G and Altman DG"], "given-names": ["P", "DG", "M"], "article-title": ["Assessing the quality of randomised controlled trials"], "source": ["Systematic reviews in health care - meta-analysis in context"], "year": ["2001"], "publisher-name": ["London, UK, BMJ Publishing Group"], "fpage": ["87"], "lpage": ["108"]}, {"surname": ["Higgins JPT"], "given-names": ["GS"], "article-title": ["Cochrane Handbook for Systematic Reviews of Interventions 4.2.6 Updated September 2006"], "source": ["The Cochrane Library"], "year": ["2006"], "publisher-name": ["Chichester, UK, John Wiley & Sons, Ltd"]}, {"surname": ["Joseph", "Hamori", "Bergman", "Roaf", "Swann", "Anastasi"], "given-names": ["E", "CA", "S", "E", "NF", "GW"], "article-title": ["A prospective randomized trial of vacuum-assisted closure versus standard therapy of chronic nonhealing wounds"], "source": ["Wounds A Compendium of Clinical Research and Practice"], "year": ["2000"], "volume": ["12"], "fpage": ["60"], "lpage": ["67"]}, {"surname": ["Samson", "Lefevre", "Aronson"], "given-names": ["DJ", "F", "N"], "source": ["Wound healing technologies: Low-level laser and vacuum-assisted closure"], "year": ["2004"], "publisher-name": ["Rockville, MD, USA, Agency for Healthcare Research and Quality (AHRQ)"]}, {"surname": ["Costa", "Brophy", "McGregor"], "given-names": ["V", "J", "M"], "source": ["Vacuum-assisted wound closure therapy (VAC (R))"], "year": ["2005"], "publisher-name": ["Montreal, Quebec, Canada, McGill University Health Centre (MUHC) Technology Assessment Unit (TAU)"], "fpage": ["1"], "lpage": ["24"]}, {"collab": ["Ontario Health Technology Advisory Committee (OHTAC)"], "source": ["Negative pressure wound therapy: Update"], "year": ["2006"], "publisher-name": ["Toronto, Ontario, Canada, Ministry of Health and Long-Term Care (MOHLTC) Medical Advisory Secretariat (MAS)"], "fpage": ["1"], "lpage": ["38"]}, {"surname": ["Gotzsche", "Harden"], "given-names": ["PC", "A"], "source": ["Searching for non-randomised studies"], "year": ["2000"], "publisher-name": ["Kopenhagen, D\u00e4nemark, The Cochrane Non-Randomised Studies Methods Group (NRSMG) at The Nordic Cochrane Centre"]}, {"surname": ["Kunz", "Vist", "Oxman"], "given-names": ["R", "G", "AD"], "source": ["Randomisation to protect against selection bias in healthcare trials [online]"], "series": ["The Cochrane Database of Methodology Reviews"], "year": ["2002"], "publisher-name": ["Chichester, UK, John Wiley & Sons, Ltd"]}, {"source": ["Levels of evidence and grades of recommendation"], "year": ["2001"], "publisher-name": ["Oxford, UK, Centre for Evidence-Based Medicine (CEBM)"]}, {"surname": ["Strang", "Boissel", "Uberla"], "given-names": ["WN", "P", "K"], "source": ["Inter-reader variation The Cochrane Methodology Register"], "year": ["1997"], "publisher-name": ["West Sussex, United Kingdom, John Wiley & Sons Ltd"]}, {"surname": ["Bombardier", "Jadad", "Tomlinson"], "given-names": ["C", "A", "G"], "source": ["What is the study design? The Cochrane Methodology Register"], "year": ["2004"], "publisher-name": ["West Sussex, United Kingdom, John Wiley & Sons Ltd"]}, {"surname": ["Fisher", "Brady"], "given-names": ["A", "B"], "source": ["Vacuum assisted wound closure therapy"], "year": ["2003"], "publisher-name": ["Ottawa, Ontario, Canada, The Canadian Coordinating Office for Health Technology Assessment (CCOHTA)"]}, {"surname": ["Inc"], "given-names": ["H"], "source": ["Negative pressure wound therapy for wound healing"], "year": ["2003"], "publisher-name": ["Lansdale, Pennsylvania, USA, Hayes, Inc"]}, {"surname": ["Higgins"], "given-names": ["S"], "source": ["The effectiveness of vacuum assisted closure (VAC) in wound healing"], "year": ["2003"], "publisher-name": ["Clayton, Australia, Centre for Clinical Effectiveness (CCE)"]}, {"surname": ["Mayer", "Boukamp", "Simoes"], "given-names": ["ED", "K", "E"], "source": ["Vakuumversiegelung in der Wundbehandlung - Verfahren nach EbM-Kriterien evaluiert? Bewertung aus sozialmedizinischer Sicht"], "year": ["2002"], "publisher-name": ["Lahr (Schwarzwald), Medizinischer Dienst der Krankenkassen (MDK) Baden-W\u00fcrttemberg"]}, {"collab": ["Ontario Health Technology Advisory Committee (OHTAC)"], "source": ["Vacuum assisted closure therapy for wound care"], "year": ["2004"], "publisher-name": ["Toronto, Ontario, Canada, Ministry of Health and Long-Term Care (MOHLTC) Medical Advisory Secretariat (MAS)"], "fpage": ["1"], "lpage": ["59"]}, {"surname": ["Pham", "Middleton", "Maddern"], "given-names": ["C", "P", "G"], "source": ["Vacuum-assisted closure for the management of wounds: an accelerated systematic review"], "year": ["2003"], "publisher-name": ["Adelaide, Australia, Australian safety and efficacy register of new interventional procedures - surgical (ASERNIP-S)"]}, {"surname": ["Costa", "Brophy", "McGregor"], "given-names": ["V", "J", "M"], "source": ["Vacuum-assisted wound closure therapy (VAC (R))"], "year": ["2007"], "publisher-name": ["Montreal, Quebec, Canada, McGill University Health Centre (MUHC) Technology Assessment Unit (TAU)"], "fpage": ["1"], "lpage": ["24"]}]
BMC Med Res Methodol. 2008 Jun 26; 8:41