text:
Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study
Käthe Goossen ORCID: orcid.org/0000-0002-1436-11441,
Simone Hess1,
Carole Lunny2 &
Dawid Pieper1
When conducting an Overviews of Reviews on health-related topics, it is unclear which combination of bibliographic databases authors should use for searching for SRs. Our goal was to determine which databases included the most systematic reviews and identify an optimal database combination for searching systematic reviews.
A set of 86 Overviews of Reviews with 1219 included systematic reviews was extracted from a previous study. Inclusion of the systematic reviews was assessed in MEDLINE, CINAHL, Embase, Epistemonikos, PsycINFO, and TRIP. The mean inclusion rate (% of included systematic reviews) and corresponding 95% confidence interval were calculated for each database individually, as well as for combinations of MEDLINE with each other database and reference checking.
Inclusion of systematic reviews was higher in MEDLINE than in any other single database (mean inclusion rate 89.7%; 95% confidence interval [89.0–90.3%]). Combined with reference checking, this value increased to 93.7% [93.2–94.2%]. The best combination of two databases plus reference checking consisted of MEDLINE and Epistemonikos (99.2% [99.0–99.3%]). Stratification by Health Technology Assessment reports (97.7% [96.5–98.9%]) vs. Cochrane Overviews (100.0%) vs. non-Cochrane Overviews (99.3% [99.1–99.4%]) showed that inclusion was only slightly lower for Health Technology Assessment reports. However, MEDLINE, Epistemonikos, and reference checking remained the best combination. Among the 10/1219 systematic reviews not identified by this combination, five were published as websites rather than journals, two were included in CINAHL and Embase, and one was included in the database ERIC.
MEDLINE and Epistemonikos, complemented by reference checking of included studies, is the best database combination to identify systematic reviews on health-related topics.
What is already known
Overviews of Reviews summarize data from several systematic reviews, thus providing a broad picture of relevant evidence.
Few empirical studies exist that support methodological approaches to producing Overviews of Reviews, including the search process for systematic reviews.
The present empirical study has shown that in a sample of 1219 systematic reviews, 99.2% of records are included in a combination of the electronic databases MEDLINE via PubMed and Epistemonikos, supplemented by checking reference lists of eligible studies retrieved by these databases.
Potential impact
A resource-efficient search process for systematic reviews should be based on the free-of-charge electronic databases MEDLINE via PubMed and Epistemonikos, supplemented by reference checking.
Overviews of Reviews (Overviews) are used to summarize data from across multiple systematic reviews (SRs) on the same topic, thus providing a broader picture of evidence relevant for decision-making [1]. Generally, they aim to provide a comprehensive assessment of multiple interventions, populations, or outcomes for a defined health problem using SR-level evidence.
Some methodological components of preparing Overviews are analogous to SRs, such as defining the review question structured into a Population, Intervention, Comparator, Outcomes, and Study types (PICOS) format, setting eligibility criteria, and defining a search strategy, though nuances clearly exist. Other methodological components such as the critical appraisal of included SRs, extraction and analysis of data, and presentation of findings differ more markedly between Overviews and SRs [2,3,4].
Many specific steps for conducting an Overview are not yet based on empirical research [5], and some steps contain few empirical studies which may guide future recommendations including selection of electronic databases to use when searching for SRs.
Current guidance recommends searching the Cochrane Database of Systematic Reviews (CDSR) to locate Cochrane SRs [1, 6], and a structured search process to locate and select non-Cochrane reviews, (e.g. in MEDLINE [7] and Embase [8]). Guidance also recommends searching additional regional and subject-specific databases (e.g. LILACS [9], CINAHL [10], PsycINFO [11]), major repositories of SRs, and the PROSPERO register [1, 2, 12]. In practice, the majority of Overviews in healthcare-related fields published to date searched at least two databases [13, 14], in addition to reference checking (i.e. looking through the reference list of included studies), and consultation with the relevant Cochrane group [14].
Rathbone et al. have evaluated retrieval of a set of 400 SRs of interventions for hypertension in seven electronic databases [15]. They searched for SRs in the Cochrane Library, DARE, Embase, Epistemonikos, MEDLINE, PubMed Health, and TRIP. For each database, sensitivity, precision, numbers missed, and unique records identified were calculated. Embase had the highest sensitivity (169/400, or 69% of SRs) and retrieved the largest number of unique SR records, i.e. records found by their search in only one database (34/400, or 8.5% of SRs). The authors conclude that searching should not be restricted to one or two major databases, but that all databases should be searched.
In a situation where resources are limited, it remains unclear which combination of electronic resources Overview authors should use for searching for SRs. Therefore, the aims of the present methodological study were: (1) to assess the inclusion of SRs in six electronic databases: MEDLINE [7], CINAHL [10], Embase [8], Epistemonikos [16], PsycINFO [11], and TRIP [17] without limiting the SR topic; (2) to evaluate whether a single database combined with manual reference checking is sufficient to comprehensively retrieve SRs in the context of preparing Overviews; (3) to identify a combination of databases plus reference checking that may be recommended for searching SRs; and (4) to explore possible contexts (for example, for certain Overview types, or for healthcare interventions compared to other fields of healthcare research) in which the recommendation result of objective #3 produces inadequate retrieval of SRs, defined as lower than 95% retrieval [18]. It was not our aim to evaluate search strategies.
A methodological study was conducted to analyse the rate of inclusion of SRs in six selected electronic resources, and in combinations of two databases with reference checking. We did not write a protocol for this study.
A set of Overviews, including Health Technology Assessment (HTA) reports, Cochrane Overviews, and non-Cochrane Overviews, was obtained from a preceding methodological study, as described in detail in Pieper et al. (2014) [19]. Briefly, a search for overviews was conducted in MEDLINE via PubMed, Embase via Embase.com [8], CINAHL via EBSCOhost [10], PEDro [20], CDSR, DARE, CENTRAL, CMR, HTA, and NHS-EED via the Cochrane Library, and the websites of 127 HTA agencies from inception to May 2012. Search terms were text words related to Overviews and SRs and the search algorithms can be found in Pieper et al. (2014) [19]. The search was limited to Overviews published in English or German between 2009 and 2011.
Overviews were defined as systematic reviews for which the unit of searching, inclusion and data analysis is the systematic review rather than the primary study [1]. Thus, we included all Overviews that had searched explicitly and systematically for SRs in at least one electronic database, included at least one SR (Overviews including both SRs and primary studies were eligible if the evidence synthesis relied at least in part on SRs, e.g., by combining primary studies and SRs in the evidence synthesis), and critically appraised all included SRs and additional primary studies. A HTA report was defined as "a method of evidence synthesis that considers evidence regarding clinical effectiveness, safety, cost-effectiveness and, when broadly applied, includes social, ethical, and legal aspects of the use of health technologies" [21].
Searched for SRs in at least one electronic database;
Included at least one SR in their evidence synthesis;
Critically appraised included SRs and primary studies; and
Full text publication was available.
Overviews with a methodological focus; and
Published in a language other than English or German.
The set of included Overviews will be henceforth called the "reference set".
Description of electronic databases selected in this study
Six databases were selected to assess inclusion of systematic reviews as described in the section "data collection", below, namely MEDLINE, CINAHL, Embase, Epistemonikos, PsycINFO, and TRIP. The key features of these databases are described in Table 1.
Table 1 Description of electronic databases and resources
The sources scraped by Epistemonikos include, or have included, CDSR, PubMed, Embase, CINAHL, PsycINFO, LILACS, DARE, HTA database, The Campbell Collaboration online library, JBI Database of Systematic Reviews and Implementation Reports, EPPI-Centre Evidence Library. Updates of algorithms in February and April 2019 have led to an expansion in the dataset by more than a factor of 1.5. TRIP widely collects references from sources of SRs (including Cochrane Library and DARE), guidelines, regulatory agencies (FDA, EMA, NICE, IQWIG), HTA databases, NHS EED, literature databases (PubMed), journals, as well as PROSPERO and clinical trial registries.
From the full text of each included Overview, the following data were extracted into MS Excel (2016): citation, publication title, number of databases searched, name of each database searched, searched in social science/economics databases (yes/no; i.e. EconLit, HEED, NHS EED, IBSS, Social Sciences Citation Index, Social SciSearch, the Campbell Collaboration Database, Social Sciences Abstracts, Social Services Abstracts, Applied Social Science Index and Abstracts, Social Service Information Gateway), searched in additional sources ('other sources' yes/no; i.e. reference lists of included studies, queries to experts, Google, Google Scholar, internal departmental files, hand-searching or electronically searching journals, clinical trial or study registries (e.g. clinicaltrials.gov, PROSPERO), publishers' databases (e.g. Springer, ScienceDirect, Thieme, Wolters Kluwer), HTA agencies' websites (e.g. https://www.iqwig.de, https://www.dimdi.de, http://www.msac.gov.au)), number of SRs included, Overview type (Cochrane Overview, HTA report, or non-Cochrane Overview), intervention/non-intervention Overview, and mental health- or psychology-related topic (yes/no).
For each Overview, the included SRs were extracted and tagged with the Overview from which they originated. Primary studies were not extracted. HTA reports are usually structured into sections entitled clinical effectiveness, safety, cost-effectiveness, social, ethical, or legal. For HTAs, we only included SRs from the clinical effectiveness section of the report.
The database searches for SRs were performed in April 2019. A stepwise process was followed to identify whether a SR was included in an electronic database, found by reference checking, or included in a database combination:
From the sample of SRs extracted from the Overviews, we determined which of six databases each SR was included in, namely MEDLINE, CINAHL, Embase, Epistemonikos, PsycINFO, or TRIP.
We then determined which database contained the largest overall number of included SRs. This database was identified as the 'reference database'. We set the reference database to MEDLINE as it had the highest inclusion rate. The SRs included in MEDLINE will be henceforth called the "MEDLINE-included SRs".
A list of all SRs not included in MEDLINE was compiled. These SRs are called the 'MEDLINE-non-included SRs'.
For each 'MEDLINE-non-included SR' obtained in step C, we then manually checked the reference lists of the 'MEDLINE-included SRs' that were cited in the same Overview as the 'MEDLINE-non-included SR'. The purpose of this step was to find out if each SR not included in MEDLINE could have been identified by reference checking of SRs identified in MEDLINE on the same topic, rather than by additional database searching. The SRs found in the reference lists/bibliographies are henceforth called 'biblio SRs'.
Finally, we constructed five combined sets of SRs by merging the 'MEDLINE-included SRs', 'biblio-SRs', and SRs obtained in step A for CINAHL, Embase, Epistemonikos, PsycINFO, and TRIP. For each of these five combined sets, we calculated a combined mean inclusion rate (see statistical analysis). This was done to evaluate whether searching more than one database would expand the study pool.
The dataset generated and analysed during the current study is made available in Additional file 1. For each Overview, we calculated:
the mean inclusion rate (% of included SRs) and corresponding 95% confidence interval (95% CI) separately for each database.
the mean inclusion rate for the reference database (as defined above) combined with reference checking (as described above).
the mean inclusion rates for combinations of the reference database, reference checking, and each of the other five databases.
The Overview-level inclusion rates obtained in statistical analysis steps A to C were then aggregated for the entire dataset by calculating weighted mean inclusion rates and corresponding 95% confidence intervals (95% CI). Weighting was based on the number of SRs included in each Overview.
The goals of stratification were to generate hypotheses on contexts where the results-based recommendations would apply, and to identify situations where retrieval would be inadequate and further searches may be necessary. Inadequate retrieval of SRs was defined as lower than 95% retrieval. Thus, we: (1) investigated whether searching large numbers of databases offers added value, (2) gauged the magnitude of effect when using 'other sources' (as defined above in section 'data collection'), (3) examined whether different Overview types require searching different electronic resources, (4) explored differences in database inclusion between healthcare interventions and other fields of healthcare research, and (5) evaluated the role of specialist databases when such databases exist in the area of the Overview topic, using PsycINFO as an example.
To answer the above objectives (1) to (5), respectively, exploratory analyses were performed for the following strata: (1) number of databases searched (1–3 / ≥4), (2) other sources searched (yes / no), (3) Overview type (Cochrane Overview, HTA report, or non-Cochrane Overview), (4) intervention/non-intervention Overviews, and (5) mental health- or psychology-related topic (yes/no).
Stratification analysis was performed only for strata containing ≥3 Overviews for analysis. For each stratification analysis, the weighted mean inclusion rate with 95% CI was calculated for combinations of the reference database and reference checking with each of the other databases. For analyses with two strata, the weighted difference in means and corresponding p-value were calculated using a two-sample weighted t-test (Welch) computed in R version 3.5.1 (2018-07-02) using the R package 'weights' [26, 27]. The significance level for each individual test αi was adjusted for multiple testing using the Bonferroni correction, i.e. αi = αg/n = 0.0017 for a global significance level of αg = 0.05 and n = 30 tests (6 databases and 5 stratified analyses).
Qualitative analysis of missed SRs
All SRs that were not included in a combination of the reference database, reference checking, and the best additional database were analysed qualitatively. Features investigated were the topics of these SRs, whether they were located on websites, included in the other five databases that were investigated in this study, listed in a publisher's database (e.g. ScienceDirect, Wiley Online Library, Springerlink, De Gruyter), or in Google Scholar.
Overviews included in the study
The literature search yielded a reference set of 86 Overviews [28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113], of which 73 had been identified in electronic databases and 13 on HTA websites [19]. The characteristics of the included Overviews are summarised in Table 2, and detailed in Table S1 (see Additional file 2).
Table 2 Summary characteristics of N = 86 included Overviews
A total of 1219 SRs were included in the 86 Overviews overall, with a median of eight SRs in an Overview. Between one and 25 (median 6) databases had been searched. Among them, the most widely used were MEDLINE and Embase. More than half of the Overviews had searched DARE or the Cochrane Library, which up to 2018 also contained all DARE records. None had searched the international SR-focused database Epistemonikos, which was first launched internationally in August 2012, and was therefore not available at the time of publication of the included Overviews [22].
A wide range of subjects were covered by the included Overviews [13]. Sixty-nine percent were intervention Overviews, defined as Overviews of health-related interventions, i.e. actions taken with the intent of modifying a defined outcome, usually to treat or cure a health condition or change behaviour. Non-intervention Overviews focused, for example, on diagnosis, incidence/prevalence, or risk factors for certain outcomes.
Thirty-five percent (n = 30/86) of Overviews searched PsycINFO, but of these, only 30% (n = 9/30) had topics related to mental health (i.e. autism, depression, psychosis, or schizophrenia), or psychology (i.e. psychological or psychosocial interventions (such as behavioural therapy)).
Inclusion in individual databases and database combinations
Among the 1219 SRs retrieved, 90% (n = 1093/1219) were included in MEDLINE. The inclusion rates in other databases were lower (Table 3, Fig. 1). Therefore, MEDLINE was used as the reference database.
Table 3 Proportion of SRs included in individual databases and their combination with MEDLINE and reference checking
Inclusion rates in individual databases and their combination with MEDLINE and reference checking. MEDL = MEDLINE, CIN = CINAHL, EMB = Embase, PSI = PsycINFO, EPIS = Epistemonikos, DB = database
In addition to the SRs included in MEDLINE, a further 4% of SRs (n = 49/1219) were identified by reference checking (see Methods, step B). Combinations of MEDLINE and reference checking with the addition of one database (Epistemonikos, PsycINFO, and TRIP) led to inclusion rates above 95% (n = 1209/1219, 1159/1219, and 1174/1219, respectively). Among these databases, the inclusion rate was highest in the combination with Epistemonikos (Table 3, Fig. 1).
Table 4 presents the results obtained for each of the strata investigated. For the combination of MEDLINE, Epistemonikos and reference checking, inclusion rates and their 95% confidence intervals were above the 95% retrieval threshold for all individual strata. Therefore, no context was identified in which this combination produced inadequate retrieval of SRs.
Table 4 Stratified inclusion rates in database combinations with MEDLINE and reference checking (mean [95% CI])
Databases searched
The Overviews in the reference set had searched for SRs in 1–25 databases. The inclusion rates calculated for Overviews searching 1–3 databases was roughly equal to that calculated for Overviews searching 4 or more databases.
Other sources searched
Other sources that were searched by Overview authors include reference lists of included studies, queries to experts, Google, Google Scholar, internal, non-public departmental files from the institutions of Overview authors, hand-searching journals, trial registries, publishers' databases, journals, institutions, and HTA agencies. Because this represents a larger dataset containing SRs that may not all be included in databases, one may expect that database inclusion rates would be smaller in this stratum.
A total of 74% of Overviews (n = 64/86) reported searching at least one other source. In any database combination, the mean inclusion of SRs for Overviews that had searched other sources was only slightly lower than for Overviews that had not searched other sources. For example, the difference was 0.7% for the combination of MEDLINE, Epistemonikos and reference checking.
Overview types
Overviews were classified into three types, i.e. Cochrane Overviews (n = 3), HTA reports (n = 14), and non-Cochrane Overviews (n = 69). Inclusion of SRs from Cochrane Overviews was complete for combinations of MEDLINE plus reference checking and each of the databases Embase, TRIP, and Epistemonikos (Fig. 2). In contrast, inclusion rates were lower for SRs originating from HTA reports in most database combinations. MEDLINE, Epistemonikos, and reference checking remained the best combination, reaching a mean rate of 97.7% included SRs [96.5 to 98.9]. For non-Cochrane Overviews, which made up 80% (n = 69/86) of the total set and contributed 89% (n = 1087/1219) of SRs, the results were similar to the results for the total set. Thus, the SR inclusion rate for MEDLINE, Epistemonikos, and reference checking was 99.3% [99.1 to 99.4%].
Inclusion rates in database combinations with MEDLINE and reference checking, stratified by Overview type
Intervention/non-intervention overviews
Intervention Overviews represented 69% of the overall sample. The difference between SRs originating from intervention vs. non-intervention Overviews was minimal for all databases.
Mental health- or psychology-related topics
The present dataset included only 10% (n = 9/86) Overviews in the stratum with a mental health- or psychology-related topic, corresponding to 8% (n = 98/1219) of included SRs. In this stratum, the inclusion rate in PsycINFO combined with MEDLINE and reference checking was slightly higher than in the stratum without psychology-related topics. However, the combination of the non-specialist databases Epistemonikos and MEDLINE with reference checking was superior, because 100% of SRs with a mental health- or psychology-related topic were included in this combination.
Ten SRs (n = 10/1219, 0.8%) were not identified by the best database combination (Table 5). Of these, one was incorrectly cited in the original Overview [116]. The correct citation [126] was included in the databases CINAHL, Epistemonikos, and Embase. Two were evidence syntheses published on the web only, for which alternative versions were found by database searching [124, 125]. Thus, the evidence for 3/10 missed records would have been included in alternative form, resulting in a total coverage of 99.43% (n = 1212/1219) of SRs.
Table 5 Qualitative analysis of SRs not included in MEDLINE, Epistemonikos and reference checking
Three missed references (n = 3/1219, 0.24%) were websites not included in any of the databases investigated in the present study [119, 122, 123]. Two missed SRs (n = 2/1219, 0.16%) were included in both CINAHL and Embase [120, 121]. One (n = 1/1219, 0.08%) was listed on the publisher's website (ScienceDirect) and found via Google Scholar [117]. Finally, one was not found via any of the routes explored in this study [118]. However, it was included in the Education Resources Information Center (ERIC) database, sponsored by the Institute of Education Sciences of the U.S. Department of Education [127], which had been searched by the Overview authors [93].
We identified MEDLINE/Epistemonikos, complemented by reference checking, as the best combination to retrieve SRs for an Overview of Reviews on health-related topics. This study fill a gap in the evidence around the evaluation of methods in overviews as identified in the MoOR framework by Lunny et al. [5, 128]. Our investigation mapped to the option 'select the types of databases to search' in the MoOR framework of all methods used in overviews, and provides clear guidance for authors around which databases to choose when planning an overview.
No single database was found to be sufficiently comprehensive by itself for a systematic search for SRs in the context of preparing Overviews. MEDLINE emerged as the best single source for retrieval of SRs (inclusion rate 89.7%). MEDLINE using the PubMed interface has a good inclusion rate for SRs, and is free of charge and open access.
Among databases assessed in combination with MEDLINE and reference checking (i.e. checking the citation lists of SRs identified in MEDLINE), Epistemonikos gave the highest pooled inclusion rate with 99.2%, followed by TRIP (96.3%). Both Epistemonikos and TRIP are resources specialising in the retrieval of SRs. In spite of the fact that the inclusion rate of SRs was relatively high in Embase (inclusion rate 83.7%), the pooled inclusion rate of MEDLINE, Embase and reference checking was below 95%, possibly due to greater overlap with MEDLINE. The subject-specific databases CINAHL (nursing) and PsycINFO (psychology) had pooled inclusion rates similar to Embase (94.6 and 95.1%, respectively).
Analysis of the different strata did not identify any context in which the combination of MEDLINE, Epistemonikos and reference checking was inadequate.
The difference between the number of SRs retrieved from Overviews that had searched in 4 or more databases was minimal compared to Overviews that had searched in 1–3 databases, casting doubt on the value of searching large numbers of databases without specific justification. When looking at the SRs not covered by our optimal database combination, an additional 0.16% of SRs were included in both CINAHL and Embase, and 0.08% in ERIC. The effect of searching other sources beyond electronic databases (e.g. Google Scholar and publishers' databases) was found to be similarly small (0.5 and 0.16%, respectively, of studies found in addition to the recommended combination). Nevertheless, a limited number of SRs are published on the web only and not identified by searching the databases investigated in this study (0.24% in this dataset).
The recommended database combination included slightly more SRs from Cochrane and non-Cochrane Overviews than from HTA reports. The better rate of SRs included in Cochrane Overviews (100% of included SRs) is likely a result of guidance for Cochrane Overview authors to search for, and include, only Cochrane SRs [1]. SRs from Cochrane Overviews are more frequently included than from non-Cochrane Overviews (99.3% of included SRs), because all Cochrane Reviews are included in PubMed and other electronic databases [6]. The inclusion rate using the recommended combination was slightly lower for SRs from HTA reports (97.7% of included SRs). This may be because authors of HTA reports typically search more widely, and might thus identify more studies, than authors of Cochrane or non-Cochrane Overviews (median 8 databases searched, compared to 2 databases for Cochrane Overviews and 5 for non-Cochrane Overview; all searches in HTA reports complemented by other methods).
Only one empirical study was found that investigated the types of databases to search [15]. The recall rates in the Rathbone study (88% recall for Cochrane Library and Embase; and 83% for Cochrane Library, Epistemonikos and MEDLINE) are substantially lower than in our study (99.2% indexing in MEDLINE, Epistemonikos and reference checking). Rathbone et al. examined bibliographic database performance in identifying SRs using an approach that was different to ours in several key aspects. First, the study was topic specific and related to interventions for hypertension. Second, the reference set of SRs was generated by searching in the same electronic databases that were later used to analyse retrieval of SRs, and was thus a relative recall analysis based on databases alone [129]. They performed systematic literature searches in seven electronic databases and used search filters for SRs to increase precision. Therefore, their approach primarily evaluated the relative performance of search strategies in bibliographic databases compared to each other, in terms of precision and sensitivity.
In contrast to the Rathbone study [15], our sample was not topic-specific, and included both intervention and non-intervention SRs. We evaluated database coverage independently of the search. Our sample of SRs was larger (1219 vs. 400), and was obtained from published Overviews which had used various methods to identify relevant literature. Our study investigating database inclusion of SRs, as opposed to evaluating the performance of search strategies in different databases.
These methodological differences may explain the different results obtained. In addition, our last search was performed after a major update in the Epistemonikos machine learning algorithms. As a result, a larger number of SRs were included in this resource and retrieved by our search.
Rathbone et al. concluded that "a search of all databases should be performed". This conclusion is not supported by our results. First, the high database inclusion rate of over 99% that we observed for a combination of two databases and reference checking shows that when a sensitive search strategy is employed, this combination is sufficient for retrieving SRs. Second, in the context of limited resources, it may not be efficient to search additional databases as we found no relevant differences when we stratified inclusion of SRs by Overviews that had searched in 4 or more databases compare with 1 to 3 databases (99.3% vs. 98.8% inclusion, respectively).
Strengths and limitations of the study
The present methodological study is based on a large sample of 1219 SRs. The SRs were extracted from published Overviews, and were found in diverse electronic databases, often complemented by reference checking, queries to experts, searches of the web (e.g. Google, Google Scholar, government reports), or hand-searching journals, thus making our sample representative of searches in a variety of overviews. We analysed the inclusion rate of SR in databases, and have not used any search strategies for the retrieval of SRs. Therefore, our results are independent of the effectiveness of any search strategy employed.
The results of this study apply only to database coverage. Real-world retrieval of SRs will usually be lower because search strategies can be unreliable and less than 100% sensitive. Another limitation relates to the choice of sample. The lack of recency of the dataset of SRs dated from 1982 to 2011 may be limiting, and future efforts should be made to validate this research in a more up-to-date set of SRs. The reference set of SRs was not generated by hand-searching all relevant resources, which may be considered the gold standard, but relies on relative recall [129]. Some Overview authors may have searched for SRs less extensively or less effectively than others, resulting in a possible bias for studies included in databases. This may affect the absolute values for means and confidence intervals generated within this study. In the worst case, if some Overview authors have missed harder-to-find SRs in their searches, this may tend to even out observable differences between databases and bias the results towards higher overall inclusion rates.
The inclusion of SRs in the six databases is likely to change over time, as the terminology used to describe systematic reviews changes, and as tagging of SRs and algorithms for retrieval of SRs improves. For example, the National Library of Medicine has established a new MeSH publication type "Systematic Reviews" in January 2019, and SRs have retrospectively been re-indexed in MEDLINE [130]. A more general search filter, designed to include SRs that had not yet been indexed, is also available [131]. Other databases may decline in inclusion rates, such as DARE and the NHS EED database (not updated since 2015). The reference set of Overviews was limited to those published in English or German, so that the results are not applicable to SRs published in other languages. In addition, some SRs may have been included in more than one Overview, the effect of which was not assessed. The 'biblio-SRs', i.e. those obtained by reference checking in this study, may also have been retrievable by other means. Overview authors were not contacted to clarify the origin of these 'biblio-SRs'. Also, the results may depend on factors not studied, for example, specific diseases, drugs, or other interventions that are more likely to be included in one database than in another. Furthermore, the present study was not designed primarily to quantify differences between strata, so that the results of the stratification analysis should be considered exploratory. Finally, inclusion in databases was not assessed in duplicate, leading to potential errors in extractions and calculations.
Future research should be directed at validating our findings using an up-to-date reference set, assessing whether it is applicable to languages not evaluated in the present study, and exploring the relative contribution of other methods of study retrieval.
The Cochrane Handbook [1] and the Joanna Briggs Institute [132] currently recommend that a structured search process using multiple databases (e.g. MEDLINE and Embase, and additional regional and subject-specific databases, such as LILACS, CINAHL, PsycINFO) be used to retrieve systematic reviews. This guidance will need to be re-evaluated based on our findings that MEDLINE and Epistemonikos, with reference checking of included studies, is the best strategy for retrieval of systematic reviews.
The present study shows that the literature search for Overviews should be performed in MEDLINE and Epistemonikos, complemented by reference checking.
All data generated or analysed during this study are included in this published article and its supplementary information files.
HTA:
Health Technology Assessment
IQR:
PICOS:
Population, Intervention, Comparator, Outcomes, and Study types
SR:
Pollock M, Fernandes RM, Becker LA, Pieper D, Hartling L. Chapter V: Overviews of Reviews. In: JPT H, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.0 (updated March 2020): Cochrane; 2020. Available from www.training.cochrane.org/handbook.
Aromataris E, Fernandez R, Godfrey CM, Holly C, Khalil H, Tungpunkom P. Summarizing systematic reviews: methodological development, conduct and reporting of an umbrella review approach. Int J Evid Based Healthc. 2015;13(3):132–40. https://doi.org/10.1097/xeb.0000000000000055. Epub 2015/09/12. PubMed PMID: 26360830.
Fusar-Poli P, Radua J. Ten simple rules for conducting umbrella reviews. Evid Based Mental Health. 2018;21(3):95–100. https://doi.org/10.1136/ebmental-2018-300014. Epub 2018/07/15. PubMed PMID: 30006442.
Pollock M, Fernandes RM, Becker LA, Featherstone R, Hartling L. What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary. Syst Rev. 2016;5(1):190. https://doi.org/10.1186/s13643-016-0367-5. Epub 2016/11/16. PubMed PMID: 27842604; PubMed Central PMCID: PMCPMC5109841.
Lunny C, Brennan SE, McDonald S, McKenzie JE. Toward a comprehensive evidence map of overview of systematic review methods: paper 1-purpose, eligibility, search and data extraction. Syst Rev. 2017;6(1):231. https://doi.org/10.1186/s13643-017-0617-1. Epub 2017/11/23. PubMed PMID: 29162130; PubMed Central PMCID: PMCPMC5698938.
Cochrane Library: About the Cochrane Database of Systematic Reviews. https://www.cochranelibrary.com/de/cdsr/about-cdsr. Accessed 6 Sept 2019.
NCBI PubMed. https://www.ncbi.nlm.nih.gov/pubmed/. Accessed 23 Mar 2019.
Embase. https://www.embase.com. Accessed 23 Mar 2019.
Literatura Latino-Americana e do Caribe em Ciências da Saúde [Latin American and Caribbean Center on Health Sciencies Information]: LILACS. http://lilacs.bvsalud.org/en/. Accessed 23 Mar 2019.
Cumulative Index for Nursing and Allied Health Literature (CINAHL). https://www.ebscohost.com/nursing/products/cinahl-databases/cinahl-complete. Accessed 23 Mar 2019.
EBSCO PsycINFO. https://www.ebsco.com/products/research-databases/psycinfo. Accessed 23 Mar 2019.
International prospective register of systematic reviews (PROSPERO). https://www.crd.york.ac.uk/prospero/. Accessed 23 Mar 2019.
Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: a systematic review. J Clin Epidemiol. 2012;65(12):1267–73 https://doi.org/10.1016/j.jclinepi.2012.06.015. Epub 2012/09/11. PubMed PMID: 22959594.
Hartling L, Chisholm A, Thomson D, Dryden DM. A descriptive analysis of overviews of reviews published between 2000 and 2011. PLoS One. 2012;7(11):e49667 https://doi.org/10.1371/journal.pone.0049667. Epub 2012/11/21. PubMed PMID: 23166744; PubMed Central PMCID: PMCPMC3499476.
Rathbone J, Carter M, Hoffmann T, Glasziou P, et al. Syst Rev. 2016;5:27 https://doi.org/10.1186/s13643-016-0197-5. Epub 2016/02/11. PubMed PMID: 26862061; PubMed Central PMCID: PMCPMC4748526.
Epistemonikos: Database of the best of Evidence-Based Health Care. https://www.epistemonikos.org/. Accessed 23 Mar 2019.
Trip medical database. https://www.tripdatabase.com/. Accessed 23 Mar 2019.
Bramer WM, Rethlefsen ML, Kleijnen J, Franco OH. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017;6(1):245 https://doi.org/10.1186/s13643-017-0644-y. Epub 2017/12/07. PubMed PMID: 29208034; PubMed Central PMCID: PMCPMC5718002.
Pieper D, Antoine SL, Mathes T, Neugebauer EA, Eikermann M. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol. 2014;67(4):368–75. https://doi.org/10.1016/j.jclinepi.2013.11.007. Epub 2014/03/04. PubMed PMID: 24581293.
Physiotherapy Evidence Database (PEDro). https://search.pedro.org.au/search. Accessed 23 Mar 2019.
Luce BR, Drummond M, Jonsson B, Neumann PJ, Schwartz JS, Siebert U, et al. EBM, HTA, and CER: clearing the confusion. Milbank Q. 2010;88(2):256–76. https://doi.org/10.1111/j.1468-0009.2010.00598.x. Epub 2010/06/29. PubMed PMID: 20579285; PubMed Central PMCID: PMCPMC2980346.
Rada G, Perez D, Capurro D. Epistemonikos: a free, relational, collaborative, multilingual database of health evidence. Stud Health Technol Inform. 2013;192:486–90. https://doi.org/10.3233/978-1-61499-289-9-486. Epub 2013/08/08. PubMed PMID: 23920602.
El-Khayat YM. Epistemonikos (Resource Review). J Med Libr Assoc. 2017;105(4):431–2 https://doi.org/10.5195/jmla.2017.260. Epub 2017 Oct 1. PubMed Central PMCID: PMCPMC5624441.
PubMed Central Article Google Scholar
MEDLINE (R): Description of the database. https://www.nlm.nih.gov/bsd/medline.html. Accessed 27 Aug 2019.
Sources searched by Trip. In: Trip database blog. https://blog.tripdatabase.com/2017/10/27/sources-searched-by-trip/. Accessed 7 Mar 2019.
R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for statistical computing; 2018. URL https://www.R-project.org/.
Josh Pasek, with some assistance from Alex Tahk, some code modified from R-core; Additional contributions by Gene Culter and Marcus Schwemmle. weights: Weighting and Weighted Statistics. R package version 1.0. 2018. https://CRAN.R-project.org/package=weights.
Andersen JH, Fallentin N, Thomsen JF, Mikkelsen S. Risk factors for neck and upper extremity disorders among computers users and the effect of interventions: an overview of systematic reviews. PLoS One. 2011;6(5):e19691. https://doi.org/10.1371/journal.pone.0019691. Epub 2011/05/19. PubMed PMID: 21589875; PubMed Central PMCID: PMCPmc3093401.
Australia Medical Services Advisory Committee. Positron emission tomography for lymphoma: assessment report: Medical Services Advisory Committee; 2009. ISBN: 978-1-74241-066-1. Available from: https://trove.nla.gov.au/work/37079128?q=978-1-74241-066-1&c=book&online=true.
Australia Medical Services Advisory Committee. Human papillomavirus triage test for women with possible or definite low-grade squamous intra-epithelial lesions. 2009. ISBN: 978-1-74241-019-7. Available from: https://trove.nla.gov.au/work/35947706?q=978-1-74241-019-7&c=book&online=true.
Australia Medical Services Advisory Committee. Positron emission tomography for cervical cancer : assessment report: Medical Services Advisory Committee. 2010. ISBN: 978-1-74241-155-2. Available from: https://trove.nla.gov.au/work/37964413?q=978-1-74241-155-2&c=book&online=true.
Australia Medical Services Advisory Committee. Positron emission tomography for glioma: Medical Services Advisory Committee. 2010. ISBN: 978-1-74241-151-4. Available from: https://trove.nla.gov.au/work/37683103?q=978-1-74241-151-4&c=book&online=true.
Australia Medical Services Advisory Committee, Khafagi F, Atherton J, Gracanin A, Kearney B, Pitman A. Positron emission tomography for myocardial viability: assessment report: Medical Services Advisory Committee. 2010. ISBN: 978-1-74241-157-6. Available from: https://trove.nla.gov.au/work/37782298?q=978-1-74241-157-6&c=book&online=true.
Beattie M, Taylor J. Silver alloy vs. uncoated urinary catheters: a systematic review of the literature. J Clin Nurs. 2011;20(15–16):2098–108. https://doi.org/10.1111/j.1365-2702.2010.03561.x. Epub 2011/03/23. PubMed PMID: 21418360.
Berkhof M, van Rijssen HJ, Schellart AJ, Anema JR, van der Beek AJ. Effective training strategies for teaching communication skills to physicians: an overview of systematic reviews. Patient Educ Couns. 2011;84(2):152–62. https://doi.org/10.1016/j.pec.2010.06.010. Epub 2010/08/03. PubMed PMID: 20673620.
Black AD, Car J, Pagliari C, Anandan C, Cresswell K, Bokun T, et al. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Med. 2011;8(1):e1000387. https://doi.org/10.1371/journal.pmed.1000387. Epub 2011/01/27. PubMed PMID: 21267058; PubMed Central PMCID: PMCPmc3022523.
Brouwers MC, Garcia K, Makarski J, Daraz L. The landscape of knowledge translation interventions in cancer control: what do we know and where to next? A review of systematic reviews. Implement Sci. 2011;6:130. https://doi.org/10.1186/1748-5908-6-130. Epub 2011/12/22. PubMed PMID: 22185329; PubMed Central PMCID: PMCPmc3284444.
Clar CBK, Cummins E, Royle P, Waugh N. Self-monitoring of blood glucose in type 2 diabetes: systematic review. Health Technol Assess (Winchester, England). 2010;14(12). https://doi.org/10.3310/hta14120.
Damen A, Remmen R, Wens J, Paulus D. Evidence based post graduate training. A systematic review of reviews based on the WFME quality framework. BMC Med Educ. 2011;11:80. https://doi.org/10.1186/1472-6920-11-80. Epub 2011/10/08. PubMed PMID: 21977898; PubMed Central PMCID: PMCPmc3200166.
De Niet GJ, Tiemens BG, Kloos MW, Hutschemaekers GJ. Review of systematic reviews about the efficacy of non-pharmacological interventions to improve sleep quality in insomnia. Int J Evid Based Healthc. 2009;7(4):233–42. https://doi.org/10.1111/j.1744-1609.2009.00142.x. Epub 2009/12/01. PubMed PMID: 21631864.
de Vet E, de Ridder DT, de Wit JB. Environmental correlates of physical activity and dietary behaviours among young people: a systematic review of reviews. Obes Rev. 2011;12(5):e130–42 https://doi.org/10.1111/j.1467-789X.2010.00784.x. Epub 2010/07/16. PubMed PMID: 20630024.
Diener MK, Voss S, Jensen K, Buchler MW, Seiler CM. Elective midline laparotomy closure: the INLINE systematic review and meta-analysis. Ann Surg. 2010;251(5):843–56. https://doi.org/10.1097/SLA.0b013e3181d973e4. Epub 2010/04/17. PubMed PMID: 20395846.
Hagen A, Gorenoi V, Schönermark MP. Spezifische Immuntherapie (SIT) zur Behandlung der allergischen Rhinitis. Schriftenreihe Health Technology Assessment; 2010. p. Bd. 96. https://doi.org/10.3205/hta000079L.
Gorenoi V, Schönermark MP, Hagen A. Perkutane Koronarinterventionen zusätzlich zur optimalen medikamentösen Therapie bei stabiler Angina Pectoris Schriftenreihe Health Technology Assessment; 2011. p. Bd. 115. https://doi.org/10.3205/hta000098L.
Schnell-Inderst P, Hunger T, Hintringer K, Schwarzer R, Seifert-Klauss V, Gothe H, et al. Individuelle Gesundheitsleistungen. Schriftenreihe Health Technology Assessment; 2011. p. Bd. 113. https://doi.org/10.3205/hta000096L.
Ekeland AG, Bowes A, Flottorp S. Effectiveness of telemedicine: a systematic review of reviews. Int J Med Inform. 2010;79(11):736–71. https://doi.org/10.1016/j.ijmedinf.2010.08.006. Epub 2010/10/05. PubMed PMID: 20884286.
Ernst E, Lee M. Ayurvedic medicine: an overview of systematic reviews. Perfusion. 2010;23:132–40.
Ernst E, Lee MS. Acupressure: an overview of systematic reviews. J Pain Symptom Manag. 2010;40(4):e3–7. https://doi.org/10.1016/j.jpainsymman.2010.07.003. Epub 2010/09/04. PubMed PMID: 20813496.
Ernst E, Lee MS. Acupuncture for rheumatic conditions: an overview of systematic reviews. Rheumatology (Oxford, England). 2010;49(10):1957–61. https://doi.org/10.1093/rheumatology/keq180. Epub 2010/07/02. PubMed PMID: 20591833.
Ernst E, Lee MS. How effective is yoga? A concise overview of systematic reviews. Focus Altern Complement Ther. 2010;15(4). https://doi.org/10.1111/j.2042-7166.2010.01049.x.
Ernst E, Lee MS, Choi TY. Acupuncture for depression?: a systematic review of systematic reviews. Eval Health Prof. 2011;34(4):403–12. https://doi.org/10.1177/0163278710386109. Epub 2010/12/09. PubMed PMID: 21138913.
Ernst E, Lee MS, Choi TY. Acupuncture for insomnia? An overview of systematic reviews. Eur J Gen Pract. 2011;17(2):116–23. https://doi.org/10.3109/13814788.2011.568475. Epub 2011/04/06. PubMed PMID: 21463162.
Ernst E, Posadzki P. Complementary and alternative medicine for rheumatoid arthritis and osteoarthritis: an overview of systematic reviews. Curr Pain Headache Rep. 2011;15(6):431–7. https://doi.org/10.1007/s11916-011-0227-x. Epub 2011/10/08. PubMed PMID: 21979101.
Ernst E, Posadzki P, Lee MS. Complementary and alternative medicine (CAM) for sexual dysfunction and erectile dysfunction in older men and women: an overview of systematic reviews. Maturitas. 2011;70(1):37–41. https://doi.org/10.1016/j.maturitas.2011.06.011. Epub 2011/07/26. PubMed PMID: 21782365.
Flodgren G, Eccles MP, Shepperd S, Scott A, Parmelli E, Beyer FR. An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database Syst Rev. 2011;(7):Cd009255. https://doi.org/10.1002/14651858.cd009255. Epub 2011/07/08. PubMed PMID: 21735443; PubMed Central PMCID: PMCPmc4204491.
Gibson M, Petticrew M, Bambra C, Sowden AJ, Wright KE, Whitehead M. Housing and health inequalities: a synthesis of systematic reviews of interventions aimed at different pathways linking housing and health. Health Place. 2011;17(1):175–84. https://doi.org/10.1016/j.healthplace.2010.09.011. Epub 2010/12/17. PubMed PMID: 21159542; PubMed Central PMCID: PMCPmc3098470.
Greaves CJ, Sheppard KE, Abraham C, Hardeman W, Roden M, Evans PH, et al. Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions. BMC Public Health. 2011;11:119. https://doi.org/10.1186/1471-2458-11-119. Epub 2011/02/22. PubMed PMID: 21333011; PubMed Central PMCID: PMCPmc3048531.
Heighes PT, Doig GS, Sweetman EA, Simpson F. An overview of evidence from systematic reviews evaluating early enteral nutrition in critically ill patients: more convincing evidence is needed. Anaesth Intensive Care. 2010;38(1):167–74. https://doi.org/10.1177/0310057X1003800126. Epub 2010/03/03. PubMed PMID: 20191793.
Hillberg T, Hamilton-Giachritsis C, Dixon L. Review of meta-analyses on the association between child sexual abuse and adult mental health difficulties: a systematic approach. Trauma Violence Abuse. 2011;12(1):38–49. https://doi.org/10.1177/1524838010386812. Epub 2011/02/04. PubMed PMID: 21288934.
Hopton A, MacPherson H. Acupuncture for chronic pain: is acupuncture more than an effective placebo? A systematic review of pooled data from meta-analyses. Pain Practi. 2010;10(2):94–102. https://doi.org/10.1111/j.1533-2500.2009.00337.x. Epub 2010/01/15. PubMed PMID: 20070551.
Huguet F, Girard N, Guerche CS, Hennequin C, Mornex F, Azria D. Chemoradiotherapy in the management of locally advanced pancreatic carcinoma: a qualitative systematic review. J Clin Oncol. 2009;27(13):2269–77. https://doi.org/10.1200/jco.2008.19.7921. Epub 2009/03/25. PubMed PMID: 19307501.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Nutzenbewertung nichtmedikamentöser Behandlungsstrategien bei Patienten mit essenzieller Hypertonie: Kochsalzreduktion. Rapid Rep. 2009:A05–21B. Available from: https://www.iqwig.de/download/A05-21B_Rapid_Report_Nichtmedikamentoese_Behandlungsstrategien_bei_Hypertonie_Kochsalzreduktion.pdf.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Positronenemissionstomographie (PET und PET/CT) bei malignen Lymphomen. IQWiG-Berichte; 2009. p. Nr. 47. Available from: https://www.iqwig.de/download/D06-01A_Abschlussbericht_PET_bei_malignen_Lymphomen.pdf.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Positronenemissionstomographie (PET) und PET/CT bei malignem Melanom. IQWiG-Berichte; 2011. p. Nr. 86. Available from: https://www.iqwig.de/download/D06-01F_Abschlussbericht_PET_und_PET-CT_bei_malignem_Melanom.pdf.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen. Positronenemissionstomographie (PET) und PET/CT bei Kopf- und Halstumoren. IQWiG-Berichte; 2011. p. Nr. 82. https://www.iqwig.de/download/D06-01B_AB_PET_und_PET-CT_bei Kopf-Halstumoren.pdf.
Jepson RG, Harris FM, Platt S, Tannahill C. The effectiveness of interventions to change six health behaviours: a review of reviews. BMC Public Health. 2010;10:538. https://doi.org/10.1186/1471-2458-10-538. Epub 2010/09/10. PubMed PMID: 20825660; PubMed Central PMCID: PMCPmc2944371.
Kamioka H, Tsutani K, Okuizumi H, Mutoh Y, Ohta M, Handa S, et al. Effectiveness of aquatic exercise and balneotherapy: a summary of systematic reviews based on randomized controlled trials of water immersion therapies. J Epidemiol. 2010;20(1):2–12. https://doi.org/10.2188/jea.je20090030. Epub 2009/11/03. PubMed PMID: 19881230; PubMed Central PMCID: PMCPmc3900774.
Kang HS, Jeong D, Kim DI, Lee MS. The use of acupuncture for managing gynaecologic conditions: an overview of systematic reviews. Maturitas. 2011;68(4):346–54. https://doi.org/10.1016/j.maturitas.2011.02.001. Epub 2011/03/08. PubMed PMID: 21376483.
Keus F, Gooszen HG, van Laarhoven CJ. Open, small-incision, or laparoscopic cholecystectomy for patients with symptomatic cholecystolithiasis. An overview of Cochrane Hepato-Biliary Group reviews. Cochrane Database Syst Rev. 2010;(1):Cd008318. https://doi.org/10.1002/14651858.cd008318. Epub 2010/01/22. PubMed PMID: 20091665.
Khambalia AZ, Dickinson S, Hardy LL, Gill T, Baur LA. A synthesis of existing systematic reviews and meta-analyses of school-based behavioural interventions for controlling and preventing obesity. Obe Rev:214–33. https://doi.org/10.1111/j.1467-789X.2011.00947.x. Epub 2011/11/11. PubMed PMID: 22070186.
Kumar A, Galeb S, Djulbegovic B. Treatment of patients with multiple myeloma: an overview of systematic reviews. Acta Haematol. 2011;125(1–2):8–22 https://doi.org/10.1159/000318880. Epub 2010/12/15. PubMed PMID: 21150183.
Lakke SE, Soer R, Takken T, Reneman MF. Risk and prognostic factors for non-specific musculoskeletal pain: a synthesis of evidence from systematic reviews classified into ICF dimensions. Pain. 2009;147(1–3):153–64. https://doi.org/10.1016/j.pain.2009.08.032. Epub 2009/10/06. PubMed PMID: 19800735.
Fischer S, Zechmeister I. Sakralnervenstimulation bei fäkaler Inkontinenz. Rapid Assessment. Wien: Ludwig Boltzmann Institut für Health Technology Assessment; 2011. p. Nr. 004. ISSN: 1996–935. Available from: http://docplayer.org/77796982-Sakralnervenstimulation-bei-f-kaler-inkontinenz.html.
Lee MS, Kim JI, Ernst E. Is cupping an effective treatment? An overview of systematic reviews. J Acupunct Meridian Studies. 2011;4(1):1–4. https://doi.org/10.1016/s2005-2901(11)60001-0. Epub 2011/03/29. PubMed PMID: 21440874.
Lenz M, Richter T, Mühlhauser I. Morbidität und Mortalität bei Übergewicht und Adipositas im Erwachsenenalter. Dtsch Arztebl Int. 2009;106(40):641–8. https://doi.org/10.3238/arztebl.2009.0641.
List T, Axelsson S. Management of TMD: evidence from systematic reviews and meta-analyses. J Oral Rehabil. 2010;37(6):430–51. https://doi.org/10.1111/j.1365-2842.2010.02089.x. Epub 2010/05/05. PubMed PMID: 20438615.
Maniglio R. The impact of child sexual abuse on health: a systematic review of reviews. Clin Psychol Rev. 2009;29(7):647–57. https://doi.org/10.1016/j.cpr.2009.08.003. Epub 2009/09/08. PubMed PMID: 19733950.
Maniglio R. Child sexual abuse in the etiology of depression: a systematic review of reviews. Depress Anxiety. 2010;27(7):631–42. https://doi.org/10.1002/da.20687. Epub 2010/03/26. PubMed PMID: 20336807.
Matheson SL, Green MJ, Loo C, Carr VJ. Quality assessment and comparison of evidence for electroconvulsive therapy and repetitive transcranial magnetic stimulation for schizophrenia: a systematic meta-review. Schizophr Res. 2010;118(1–3):201–10. https://doi.org/10.1016/j.schres.2010.01.002. Epub 2010/02/02. PubMed PMID: 20117918.
Matheson SL, Shepherd AM, Laurens KR, Carr VJ. A systematic meta-review grading the evidence for non-genetic risk factors and putative antecedents of schizophrenia. Schizophr Res. 2011;133(1–3):133–42. https://doi.org/10.1016/j.schres.2011.09.020. Epub 2011/10/18. PubMed PMID: 21999904.
Matyas E, Jeitler K, Horvath K, Semlitsch T, Hemkens LG, Pignitter N, et al. Benefit assessment of salt reduction in patients with hypertension: systematic overview. J Hypertens. 2011;29(5):821–8. https://doi.org/10.1097/HJH.0b013e3283442840. Epub 2011/04/09. PubMed PMID: 21475042.
Melnik T, Soares BG, Puga ME, Atallah AN. Efficacy and safety of atypical antipsychotic drugs (quetiapine, risperidone, aripiprazole and paliperidone) compared with placebo or typical antipsychotic drugs for treating refractory schizophrenia: overview of systematic reviews. Sao Paulo Med J. 2010;128(3):141–66. https://doi.org/10.1590/S1516-31802010000300007. Epub 2010/10/22. PubMed PMID: 20963366.
Mikton C, Butchart A. Child maltreatment prevention: a systematic review of reviews. Bull World Health Organ. 2009;87(5):353–61. https://doi.org/10.2471/BLT.08.057075. Epub 2009/06/25. PubMed PMID: 19551253; PubMed Central PMCID: PMCPmc2678770.
Minozzi S, Davoli M, Bargagli AM, Amato L, Vecchi S, Perucci CA. An overview of systematic reviews on cannabis and psychosis: discussing apparently conflicting results. Drug Alcohol Rev. 2010;29(3):304–17. https://doi.org/10.1111/j.1465-3362.2009.00132.x. Epub 2010/06/23. PubMed PMID: 20565524.
Moe RH, Kjeken I, Uhlig T, Hagen KB. There is inadequate evidence to determine the effectiveness of nonpharmacological and nonsurgical interventions for hand osteoarthritis: an overview of high-quality systematic reviews. Phys Ther. 2009;89(12):1363–70. https://doi.org/10.2522/ptj.20080398. Epub 2009/10/24. PubMed PMID: 19850713.
Monasta L, Batty GD, Cattaneo A, Lutje V, Ronfani L, Van Lenthe FJ, et al. Early-life determinants of overweight and obesity: a review of systematic reviews. Obes Rev. 2010;11(10):695–708. https://doi.org/10.1111/j.1467-789X.2010.00735.x. Epub 2010/03/25. PubMed PMID: 20331509.
Muangpaisan W, Brayne C. Systematic review of statins for the prevention of vascular dementia or dementia. Geriatr Gerontol Int. 2010;10(2):199–208. https://doi.org/10.1111/j.1447-0594.2009.00579.x. Epub 2010/01/27. PubMed PMID: 20100290.
O'Connor EA, Whitlock EP, Gaynes B, Beil TL. U.S. Preventive Services Task Force Evidence Syntheses, formerly Systematic Evidence Reviews. Screening for Depression in Adults and Older Adults in Primary Care: An Updated Systematic Review. Rockville: Agency for Healthcare Research and Quality (US); 2009. Available from: https://www.uspreventiveservicestaskforce.org/Home/GetFile/1/4285/depradultfinales/pdf.
Oestergaard S, Moldrup C. Improving outcomes for patients with depression by enhancing antidepressant therapy with non-pharmacological interventions: a systematic review of reviews. Public Health. 2011;125(6):357–67. https://doi.org/10.1016/j.puhe.2011.02.001. Epub 2011/05/24. PubMed PMID: 21600619.
Onakpoya IJ, Wider B, Pittler MH, Ernst E. Food supplements for body weight reduction: a systematic review of systematic reviews. Obesity (Silver Spring, Md). 2011;19(2):239–44 https://doi.org/10.1038/oby.2010.185. Epub 2010/09/04. PubMed PMID: 20814412.
Oxman AD, Fretheim A. Can paying for results help to achieve the millennium development goals? Overview of the effectiveness of results-based financing. J Evid Based Med. 2009;2(2):70–83. https://doi.org/10.1111/j.1756-5391.2009.01020.x. Epub 2009/05/01. PubMed PMID: 21348993.
Palmateer N, Kimber J, Hickman M, Hutchinson S, Rhodes T, Goldberg D. Evidence for the effectiveness of sterile injecting equipment provision in preventing hepatitis C and human immunodeficiency virus transmission among injecting drug users: a review of reviews. Addiction (Abingdon, England). 2010;105(5):844–59 https://doi.org/10.1111/j.1360-0443.2009.02888.x Epub 2010/03/12. PubMed PMID: 20219055.
Peters LW, Kok G, Ten Dam GT, Buijs GJ, Paulussen TG. Effective elements of school health promotion across behavioral domains: a systematic review of reviews. BMC Public Health. 2009;9:182. https://doi.org/10.1186/1471-2458-9-182. Epub 2009/06/16. PubMed PMID: 19523195; PubMed Central PMCID: PMCPMC2702385.
Posadzki P, Ernst E. Spinal manipulation: an update of a systematic review of systematic reviews. N Z Med J. 2011;124(1340):55–71. Epub 2011/09/29. PubMed PMID: 21952385. Available from: https://global-uploads.webflow.com/5e332a62c703f653182faf47/5e332a62c703f68a0b2fdd84_content.pdf.
Posadzki P, Ernst E. Systematic reviews of spinal manipulations for headaches: an attempt to clear up the confusion. Headache. 2011;51(9):1419–25 https://doi.org/10.1111/j.1526-4610.2011.01888.x Epub 2011/04/02. PubMed PMID: 21453329.
Ryan R, Santesso N, Hill S, Lowe D, Kaufman C, Grimshaw J. Consumer-oriented interventions for evidence-based prescribing and medicines use: an overview of systematic reviews. Cochrane Database Syst Rev. 2011;(5):Cd007768 https://doi.org/10.1002/14651858.CD007768.pub2. Epub 2011/05/13. PubMed PMID: 21563160.
Safron M, Cislak A, Gaspar T, Luszczynska A. Micro-environmental characteristics related to body weight, diet, and physical activity of children and adolescents: a systematic umbrella review. Int J Environ Health Res. 2011;21(5):317–30. https://doi.org/10.1080/09603123.2011.552713. Epub 2011/05/07. PubMed PMID: 21547807.
Safron M, Cislak A, Gaspar T, Luszczynska A. Effects of school-based interventions targeting obesity-related behaviors and body weight change: a systematic umbrella review. Behav Med (Washington, DC). 2011;37(1):15–25. https://doi.org/10.1080/08964289.2010.543194. Epub 2011/02/25. PubMed PMID: 21347906.
Salvo F, Fourrier-Reglat A, Bazin F, Robinson P, Riera-Guardia N, Haag M, et al. Cardiovascular and gastrointestinal safety of NSAIDs: a systematic review of meta-analyses of randomized clinical trials. Clin Pharmacol Ther. 2011;89(6):855–66. https://doi.org/10.1038/clpt.2011.45. Epub 2011/04/08. PubMed PMID: 21471964.
Savard LA, Thompson DR, Clark AM. A meta-review of evidence on heart failure disease management programs: the challenges of describing and synthesizing evidence on complex interventions. Trials. 2011;12:194. https://doi.org/10.1186/1745-6215-12-194. Epub 2011/08/19. PubMed PMID: 21846340; PubMed Central PMCID: PMCPMC3174117.
Schneider Chafen JJ, Newberry SJ, Riedl MA, Bravata DM, Maglione M, Suttorp MJ, et al. Diagnosing and managing common food allergies: a systematic review. JAMA. 2010;303(18):1848–56. https://doi.org/10.1001/jama.2010.582. Epub 2010/05/13. PubMed PMID: 20460624.
Seida JK, Ospina MB, Karkhaneh M, Hartling L, Smith V, Clark B. Systematic reviews of psychosocial interventions for autism: an umbrella review. Dev Med Child Neurol. 2009;51(2):95–104. https://doi.org/10.1111/j.1469-8749.2008.03211.x. Epub 2009/02/05. PubMed PMID: 19191842.
Smith CA, Cochrane S. Does acupuncture have a place as an adjunct treatment during pregnancy? A review of randomized controlled trials and systematic reviews. Birth (Berkeley, Calif). 2009;36(3):246–53. https://doi.org/10.1111/j.1523-536X.2009.00329.x. Epub 2009/09/15. PubMed PMID: 19747272.
Smith V, Devane D, Begley CM, Clarke M, Higgins S. A systematic review and quality assessment of systematic reviews of randomised trials of interventions for preventing and treating preterm birth. Eur J Obstet Gynecol Reprod Biol. 2009;142(1):3–11. https://doi.org/10.1016/j.ejogrb.2008.09.008. Epub 2008/11/11. PubMed PMID: 18996637.
Smith CA, Carmady B. Acupuncture to treat common reproductive health complaints: an overview of the evidence. Auton Neurosci. 2010;157(1–2):52–6. https://doi.org/10.1016/j.autneu.2010.03.013. Epub 2010/05/21. PubMed PMID: 20483671.
Spearing NM, Connelly LB. Is compensation "bad for health"? A systematic meta-review. Injury. 2011;42(1):15–24. https://doi.org/10.1016/j.injury.2009.12.009. Epub 2010/01/12. PubMed PMID: 20060524.
Swinkels A, Cochrane K, Burt A, Johnson L, Lunn T, Rees AS. Exercise interventions for non-specific low back pain: an overview of systematic reviews. Phys Ther Rev. 2009;14(4):247–59. https://doi.org/10.1179/174328809X452917.
Tamayo-Velazquez MI, Simon-Lorda P, Villegas-Portero R, Higueras-Callejon C, Garcia-Gutierrez JF, Martinez-Pecino F, et al. Interventions to promote the use of advance directives: an overview of systematic reviews. Patient Educ Couns. 2010;80(1):10–20. https://doi.org/10.1016/j.pec.2009.09.027. Epub 2009/11/03. PubMed PMID: 19879090.
Terry R, Perry R, Ernst E. An overview of systematic reviews of complementary and alternative medicine for fibromyalgia. Clin Rheumatol. 2012;31(1):55–66 https://doi.org/10.1007/s10067-011-1783-5. Epub 2011/05/27. PubMed PMID: 21614472.
Trudeau M, Green E, Cosby R, Charbonneau F, Easty T, Ko Y, et al. Key components of intravenous chemotherapy labeling: a systematic review and practice guideline. J Oncol Pharm Pract. 2011;17(4):409–24. https://doi.org/10.1177/1078155210385160. Epub 2010/09/30. PubMed PMID: 20876081.
van Achterberg T, Huisman-de Waal GG, Ketelaar NA, Oostendorp RA, Jacobs JE, Wollersheim HC. How to promote healthy behaviours in patients? An overview of evidence for behaviour change techniques. Health Promot Int. 2011;26(2):148–62. https://doi.org/10.1093/heapro/daq050. Epub 2010/08/27. PubMed PMID: 20739325; PubMed Central PMCID: PMCPMC3090154.
van der Feltz-Cornelis CM, Sarchiapone M, Postuvan V, Volker D, Roskar S, Grum AT, et al. Best practice elements of multilevel suicide prevention strategies: a review of systematic reviews. Crisis. 2011;32(6):319–33 https://doi.org/10.1027/0227-5910/a000109. Epub 2011/09/29. PubMed PMID: 21945840; PubMed Central PMCID: PMCPMC3306243.
Zwicker JG, Mayson TA. Effectiveness of treadmill training in children with motor impairments: an overview of systematic reviews. Pediatr Physical Ther. 2010;22(4):361–77. https://doi.org/10.1097/PEP.0b013e3181f92e54. Epub 2010/11/12. PubMed PMID: 21068636.
NIHR Centre for Reviews and Dissemination (CRD): Database of Abstracts of Reviews and Effects (DARE). https://www.crd.york.ac.uk/CRDWeb/. .
Canadian Agency for Drugs and Technologies in Health. https://www.cadth.ca/. Accessed 25 Feb 2020.
Brunton G, Harden A, Rees R, Kavanagh J, Oliver S, Oakley A. Promoting physical activity amongst children outside of physical education classes: a systematic review integrating intervention and qualitative studies. London: EPPI Centre; 2003.
Büssing A, Schnepp W, Ostermann T, Neugebauer E. Impact of yoga on chronic pain – a review. Eur J Integr Med. 2009;1:236–7.
Christopher FS. Adolescent Pregnancy Prevention. Family Relations, Vol. 44, No. 4, Helping Contemporary Families (Oct., 1995), pp. 384–391. https://www.jstor.org/stable/pdf/584994.pdf. Accessed 25 Apr 2019.
Clamp S, Keen J. The value of electronic health records: A literature review. Final report, December 2005. Yorkshire Centre for Health Informatics, University of Leeds. Available from: https://www.researchgate.net/publication/240702496. Accessed 25 Apr 2019.
Erny-Albrecht K, Valentine WJ, Christensen J, Vestenbaek U, Palmer AJ. Sublingual immunotherapy in allergic rhinitis and asthma: a review of recent clinical evidence. J Appl Res. 2007;7(1):17–31.
Evans S, Subramanian S, Sternlieb D. Yoga as treatment for chronic pain conditions: a literature review. Int J Disabil Hum Dev. 2008;7:25–32. https://doi.org/10.1515/IJDHD.2008.7.1.25.
Horta BL, Bahl R, Martinés JC, Victora CG. Evidence on the long-term effects of breastfeeding : systematic review and meta-analyses: World Health Organization; 2007. http://www.who.int/iris/handle/10665/43623. Accessed 25 Apr 2019.
Institute for Safe Medication Practices US. 'Principles of Designing a Medication Label for Injectable Syringes for Patient Specific, Inpatient Use', original website http://www.ismp.org/Tools/guidelines/labelFormats/injectionSyringe.asp (accessed by the Overview authors in March 2008; no longer accessible); updated website https://www.ismp.org/recommendations/designing-medication-label-injectable-syringes. Accessed 27 Feb 2018.
Nelson H, Westhoff C, Piepert J, Berg A. Screening for ovarian cancer: brief evidence update: AHRQ; 2004. https://www.uspreventiveservicestaskforce.org/Home/GetFile/1/900/ovcanup/pdf. Accessed 25 Apr 2019.
Shekelle PG, Goldzweig CL. Costs and benefits of health information technology: an updated systematic review. Southern California Evidence-based Practice Centre RAND Corporation. https://www.health.org.uk/publications/costs-and-benefits-of-health-technology-information. Accessed 25 Apr 2019.
Brunton G, Thomas J, Harden A, Rees R, Kavanagh J, Oliver S, et al. Promoting physical activity amongst children outside of physical education classes: a systematic review integrating intervention studies and qualitative studies. Health Educ J. 2005;64(4):323–38. https://doi.org/10.1177/001789690506400404.
ERIC - Education Resources Information Center. https://www.eric.ed.gov/.
Lunny C, Brennan SE, McDonald S, McKenzie JE. Toward a comprehensive evidence map of overview of systematic review methods: paper 2-risk of bias assessment; synthesis, presentation and summary of the findings; and assessment of the certainty of the evidence. Syst Rev. 2018;7(1):159. https://doi.org/10.1186/s13643-018-0784-8. Epub 2018/10/14. PubMed PMID: 30314530; PubMed Central PMCID: PMCPMC6186052.
Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, et al. An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006;6:33. https://doi.org/10.1186/1471-2288-6-33. Epub 2006/07/20. PubMed PMID: 16848895; PubMed Central PMCID: PMCPMC1557524.
MEDLINE Data Changes - 2019. NLM Technical Bulletin, 2018 Nov-Dec. https://www.nlm.nih.gov/pubs/techbull/nd18/nd18_medline_data_changes_2019.html. Accessed 6 Sept2019.
National Library of Medicine: Search Strategy Used to Create the PubMed Systematic Reviews Filter. www.nlm.nih.gov/bsd/pubmed_subsets/sysreviews_strategy.html. Accessed 20 Feb 2020.
Aromataris E, Fernandez R, Godfrey C, Holly C, Khalil H, Tungpunkom P. Chapter 10: Umbrella Reviews. In: Aromataris E, Munn Z, editors. Joanna Briggs Institute Reviewer's Manual: The Joanna Briggs Institute; 2017. Available from https://reviewersmanual.joannabriggs.org/.
Zemzem Cinar and Jelena Heitz are gratefully acknowledged for contributing to the assessment of database inclusion. We thank Camilo Vergara for insights into the Epistemonikos search and classification methods.
This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke University, Ostmerheimer Str. 200, 51109, Cologne, Germany
Käthe Goossen, Simone Hess & Dawid Pieper
Department of Anesthesiology, Pharmacology and Therapeutics, Faculty of Medicine, Cochrane Hypertension Review Group and the Therapeutics Initiative, University of British Columbia, 2329 West Mall, Vancouver, BC, V6T 1Z4, Canada
Carole Lunny
Käthe Goossen
Simone Hess
Dawid Pieper
SH performed database searches and collected data. KG designed the analysis methods, analysed and interpreted the data. KG and CL co-wrote the manuscript. DP conceived and supervised the research, and revised the manuscript. All authors read and approved the final manuscript.
Correspondence to Käthe Goossen.
Dataset generated and analysed during the current study.
Characteristics of included Overviews.
Goossen, K., Hess, S., Lunny, C. et al. Database combinations to retrieve systematic reviews in overviews of reviews: a methodological study. BMC Med Res Methodol 20, 138 (2020). https://doi.org/10.1186/s12874-020-00983-3
Review methods
Overview of reviews
Umbrella review


60 Kinoites produced 50 shorts this summer. Watch them all now!
KinoDynamqiue 2017 – register now!
KinoDynamique is back! 14th till 21st of August international filmmakers from other kino cells and locals engage in two collaborative filmmaking sessions of 60h each. The venue is an old horseracing-track at Vienna's "Prater". Join us now by filling out the registration form!
If you are new to the world of kino and haven't participated at KinoDynamique or any other international KinoKabaret – don't be shy. We value motivation and teamspirit above all other things. Check out our KinoDynamique page for more infos and a compilation of previous Dynamique shorts.
For more infos about this year's Dynamique click here.
How to make your own zombie and kill it.
and it all came to life in the SPLATTER-LAB!
So here are some of the videos that were produced during the 2nd Session within 60 hours.
So here are the films that were produced during the first 36 hours.
Als Rahmenprogram für das diesjährige KinoDynamique organisieren wir zwei musikalische Events. Zum Einen wird eine freie Jamsession im Brick5 geplant, und zum Anderen lassen wir das KinoDynamique mit einer großen Abschlussparty enden.


text:
Food Travel Leisure
Pacific Coast Way
Australia From Above
Category - New South Wales
Newcastle Children's Charity "Blown Away" By $10,000 Donation Despite Covid Cancellation
Like so many charity events in 2020, Charlie's Run 4 Kids was forced to cancel its major fundraiser, a 5-day run held every September to raise money for John Hunter Children's Hospital's Child Therapy Department and towards a family whose child is undergoing treatment. It goes without...
EPA seeking information after deliberate bird baiting
The NSW Environment Protection Authority (EPA) is appealing for information about the apparent poisoning of a large number of birds at a suburban Sydney park. The EPA...
NSW School kids are helping the planet this Fruit & Veg Month
The health of kids (and adults!) is closely tied to the health of our planet. So, for Fruit & Veg Month 2020, NSW primary school students will journey into "Planet...
Taxi driver allegedly caught drink-driving at Coffs Harbour
A taxi driver has been charged with mid-range drink-driving after being stopped by police at Coffs Harbour over the weekend. Officers attached to Coffs/Clarence Traffic...
Sweet gesture to commemorate Rosebery's history
In a nod to the suburb famed for its confectionary making, the City of Sydney is proposing to name two areas in Rosebery after of some of Australia's most-loved lollies...
Two men rescued after boat capsizes near Port Kembla
Two men have been rescued after spending at least two hours in the water in the Illawarra region. About 5.50pm yesterday (Wednesday 26 August 2020), emergency services...
Copyright © 2021 NEWS12 Australia

redpajama_set_name: RedPajamaCommonCrawl


Replace yourserver.com with the correct address of the server. You should be asked for a username and password and this should be the ones you used when you connected to the database using PHP.
Both localhost/phpmyadmin and 127.0.0.1/phpmyadmin should work. By default you will not need a password as XAMPP is not secure.
Check the settings but only one probably needs explanation. The server's connection collation is what set of text characters to use in queries. If utf8_general_ci or utf8_general_mysql500_ci are selected then leave it as it is. If not consider changing. These two provide all symbols for most character-based languages used (so not languages such as Mandarin or Kanji).


AntonellaSpirts BigCockAYUMI livejasmin. ISABEL9. SirJacques. ALLANIS.
CMBabydadMishaHottieKateAshLadyExperimental .EmilyRossSlaveMannSirJacquesmistressAnie .SandraMistressSandraMistressHeyHandsomesweetfrancyfra .sweetfrancyfraKateAshISABEL9SOFIII .iamxtremLorieJinNastyTeamshemaletsvip .LadyExperimentaldanielarodriguezKerryJonesFelipeReady4Play .vanessa173MyaXJustinKameliaMoreTeaghanlee .InnaBustyAsianMiastarcittyMargoJean .MilfDominiqueNastyandKinkyGrla0SensualSexAsianMia .shemaletsvipEmilyRossAmiPreciousBBRoseKamelya .AbbyJaymesNaomi88JuliaDiamond69RavennEve .
a0SensualSexrubbbykissRalunnasweetfrancyfra .Ink420NastyandKinkyGrlmistressAnieKerryJones .HannaTroyEbonyHotCpldariyamurrXxDOLCEAMORExX .RinaLimDanielaBadGirlsweetfrancyfraPunkgurl99 .AmiPreciousBBMyaXJustinCMBabydad0AssFieryLatin0 .SweetCuteTiffanyLadyExperimentalNastyTeamAlanisSub .TheWorldIsYourantonioxx1RalunnaAlanisSub .JanyceHottyFelipeReady4Playvanessa173rakesh2 .RinaLim0KarlaHotMyaXJustinKameliaMore .JaydenLynnxoxoSarytaaJuliaDiamond69EbonyHotCpl .LadyExperimentalAlanisSubblackNpetitexTiska .


What We Offer | The Youth Junction Inc.
The Youth Junction was formed in 1999 to design, develop and manage the vibrant Visy Cares Hub (the Hub) in Sunshine. In 2005, the Visy Cares Hub opened its doors to young people and today is the largest not-for-profit, co-located one-stop-shop facility of essential, well networked and appropriate youth services and programs that respond to the needs of disadvantaged young people aged between 12-25 years in Australia.
Collectively, the Visy Cares Hub houses 12 not-for-profit youth organisation and 20 youth specific programs, comprising in excess of 250 multidisciplinary staff who meet the diverse needs of approximately 18,000 young people per year, from across Melbourne's vast and rapidly growing North-West region.
Our Mission drives everything we do as a youth organisation and it frames our practice and sets the positive culture throughout the co-located model so that collectively we respond with quality, currency and integrity towards the disadvantaged young people we work with. We acknowledge the changing landscape we operate in; the broad youth continuum of 12-25 years that spans across the thirteen years of youth development needs; the rich multi-cultural environment of young people we interact with and the technological advances that continually shape our communication, engagement, promotion, and empowerment of young people, as they strive to reach their potential as healthy and engaged young adults.
TYJ Inc has three primary roles, first, as lead agency within the co-located model ensuring that spaces and services are capable of meeting the broad needs of young people that access the Visy Cares Hub; second, we facilitate a meeting every two months where the not-for-profit leaders collaborate to improve the approaches, interventions and initiatives that respond best to the needs of young people in Melbourne's North-West and third, to design, develop and sustain youth crime prevention programs that deter and divert young people from at-risk and unhealthful decisions, so that they successfully and positively transition into adulthood.
The Youth Junction recognises the growing need for a service in the northern suburbs of Melbourne that specialises in supporting youth within the justice system to address their risk factors and work towards reducing their chances of reoffending.
In 2017 The Youth Junction Inc. was granted funding from the Department of Justice and Regulation and Premier and Cabinet to trial the Youth Community and Law Program in Broadmeadows. We wasted no time and moved into our new home away from home, Youth Central in December 2017.
In an effort to achieve our goal we are now offering a number of programs from our Broadmeadows site including the Youth Community and Law Program, The Prevent Alcohol and Risk Related Trauma in Youth (P.A.R.T.Y) Program, Narrative Therapy – Speak-Ezy program and Countering Anger and Learning Moderation Program.
We started as a humble team of one and have recently expanded to having four Youth Junction Inc. staff in Broadmeadows offering a range of support for our clients. Much like our clients, our journey is still youthful but we are excited to be present in the north and look forward to continuing our work in Broadmeadows.
Funded by the Department of Justice and Regulation and Premier and Cabinet, the YCLP is a pre-sentence program for young adults aged 18 to 25 years, who have been referred either by the presiding Magistrates at the Sunshine, Werribee and now Broadmeadows Magistrates courts for additional support and intervention. The program is provided by The Youth Junction Inc. at the Visy Cares Hub in Sunshine and at Youth Central in Broadmeadows. It is designed to help reduce the risk of re-offending by addressing issues that precipitate the young person's offending behaviour. Due to the program's case management approach, the trained and experienced staff create a realistic and practical plan collaboratively with the young person.
The program not only provides individual intensive support to each young person, it ensures they are linked into various in-house co-located agencies, along with appropriate external services where required.
The YCLP reduces the risk of re-offending in two ways. First, the program helps young adults to address the root causes of their problems. Second, the program minimises the sentence that individuals receive, keeping many participants out of prison and the negative consequences incarceration produces.
Recent legislative changes have affected magistrates' ability to sentence individuals found guilty in their courts. The YCLP allows individuals to demonstrate tangible outcomes, including engagement with support services, giving magistrates confidence when determining an appropriate sentence.
By minimising the individual's interaction with the criminal justice system and incarceration rate, the YCLP offers economic benefits. The program's immediate benefit is to reduce the average incarceration time of program participants by 20 days. The cost-benefit analysis estimates reduced incarceration costs of $6,700 for each program participant. Further, the program improves the individual's employment outcomes, increasing the overall economic benefit to approximately $19,000 per person.
The NW-YLP is a Department of Education and Training funded project awarded to the north-west consortium of organisations including The Youth Junction, YouthNow, Centre for Multicultural Youth and Melton City Council to address the risk-taking and offending behaviour of young people aged 12-24 years, by implementing protective factors relating to education, employment and training across Melton, Wyndham and Brimbank. This program was launched in July 2018 and will work with at minimum 270 young people across a two year period to June 2020.
The Crime, Choices and Consequences Program (CCCP) is a pre-sentence program developed in 2010 for young adults aged 18-25 years who have been referred by the Sunshine and Werribee Magistrates Court to the Prevent Alcohol and Risk-related Trauma in Youth ( P.A.R.T.Y) Intervention Program. The program is provided by The Youth Junction Inc. (TYJinc.) in partnership with the Magistrates Court of Sunshine, Werribee and Broadmeadows, the Royal Melbourne Hospital (RMH), VicPol and the Judy Lazarus Transition Centre (JLTC).
To be eligible to participate in the CALM Program you must be aged between 16-25 years of age, and be experiencing difficulty managing anger and aggressive behaviors and thoughts.
Regular 1 hour sessions with our experienced anger management facilitator developing personalized anger management strategies to deal with each in individual specific needs.
In the absence of YUP, young people are likely to continue to experience vulnerabilities and a range of disadvantages that place them at significant risk. Many of the young people are disengaged from education, employment and training, exiting Out of Home Care or have recently been discharged from youth detention settings or police custody. Some are children of adults currently serving prison sentences and can also often be the carers of younger siblings or in the case of the older youth, have children of their own.
The UpBeat music production workshops, facilitated every Saturday between 2pm – 4pm is designed for young people to engage in freestyle, open forum for music and singing. The workshops offer qualified musicians to facilitate teaching young people music instruments, band sessions, recording studio to support recording of songs in any genre, studio sessions to learn how to produce, mix and master instrumental tracks. Live performance opportunities and assistance in booking and organising gigs. This unstructured workshop offers a safe, non-judgmental environment for young people to use music and singing as an outlet. The workshop has a zero tolerance to aggression, alcohol / drugs and reserves the right to restrict access to anyone.
The Upskill Barista is a 6-week Pre-accredited training program where we assist young people 16 – 25 years in gaining skills in coffee making the young people how to brewing coffee, steam the milk, foam art, customer service, housekeeping and money handling. The program provides young people with further skills in budgeting, OH&S and assist in building on team cohesion, cooperation and managing professional relationships. The program is a stepping stone to open the door to either further accredited study or potential employment opportunities with our partnering provider, Little Ray's Café based in Sunshine.
The Chop & Chat Cooking Program was established to assist disadvantaged young people and provide a range of cooking skills and techniques to support independent and healthy living. Young people are given an opportunity to learn about fresh produce and nutritional benefits, how to cook on a small budget and portion to last over a few days.
Need For P's is a driving program designed to assist disadvantaged young people in gaining their licence. Should a young person require assistance in achieving their learners permit or their probationary licence, and do not have current access to a vehicle, we may be able to assist in providing assistance for testing fees, support in gaining driving hours by offering 5x 45 min lessons via a qualified driving instructor. Positions are limited.
BOP is a well-known unstructured program facilitated every Friday night between 5pm – 8pm at the Victoria University Nicholson Street sports stadium. The soccer program offers young people an opportunity to gather in a safe environment, facilitated by a multi-skilled facilitator and play as many games of soccer; within the time frame. Pizza is provided every week and is a wonderful opportunity for young African males aged 16-28 years to play sport, learn team skills, build positive relationships and gain access to support should they require.
CAS is a 10-week pre-accredited program developed as a pathway to becoming a qualified Barber. The structured program offers an introduction into Barbering and the basics on cutting hair including hair art, cutting, styling, fading, customer service and foundation theory principles. The program is run weekly on a Wednesday 10am-5pm and is a direct pathway into a Certificate III in Barbering at Chisholm Institute, should participants meet 95% attendance and satisfactory efforts within the program.
Tushauriane – Let's talk about it.
providing holistic and person centred group and individual sessions to at risk youth of CALD background.
conducted in the group sessions and anything else the young person may want to talk about.
** All one-on-one sessions are by appointment only, please contact John on reception for more details on 9091 8200.


text:
Q: Change font color of "Appendices" page that appears with the appendix package I have the following minimal of code where I have some chapters and some appendices.
\documentclass[oneside]{book}
\usepackage[toc, page, title]{appendix}

\begin{document}

\tableofcontents

\include{chapter1}
\include{chapter2}

\begin{appendices}
\include{appendix1}
\include{appendix2}
\end{appendices}

\end{document}

This will insert a page that says "Appendices" before the appendices begin, such as the one below:

I have used a different font color for my chapter and section headings, so is it possible to change the font color of this page so that it says "Appendices" in a custom color (so that it matches my chapter and section headings)?

A: I solved the problem however a better solution may be available.
Based on:
Customize appendices environment to print 'Publications' instead of 'Appendices'
adding the following in the preamble will work:
\renewcommand\appendixpagename{\color{DESIRED_COLOUR}{Appendices}}

For example, to change the colour to blue:
\renewcommand\appendixpagename{\color{blue}{Appendices}}

redpajama_set_name: RedPajamaStackExchange


text:
EMS takes habitat of giant panda to London as part of Ogilvy campaign
PR Events
Event Marketing Solutions (EMS) has created an event structure to recreate the natural habitat of the giant panda in central London as part of an experiential campaign by Ogilvy Public Relations to ignite panda fever across the capital.
The EMS-designed Bamboo House toured London during Chengdu Panda Awareness Week, which ran from Monday 2 to Friday 6 July 2012. Created by Ogilvy UK, the week helped to raise awareness of the work of Chengdu Panda Base, a non-profit organisation based in a capital province of the giant panda's native home in southwest China.
EMS worked closely with the Ogilvy team to interpret their campaign vision. EMS conceived and built the 5x6m space, which is made predominantly from bamboo, the natural habChengdu Postcarditat of the giant panda. It was equipped with two large-format touch screens and iPads to create an interactive educational experience for visitors, who have been encouraged to spread the word via social media. There were also giveaways and competitions.
The three-day tour kicked off in Covent Garden before moving on to Southbank and Liverpool Street Station. EMS managed the logistics of the campaign, including set-up and dismantling. It also recruited and trained two brand ambassadors to further engage with the public and drive footfall to the stand.
Gemma Edney, Head of Client Services at EMS explains: "This is a great example of how we work with agencies to deliver a fully integrated campaign on behalf of their clients. We were briefed to create an environment which felt authentic, reflecting the mountains of Chengdu. A new challenge for our technical team was to source large quantities of bamboo in a relatively short space of time. The end result was a captivating and engaging experience that the public couldn't resist getting involved in."
EMS designed and built a 5x6m stand out of bamboo, creating a Bamboo House
The Bamboo House was part of an experiential campaign by Ogilvy to raise awareness of giant panda conservation issues and the Chengdu Panda Base
The three-day tour started on Wednesday 4 July 2012 in Covent Garden. It also visited Southbank and Liverpool Street Station.
Delivered by two brand ambassadors, recruited and trained by EMS
Supported by highly experienced EMS team who managed the logistics, setup and movement of the Bamboo House to ensure the smooth running of the tour


Bayaud Enterprises is joining many others in conducting street out reach for the Point in Time Survey. Everyone Counts is the annual, national Point-in-Time Survey led by our partner Metropolitan Denver Homeless Initiative (MDHI).
In collaboration with agencies and volunteers across the Metropolitan Denver region, we will conduct this survey to generate a "snapshot" of the individuals and families who are experiencing homelessness in our communities.
ted from the Point-in-Time survey to identify the trends and service needs of the homeless population in the Metro Denver region.
While helping to determine the scope of homelessness, the PIT raises public awareness, promotes collaboration across seven counties, provides needed data, helps us apply for increased housing funds, and reminds the community that Everyone Counts!
In order to successfully complete the Point-in-Time, we are seeking Volunteers to help with outreach the night of Monday, January 28th, 2019 from 4:30 pm – 9:30 pm. We are also seeking Volunteers for help with outreach during the day on Tuesday, January 29th, 2019.
This is an incredible opportunity to take a stand to help our community measure progress in decreasing homelessness, which will also help plan services and programs to appropriately address our local needs.
Please contact our Volunteer Manager, Kathy.McCall@bayaudenterprises.org if you are interested and meet the above requirements.


text:
FAQ: How Far Is Santa Cruz, Ca From San Jose, Ca?
1 How far is Santa Cruz from Sam Jose?
2 How long is Santa Cruz to San Jose?
3 What airport do you fly into to get to Santa Cruz California?
4 Is it better to stay in Monterey or Santa Cruz?
5 How much does Santa Cruz Beach Boardwalk cost?
6 Is Santa Cruz near San Francisco?
7 Is Santa Cruz Open?
8 Is Santa Cruz safe?
9 Where is Santa Cruz airport?
10 How long is LA to Santa Cruz?
11 Is Santa Cruz or Monterey cheaper?
12 Is it better to stay in Monterey or Carmel?
13 Where can I sleep on the Pacific Coast Highway?
How far is Santa Cruz from Sam Jose?
There are 26.40 miles from San Jose to Santa Cruz in southwest direction and 32 miles (51.50 kilometers) by car, following the CA 17 S route.
How long is Santa Cruz to San Jose?
There is a 31 miles distance between Santa Cruz and San Jose. It takes approximately 39 minutes to drive from Santa Cruz to San Jose.
What airport do you fly into to get to Santa Cruz California?
The nearest major airport is San Jose International Airport, 30 miles northeast of Santa Cruz. The nearest train depot is also located in San Jose. San Francisco International Airport is approximately 60 miles north of Santa Cruz, and Oakland International Airport is approximately 65 miles north of Santa Cruz.
Is it better to stay in Monterey or Santa Cruz?
Re: Road Trip: Where to stay Monterey or Santa Cruz? Both are good choices. Santa Cruz is more of a classic CA beach town with a surf culture and an eclectic downtown. Its kind of a funky sort of place, a bit off-beat.
You might be interested: Question: How Many Students Are At Uc Santa Cruz?
How much does Santa Cruz Beach Boardwalk cost?
The Boardwalk is admission-free. If you'd like to take a stroll and enjoy the colorful oceanfront scene, it's free and open to the public, even when the rides are closed.
Is Santa Cruz near San Francisco?
Santa Cruz is between about 75 miles from San Francisco (roughly 1 hr 15 min if you drive). So if time is of the essence, then it's recommended that you drive there.
Is Santa Cruz Open?
Santa Cruz County is open for business and ready to welcome you! Hotels, resorts, spas, restaurants, wineries, attractions, museums, parks, and more – take a look below for what to expect during your visit!
Is Santa Cruz safe?
Is Santa Cruz, CA Safe? The D+ grade means the rate of crime is higher than the average US city. Santa Cruz is in the 26th percentile for safety, meaning 74% of cities are safer and 26% of cities are more dangerous.
Where is Santa Cruz airport?
Santa Cruz Island Airport, in Santa Barbara, California, US. Chhatrapati Shivaji Maharaj International Airport, located in Santacruz, a suburb of Mumbai, India.
How long is LA to Santa Cruz?
The distance between Los Angeles and Santa Cruz is 295 miles. The road distance is 341.5 miles.
Is Santa Cruz or Monterey cheaper?
Monterey is 8.8% less expensive than Santa Cruz. Monterey housing costs are 12.5% less expensive than Santa Cruz housing costs.
Is it better to stay in Monterey or Carmel?
Carmel is more quaint village with beach access. Monterey is more family friendly working coastal/pier town. If it was a relaxing trip, I'd definitely pick Carmel- better food, better browsing, more picturesque. No need to drive to Carmel.
You might be interested: Quick Answer: Where Is The Smoke Coming From In Santa Cruz?
Where can I sleep on the Pacific Coast Highway?
USA: 5 Great Towns For An Overnight Stay Along The Pacific Coast Highway, California
Monterey. (San Francisco – Monterey: 1 h 56 min, 120 miles)
Cambria. (Monterey – Cambria: 2 h 29 min, 141 miles)
Pismo Beach. (Cambria – Pismo Beach: 52 min, 46 miles)
Solvang. (Pismo Beach – Solvang: 52 min, 53.9 miles)
Santa Monica.
Question: How Long Can You Park A Trailer On The Street In Santa Cruz Ca?
FAQ: What Makes Uc Santa Cruz Different From Other Ucs?


text:
Q: How do I enable Live Syntax Checking in the Ace Editor Ace Editor has Live Syntax Checking, which can check code as it's being typed for syntax errors.
I have a Rails 3.2 site with the Ace file included on each coding page. I added a require statement to the javascript to tell Ace where the worker file is, but it's still not working. How do I get Live Syntax checking to work?
Each coding page includes:
<%= javascript_include_tag "ace-src/ace.js" %>
<%= javascript_include_tag "ace-editor" %>

The Ace files are located in the ace-src folder. I aded this code to ace-editor.js:
require("ace/config").set("workerPath", "/assets/ace-src");

A: Syntax checking is done via webworker which loads http://www.learneroo.com/assets/ace-src/worker-javascript.js file, but in your site that file seems to be empty. I only see ; in it.
In the jsfiddle i showed earlier http://jsbin.com/ojijeb/432/edit, it didn't work because of cross origin restrictions on web workers (which i didn't notice since was running chrome with --disable-web-security), but thanks to latest Ace update, it works now.


text:
Q: Chrome Beta Issue : Inspite of SameSite cookie set to "None" and secure, third party cookie not received I am implementing samesite=None;Secure to a page for cross domain access on chrome beta Version 80.0.3987.78 (Official Build) beta (64-bit)..
While loading the page I see that the attributes are applied correctly, but i still get the console error saying the cookie will not be sent.
Developer Tools->Application->Cookies (My only one cookie, set with samesite="None"; Secure)
Cookies Set
The error message from console:
A cookie associated with a cross-site resource at https://mycw125.***.com/ was set without the SameSite attribute. It has been blocked, as Chrome now only delivers cookies with cross-site requests if they are set with SameSite=None and Secure. You can review cookies in developer tools under Application>Storage>Cookies and see more details at https://www.chromestatus.com/feature/5088147346030592 and https://www.chromestatus.com/feature/5633521622188032.
Console Error
My functionality is broken as well since the cookie is not sent. Could someone help me understand what is going wrong?
I am using chrome Version 80.0.3987.78 (Official Build) beta (64-bit).
We have seen a discrepancy in chrome behavior. This functionality works intermittently as expected, and loads the page with same cookie. It then breaks after that.

A: Is there maybe another cookie that is being blocked? Does it show up on the Network panel when you click on the affected request? Here are some more ideas to try: https://www.chromium.org/updates/same-site/test-debug.

A: In more recent versions of Chrome, the Issues panel shows more information about which cookies and what URLs are involved in issues such as this.


1. In order to examine the potential role of atrial natriuretic factor in modulating the increased sodium excretion per nephron in chronic renal failure, we studied 12 uraemic patients on the last day of two successive 7 day periods during which their sodium intake was 100 and 20 mmol of sodium/day, respectively.
2. There was a parallel decrease from 6.31 ± 0.75 to 2.17 ± 0.32% in the fractional excretion of filtered sodium and from 234.4 ± 74.9 to 80.6 ± 20.3 pg/ml (supine position) or 140.1 ± 43.6 to 60.7 ± 14.6 pg/ml (upright position) in plasma atrial natriuretic factor. Both parameters were significantly correlated during the two periods of different sodium intake (P <0.05). The ratio of plasma guanosine 3′:5′-cyclic monophosphate to plasma creatinine changed proportionally to plasma atrial natriuretic factor. Plasma aldosterone and plasma renin activity increased during the sodium-depleted period but only plasma renin activity was significantly correlated with fractional excretion of filtered sodium.
3. The predominant role of atrial natriuretic factor compared with that of aldosterone in the renal response to varying sodium intake is suggested both by regression analysis and by the effect of 5 day's treatment with a converting enzyme inhibitor (enalapril) in six other uraemic patients on a normal (100 mmol/day) sodium intake. Such treatment, although resulting in a significant increase in plasma renin activity and a significant decrease in plasma aldosterone, at least in the supine position, did not modify the fractional excretion of sodium and plasma atrial natriuretic factor.
4. Taken together, these results suggest a role for plasma atrial natriuretic factor in promoting the adaptation of sodium excretion on chronic changes of sodium intake in patients with chronic renal failure.