A judgement was made about the strength of the evidence base, taking into account quality and risk of bias, quantity of evidence and level of evidence. Agreement was sought between three independent raters and consensus about the strength of the evidence base was obtained according to the following categories. High strength Moderate strength Low strength One or more level I One or two level II One or more level I studies with a low studies with a low to level IV study risk of bias OR three risk of bias OR two or with a high risk of or more level II more level III studies bias studies with a low with a low risk of bias risk of bias Direction The direction component of the ranking system a judgement as to whether the results are in a positive or negative direction. In cases where there are studies which show findings in different directions, preference is given to the direction of the study findings with the highest level and best quality. Positive direction Unclear direction Negative direction The weight of the The evidence does The weight of the evidence indicates not show significant evidence indicates positive results effects OR the results negative results are mixed Consistency The consistency component of the ranking system of the body of the evidence assesses whether the findings are consistent across the included studies (including across a range of study populations and study designs). It was important to determine whether study results are consistent to ensure that the results are likely to be replicable or only likely to occur under certain conditions. Most studies are consistent and inconsistency may be explained, All studies are All studies are reflecting that Some inconsistency inconsistent consistent reflecting results are reflecting that reflecting that that results are moderately- highly results are results are highly highly likely to be likely to be somewhat unlikely unlikely to be replicable replicable to be replicable replicable
A judgement was made about the strength of the evidence base, taking into account quality and risk of bias, quantity of evidence and level of evidence. Agreement was sought between three independent raters and consensus about the strength of the evidence base was obtained according to the following categories. High strength One or more level I studies with a low risk of bias OR three or more level II studies with a low risk of bias Moderate strength One or two level II studies with a low risk of bias OR two or more level III studies with a low risk of bias Low strength One or more level I to level IV study with a high risk of bias Direction The direction component of the ranking system a judgement as to whether the results are in a positive or negative direction. In cases where there are studies which show findings in different directions, preference is given to the direction of the study findings with the highest level and best quality. Positive direction The weight of the evidence indicates positive results Unclear direction The evidence does not show significant effects OR the results are mixed Negative direction The weight of the evidence indicates negative results Consistency The consistency component of the ranking system of the body of the evidence assesses whether the findings are consistent across the included studies (including across a range of study populations and study designs). It was important to determine whether study results are consistent to ensure that the results are likely to be replicable or only likely to occur under certain conditions. All studies are consistent reflecting that results are highly likely to be replicable Most studies are consistent and inconsistency may be explained, reflecting that results are moderately- highly likely to be replicable Some inconsistency reflecting that results are somewhat unlikely to be replicable All studies are inconsistent reflecting that results are highly unlikely to be replicable
Question%2012%20Adjustment%20Disorder%20Technical%20Report%202017.docx