Common reporting styles of statistical results, such as  confidence intervals (CI), are prone to dichotomous interpretations especially on null hypothesis testing frameworks , for exampleby claiming significant differences between drug treatment and placebo groups due to the non-overlapping CIs of the mean effects , while disregarding the magnitudes and absolute difference in the effect sizes. Techniques relying on the visual estimation of the strength of evidence have been recommended to limit such dichotomous interpretations but their effectiveness has  been challenged. We ran two experiments to compare several representation alternatives of confidence intervals , and used Bayesian multilevel models to estimate the effects of the representation styles on differences in subjective confidence of the results and preferences in visualization styles. Our results suggest that adding visual information to classic CI representation can decrease the sudden drop around p-value 0.05 compared to classic CIs and textual representation of  CI with p-values. All data analysis and scripts are available at URL 
Common reporting styles for statistical results, such as p-values and confidence intervals (CI), have been reported to be prone to dichotomous interpretations , especially with respect to null hypothesis testing frameworks . For example, when the p-value is small enough or the CIs of the mean effects of a studied drug and a placebo are not overlapping, scientists tend to claim significant differences while often disregarding the magnitudes and absolute differences in the effect sizes. Techniques relying on the visual estimation of the strength of evidence have been recommended to reduce such dichotomous interpretations but their effectiveness has also been challenged. We ran two experiments to compare several alternative representations of confidence intervals and used Bayesian multilevel models to estimate the effects of the representation styles on differences in subjective confidence in the results. We also asked the respondents' opinions and preferences in representation styles. Our results suggest that adding visual information to classic CI representation can decrease the tendency towards dichotomous interpretations - measured as the "cliff effect": the sudden drop in confidence around p-value 0.05 - compared with classic CI visualization and textual representation of the CI with p-values. As a contribution to open science, our data and all analyses are publicly available at URL .
R
of
for
A
p-values and
R
are
have been reported to be
R
especially on
, especially with respect to
R
, for exampleby claiming significant differences between drug treatment and placebo groups due to the non-overlapping
. For example, when the p-value is small enough or the
R
, while
of a studied drug and a placebo are not overlapping, scientists tend to claim significant differences while often
R
difference
differences
R
limit
reduce
A
also
R
representation alternatives
alternative representations
D
,
R
of the results
in the results. We also asked the respondents' opinions
R
visualization
representation
R
sudden drop
tendency towards dichotomous interpretations - measured as the "cliff effect": the sudden drop in confidence
R
compared to classic CIs
- compared with classic CI visualization
A
the
R
All data analysis and scripts are
As a contribution to open science, our data and all analyses are publicly
A
.