Measuring the magnitude and the significance of the difference of two binomial samples I have two samples with binomial distribution. In one of them, the proportion of successes was 10/20 (0.5), and in the other the proportion of successes was 5/20 (0.25). I want to test whether the difference between the two is significant and what is the magnitude of the difference.
I thought of using the following code in R:
prop.test(c(10,5),c(20,20))

Which generates the following result:
2-sample test for equality of proportions with continuity correction

data:  c(10, 5) out of c(20, 20)
X-squared = 1.7067, df = 1, p-value = 0.1914
alternative hypothesis: two.sided
95 percent confidence interval:
 -0.08988258  0.58988258
sample estimates:
prop 1 prop 2 
  0.50   0.25

Question: Can I use the chi square value (1.7067) as a measure of magnitude and the p value (0.1914) as a measure of the significance of the difference between the two samples?
Is there a better way to answer these questions?

Adding to the good answers that talked about statistical significance.  You also asked about magnitude of difference. The simplest way to look at that is to say what you said in your question: One had 50% success, the other had 25% success.
Or, you could look at an odds ratio. You have something like this (formatting tables here is hard, at least for me)
               S      F
A              10    10
B               5    15

So, the OR would be $\frac{10*15}{5*10} = \frac{150}{50} = 3$
And you could use R to get the 95% CI for the OR, if you wanted.
Or you could calculate relative risk: $\frac{10/(10+10)}{5/(5+15)} = \frac{.5}{.25} = 2$  which is as expected.
