Question regarding post-hoc power analysis I am having trouble with interpretation of a prospective superiority randomised controlled trial. Study characteristics:
Study design:

*

*Alpha value = 0.05

*1-beta = 0.8

*Predicted effect size =0.15 [P1 = 0.65, P2 = 0.5]

*Numbers needed = 492

Observed results:

*

*Effect size = 0.09 [P1 = 0.50, P2 = 0.41]


*Numbers enrolled = 502


*statistically significant P value -> P = 0.03


*null hypothesis is rejected.
My impression is that the trial underestimated the effect size. If I use the observed results to calculate a sample size that would take into the effect size (same alpha and beta), I get a numbers needed of 900+ patients. This would suggest that the trial is actually under powered. And potentially, the result we see is a false positive result.

"My impression is that the trial underestimated the effect size." The only reason to believe this is if you have good prior information such as existing prior data that indicates that the effect should be larger. The computed numbers give no indication whatsoever that the effect size is underestimated, or rather, it may be underestimated as well as overestimated due to standard statistical variation. "And potentially, the result we see is a false positive result." - This is always a possibility with p=0.03. Once more, the post hoc power analysis is not informative about this.
