Data Science, Product Analytics, Ab Testing, Simulation, Deep Dives.
val_sim_df.ci_lower.map( lambda x: 1 if x > 0 else 0) val_sim_df.groupby(['sample_size', 'effect_size']).aggregate( { 'successful_experiment': 'mean', 'experiment_id': 'count' } ) We've started with just 20 simulated experiments and 1000 bootstrap simulations to estimate their confidence interval.