The idolaters say : " If God had willed we would not have worshipped anything apart from Him , nor would our fathers have done , nor would we have forbidden any thing without His ( leave ) . " So had the people done before them .