But the idolaters say : " If God had so willed we would not have associated ( others with Him ) , nor would have our fathers , nor would we have forbidden any thing . " So had others denied before them , and had to taste Our punishment in the end .