If you will see how the audience of the town hall that Gardner tried to hold, you will understand why he does not like to hold them.  Kind of hard to have a good debate when the audience is doing nothing but yelling and interrupting him the whole time.