I think averaging uncorrelated outputs could yield a performance gain. Generally you could take the average of a lot of weak models, if their performance is at least better than a random guess.

For 2. and 3. I would refer to @rasbt’s post on cross validation 2.