'People that really want a house with a yard can start with something small and keep upgrading'
You are delusional. The point is that they cannot start with 'something small.'  The price of 'something small' in Toronto is $900,000. Young couples cannot afford that. There is no "individual choice" as you suggest. Either you rent or move to Woodstock. 
Clearly, something has to change.