You are wrong about the Charter.

Go and read the section pertinent to this: Mobility in Canada, moving from somewhere else to a new place in Canada.

"Every citizen of Canada and every person who has the status of a permanent resident of Canada has the right to move to and take up residence in any province".

Sorry, dude, nothing in there about foreign house buyers. It says permanent residents and citizens only.

On that section, the Supreme Court has never ruled any other way.