The House of Commons does not stand as a symbol honouring oppression or slavery.  While that is a part of the Canadian story, it is not the full picture.   The HoC stands as a symbol that expresses the values we hold dear today.   

Robert E. Lee was a hero of the Confederate army.  He was a slave owner and racist at a time when his values were being challenged.   He did not stand for the American ideal of equality.   He sought to bring down America with war.   He is certainly an important character in history and should be remembered for what he was:  A man who enslaved his equals for his personal gain.   His statue should stand in a museum.   It should not be honoured or revered in a public park.  There are no statues of Hitler in Germany.   

It is ok to change our view of past wrongs.  That doesn't mean that DT must apologize for slavery.  Letting go of the symbols of our past wrongs is a good thing, it is progression.