Many, not all of those monuments were erected in the early 1900s, not right after the civil war.  As for taking them down, I am pretty mixed on the idea, ultimately, they are monuments to traitors, not patriots.  

https://en.wikipedia.org/wiki/List_of_monuments_and_memorials_of_the_Confederate_States_of_America