Residents of Cape Coast were thrilled to see the moisture-blackened castle spruced up , but African-Americans living in Ghana were horrified , feeling that the history of their ancestors was being , quite literally , whitewashed . ''