The Spanish settled the land and grew crops here in the 17th century , but the fine great house was built by English colonists in the 18th century .
The English colonists arrived shortly after the Spanish settlers .