Historians say it was New Orleans 's position as a crossroads and port town that allowed for the easy mingling of races and nationalities that in turn gave birth , in the 18th century , to a part-European , part-Afro-Caribbean society that grew to an estimated 20,000 people in Louisiana by the mid-1800 's .