Many of the displaced musicians say that what made New Orleans special was the unbroken tradition of its musical heritage , extending back to the days before the Civil War , when slaves would gather on Sundays in places like Congo Square to play music in celebration or in mourning .