Born in Killane, County Wexford, Rackard was introduced to sport by his father who had hoped he would become a cricketer. His uncle, John Doran, won an All-Ireland medal as a Gaelic footballer with Wexford in 1918 and it was hurling and Gaelic football that Rackard developed a talent for.