And Egg Harbor Township , which starts just across Lake 's Bay from Atlantic City and had 19,381 residents in 1980 , had an estimated population of 37,000 in 2004 and is likely to soon surpass Atlantic City as the most populous town in Atlantic County .