Both populations grew from the 1950s until the late 1970s , but the populations then fell and plateaued throughout the 1980s due to a reduction in the number of foreign workers coming to the country , and the legalization of abortion and greater access to contraception ( there was also a period known as the 'pill-drop-off ' in the 1960s , where the birth rate decreased dramatically ) .