Stephen Harper , left , was sworn in as Canada 's 22nd prime minister , taking over from Paul Martin two weeks after the Conservative Party won a narrow victory against Mr. Martin and his long-governing Liberal Party .