 If one does not want to appeal to full second-order logic, then there are other ways to ensure categoricity of mathematical theories. One idea would be to make use of quantifiers which are somehow intermediate between first-order and second-order quantifiers. For instance, one might treat “there are finitely many x” as a primitive quantifier. This will allow one to, for instance, construct a categorical axiomatization of arithmetic.