 The position that there are both formal numbers and mathematical numbers Aristotle ascribes to Plato. Speusippus rejects the formal numbers (and the entire theory of forms along with them; see the entry on  Speusippus).  The position Aristotle ascribes to Xenocrates is a bit more elusive.