Well, electrons don't simply come off the atoms by themselves. Remember, electrons are held together by electrostatic force that comes from the positively charged nucleus and the negatively charged electrons. So something must pull those electrons away. In other words, work or energy must be inputted into our system to pull that electron off. So therefore, we can define our ionization energy to be the energy required to pull off that electron. That outermost electron.