Usually you are using an output layer with the same number of outputs as your number of classes.
If you need a feature vector in another shape, you could use the e.g. penultimate layer output for it (sometimes called FC7 features IIRC).