What if it was nonlinear regression, would you still want to remove non-linearity?
Also, are the activation functions in the layers before the output layer typically the same for regression and classification?