I just meant the last non-linearity. The activation functions between the layers should still be used. I would try to use pretty much the same architecture besides the small changes necessary for regression.