I think you should keep people in prison if they are a physical danger to others.
For other things, like embezzlement, it may be different.  This can be handled financially with expropriation to and payback.