I'ts nobodies business why he hasn't retired.
Allegations, no convictions.  Again I ask, is there anything recent? 
His actions were not appropriate. However, he was not a public servant at the time nor did he have any intentions of becoming one. No one has given him a pass on these either. He has admitted his poor choices and bad behavior. Unless it continues we have to give him grace and let the past be the past. I'm not surprised at all that he used vulgar and boastful language to impress another man. It's what a lot of guys do. It doesn't mean they are incompetent or a pervert. Bill Clinton was no better while he was President, so we unless are going to hold all to the same standard, what's the point?
I don't see any substantiated charges of misuse of public funds to meet at the secure location of his choice. He has reason to be suspicious of being eavesdropped on. By saving millions on Air Force he has shown to be fiscally responsible and sensitive to the national budget.