Personally it seems like all the kerfuffle about a letter vs envelope is besides the point, did he show up at his colleague's home unprompted, even once? If so, that's a massive problem and he should have been removed.