As I am currently the only slave to attempt using imperial I consider it this way: though it is not commonaly spoken to the slaves , slaves do still tend their masters when they are speaking with other free peoples so it is likely that over time one may understand at least a few words here and there. Maybe I'm completely off base but it makes sense to me.