Good question. Also, is Tony the only person who can interact with/control Jarvis? I imagined Jarvis would be controlling most things in the tower so if it works the security system then anyone entering the building would need to interact with it just a bit. Unless I'm wrong and Jarvis is isolated to wherever Tony works.