They are in fact connected and the Emperor was a great giver of the circus games and could easily come down to the Imperial box from the palace, or if he even wanted he could watch the circus races at the Palace.