text: Title: app module gets executed twice when serving app
  Body: This has been a known problem for a while, but I'd figure I'll document it.
  
  Issue:
  1. Create an app `app.py`.
  2. Run `python app.py serve`
  3. app.py gets executed twice, once to execute the module and find the cli, second to import the module from the server module
  
  Ideal behavior:
  `app.py` only gets executed once. I'm not sure if this is possible however with the current architecture.