Hey @Matthieu, I haven’t tried cortex so cannot comment on their latency / throughput (although I guess it is pretty good since their whole business model is based on production ML). For FastAPI vs FastAPI + Docker, I would not expect any noticeable differences, although the advantage of using Docker is that you can quickly deploy the API on different machines without needing to manually install everything each time.
If you try cortex, I would be really interested to hear what you think of it!