Fission: Serverless Functions as a Service for Kubernetes
From the article:<p>> To optimize cold start overheads, Fission keeps a running pool of containers for each environment. When a request for a function comes in, Fission doesn't have to deploy a new container -- it just chooses one that's already running, copies the function into the container, loads it dynamically, and routes the request to that instance. The overhead of this process takes on the order of 100msec for NodeJS and Python functions.<p>100 ms of overhead is pretty steep. Google recommends a limit of twice that for the entire server response (<a href="https://developers.google.com/speed/docs/insights/Server#recommendations" rel="nofollow">https://developers.google.com/speed/docs/insights/Server#rec...</a>):<p>> You should reduce your server response time under 200ms<p>Still, I've heard that AWS Lambda may run around 200 ms, so perhaps Fission is doing OK here.<p>But with modern progress in fast-starting compiled languages like Go and Rust, I'd love to have some easy way to supply small static binaries instead of source code. With compiled web server frameworks, it's feasible to handle over 250,000 (very simple) requests per second, or thousands of requests while Fission is trying to figure out where to send your source code. It doesn't always make sense to pay for interpreter startup overhead on every request (EDIT: this is not the case according to the Fission developers), especially not now that compiled code is so easy.