Once you deploy a REST API, users will typically send requests to a server and the server resolves these (server-side) and returns corresponding responses. That said, even model inference will be done on the API server and a user will receive a prediction response…

Because if it uses server’s CPU, I think it’ll cause a bottleneck, won’t it?

If you choose the wrong hardware (a weak CPU) it definitely will cause slow response times.