I assume your Flask application would have some kind of initialization method, where you could setup your model and just create the prediction for each request.
Based on your description it seems that you are recreating the model for each request, is that correct?