Is it possible to call the hosted text-generation APIs in such a way as to get low-latency partial streaming results, without having to wait for the full completion to be returned as JSON?
OpenAI has a stream parameter, documented here:

  
      

      beta.openai.com
  

  
    

OpenAI API

  An API for accessing new AI models developed by OpenAI


  

  
    
    
  

  


And InferKit has a streamResponse parameter, documented here:
https://inferkit.com/docs/api/generation
But I can’t find anything similar in the Huggingface API docs:

  

      api-inference.huggingface.co
  

  
    

Detailed parameters

  Which task is used by this model ?: In general the 🤗 Hosted API Inference accepts a simple string as an input. However, more advanced usage depends on the “t...