📢 For those who start to work with LLM streaming in web, here is a minimalistic example in JS for accessing server hosted by FastAPI via REST:
text
📢 For those who start to work with LLM streaming in web, here is a minimalistic example in JS for accessing server hosted by FastAPI via REST:
new_line
https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
link
new_line
new_line
The code above is a revised verison for accessing Replicate API posted earlier
text
The code above is a revised verison for accessing Replicate API posted earlier
new_line
https://huggingface.co/posts/nicolay-r/390307941200307
https://huggingface.co/posts/nicolay-r/390307941200307
link
new_line
new_line
The key difference from Replicate API:
text
The key difference from Replicate API:
new_line
- using only POST for passing a body with parameters and fetching the reader.
text
- using only POST for passing a body with parameters and fetching the reader.
📢 For those who start to work with LLM streaming in web, here is a minimalistic example in JS for accessing server hosted by FastAPI via REST:
https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59

The code above is a revised verison for accessing Replicate API posted earlier
https://huggingface.co/posts/nicolay-r/390307941200307

The key difference from Replicate API:
- using only POST for passing a body with parameters and fetching the reader.
👀
John6666 victor
🔥
Boqua dantezxcd
❤️
Akseltinfat dantezxcd