Post
223
π’ Following the bulk-chain v1.1.0 release and its minimalistic integration and real-world deployment on async inference with your LLM provider. Below is an example of tk-sheet for spreadsheet-style LLM reasoning
π We use the concept of asyncio loops. You can set event loop of the utilized framework. At present it converts async generators to sync.
https://stackoverflow.com/questions/71580727/translating-async-generator-into-sync-one/79617639#79617639
π The integration demo:
https://github.com/nicolay-r/bulk-chain-tksheet-client
π The provider:
https://github.com/nicolay-r/nlp-thirdgate/blob/master/llm/replicate_104.py
π We use the concept of asyncio loops. You can set event loop of the utilized framework. At present it converts async generators to sync.
https://stackoverflow.com/questions/71580727/translating-async-generator-into-sync-one/79617639#79617639
π The integration demo:
https://github.com/nicolay-r/bulk-chain-tksheet-client
π The provider:
https://github.com/nicolay-r/nlp-thirdgate/blob/master/llm/replicate_104.py