📢 For those who in textual IR and experimenting with quick deployment of CoT / reasoning, the following update might be relevant. I am happy to announce new version of the bulk-chain 0.25.3. It is a no-string framework for quick application of reasoning schema adaptation over your data.
text
📢 For those who in textual IR and experimenting with quick deployment of CoT / reasoning, the following update might be relevant. I am happy to announce new version of the bulk-chain 0.25.3. It is a no-string framework for quick application of reasoning schema adaptation over your data.
new_line
new_line
https://github.com/nicolay-r/bulk-chain/releases/tag/0.25.3
https://github.com/nicolay-r/bulk-chain/releases/tag/0.25.3
link
new_line
new_line
The latest release brings huge updates on:
text
The latest release brings huge updates on:
new_line
✅ Reforged mechanism of models inference that work in steraming mode.
text
✅ Reforged mechanism of models inference that work in steraming mode.
new_line
     - Callbacks support for streaming mode (earlier only in demo)
text
     - Callbacks support for streaming mode (earlier only in demo)
new_line
     - Deployment of various clients (shell, tksheet; see attachment)
text
     - Deployment of various clients (shell, tksheet; see attachment)
new_line
✅ Support for batching (earlier in API mode only)
text
✅ Support for batching (earlier in API mode only)
new_line
✅ Optional caching of inferred data in SQlite (always enabled earlier)
text
✅ Optional caching of inferred data in SQlite (always enabled earlier)
new_line
     - This now makes possible to faster launch small (but mighty) LLMs
text
     - This now makes possible to faster launch small (but mighty) LLMs
new_line
new_line
🌟 Project: 
text
🌟 Project: 
https://github.com/nicolay-r/bulk-chain
https://github.com/nicolay-r/bulk-chain
link
new_line
🌌 Proviers: 
text
🌌 Proviers: 
https://github.com/nicolay-r/nlp-thirdgate
https://github.com/nicolay-r/nlp-thirdgate
link
new_line
new_line
📢 For those who in textual IR and experimenting with quick deployment of CoT / reasoning, the following update might be relevant. I am happy to announce new version of the bulk-chain 0.25.3. It is a no-string framework for quick application of reasoning schema adaptation over your data.

https://github.com/nicolay-r/bulk-chain/releases/tag/0.25.3

The latest release brings huge updates on:
✅ Reforged mechanism of models inference that work in steraming mode.
     - Callbacks support for streaming mode (earlier only in demo)
     - Deployment of various clients (shell, tksheet; see attachment)
✅ Support for batching (earlier in API mode only)
✅ Optional caching of inferred data in SQlite (always enabled earlier)
     - This now makes possible to faster launch small (but mighty) LLMs

🌟 Project: https://github.com/nicolay-r/bulk-chain
🌌 Proviers: https://github.com/nicolay-r/nlp-thirdgate


👀
John6666 dantezxcd