Post
345
📢 Following the bulk-chain v1.1.0 release and its minimalistic integration and real-world deployment on async inference with your LLM provider. Below is an example of tk-sheet for spreadsheet-style LLM reasoning
🔑 We use the concept of asyncio loops. You can set event loop of the utilized framework. At present it converts async generators to sync.
https://stackoverflow.com/questions/71580727/translating-async-generator-into-sync-one/79617639#79617639
🔗 The integration demo:
https://github.com/nicolay-r/bulk-chain-tksheet-client
🌌 The provider:
https://github.com/nicolay-r/nlp-thirdgate/blob/master/llm/replicate_104.py
🔑 We use the concept of asyncio loops. You can set event loop of the utilized framework. At present it converts async generators to sync.
https://stackoverflow.com/questions/71580727/translating-async-generator-into-sync-one/79617639#79617639
🔗 The integration demo:
https://github.com/nicolay-r/bulk-chain-tksheet-client
🌌 The provider:
https://github.com/nicolay-r/nlp-thirdgate/blob/master/llm/replicate_104.py