Releasing Outlines-core 0.1.0: structured generation in Rust and Python
•
44
Erik Kaunismäki PRO
erikkaum
AI & ML interests
None yet
Recent Activity
upvoted
an
article
2 days ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
upvoted
an
article
3 days ago
Train 400x faster Static Embedding Models with Sentence Transformers
upvoted
a
collection
10 days ago
Cosmos
Articles
Organizations
Posts
1
Post
1722
A while ago I started experimenting with compiling the Python interpreter to WASM.
To build a secure, fast, and lightweight sandbox for code execution — ideal for running LLM-generated Python code.
- Send code simply as a POST request
- 1-2ms startup times
Hack away:
https://github.com/ErikKaum/runner
To build a secure, fast, and lightweight sandbox for code execution — ideal for running LLM-generated Python code.
- Send code simply as a POST request
- 1-2ms startup times
Hack away:
https://github.com/ErikKaum/runner
datasets
None public yet