Hugging Face's logo
Hugo Larcher's picture
4 6

Hugo Larcher

hlarcher
thomwolf's profile picture vivekrp's profile picture pierrci's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted an article 1 day ago
Welcome to Inference Providers on the Hub 🔥
posted an update 14 days ago
We are introducing multi-backend support in Hugging Face Text Generation Inference! With new TGI architecture we are now able to plug new modeling backends to get best performances according to selected model and available hardware. This first step will very soon be followed by the integration of new backends (TRT-LLM, llama.cpp, vLLM, Neuron and TPU). We are polishing the TensorRT-LLM backend which achieves impressive performances on NVIDIA GPUs, stay tuned 🤗 ! Check out the details: https://huggingface.co/blog/tgi-multi-backend
upvoted an article 14 days ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
View all activity

Articles

Organizations

Hugging Face's profile picture HuggingFaceBR4's profile picture Hugging Face Smol Cluster's profile picture Optimum Nvidia's profile picture smol-explorers's profile picture

hlarcher's activity

liked 3 Spaces 9 months ago
liked a Space 10 months ago
liked a Space 11 months ago
liked a model 11 months ago