Post
398
Hi HuggingFace Community๐ค, I am thrilled to announce:
๐ช๐๐ฎ๐ซ๐ฅ๐ฅ๐ฆ ๐๐ท-๐๐.๐ท (https://github.com/AstraBert/qdurllm/tree/january-2025)
Qdurllm (๐ค๐ฑrant, ๐จ๐ฅLs, ๐arge ๐anguage ๐ odels) is a local Gradio (Gradio) application that lets you upload you web content to a local Qdrant (Qdrant) database and search through it or chat with it.
The ๐ป๐ฒ๐ ๐ฝ๐ฟ๐ฒ-๐ฟ๐ฒ๐น๐ฒ๐ฎ๐๐ฒ (https://github.com/AstraBert/qdurllm/releases/tag/v1.0.0-rc.0) implements ๐๐ฝ๐ฎ๐ฟ๐๐ฒ ๐๐ฒ๐ฎ๐ฟ๐ฐ๐ต (with prithivida/Splade_PP_en_v1) + ๐ฟ๐ฒ๐ฟ๐ฎ๐ป๐ธ๐ถ๐ป๐ด (with nomic-ai/modernbert-embed-base by Hugging Face + Nomic AI) and ๐๐ฒ๐บ๐ฎ๐ป๐๐ถ๐ฐ ๐ฐ๐ฎ๐ฐ๐ต๐ถ๐ป๐ด (based on Qdrant) and switched ๐ณ๐ฟ๐ผ๐บ google/gemma-2-2b-it ๐๐ผ Qwen/Qwen2.5-1.5B-Instruct to conform to the SOTA landscape and to finally make the application based ๐ผ๐ป๐น๐ ๐ผ๐ป ๐๐ฟ๐๐น๐ ๐ผ๐ฝ๐ฒ๐ป ๐บ๐ผ๐ฑ๐ฒ๐น๐.
The pre-release is ๐ฎ๐๐ฎ๐ถ๐น๐ฎ๐ฏ๐น๐ฒ ๐ณ๐ผ๐ฟ ๐๐ฒ๐๐๐ถ๐ป๐ด and I would be really really happy if you wanted to give it a try and leave your feedback on the discussion thread on GitHub (https://github.com/AstraBert/qdurllm/discussions/8) or here on Hugging Face forum via comments under this postโจ.
Find all the information to install and launch it here ๐ https://astrabert.github.io/qdurllm/#2-installation
๐ช๐๐ฎ๐ซ๐ฅ๐ฅ๐ฆ ๐๐ท-๐๐.๐ท (https://github.com/AstraBert/qdurllm/tree/january-2025)
Qdurllm (๐ค๐ฑrant, ๐จ๐ฅLs, ๐arge ๐anguage ๐ odels) is a local Gradio (Gradio) application that lets you upload you web content to a local Qdrant (Qdrant) database and search through it or chat with it.
The ๐ป๐ฒ๐ ๐ฝ๐ฟ๐ฒ-๐ฟ๐ฒ๐น๐ฒ๐ฎ๐๐ฒ (https://github.com/AstraBert/qdurllm/releases/tag/v1.0.0-rc.0) implements ๐๐ฝ๐ฎ๐ฟ๐๐ฒ ๐๐ฒ๐ฎ๐ฟ๐ฐ๐ต (with prithivida/Splade_PP_en_v1) + ๐ฟ๐ฒ๐ฟ๐ฎ๐ป๐ธ๐ถ๐ป๐ด (with nomic-ai/modernbert-embed-base by Hugging Face + Nomic AI) and ๐๐ฒ๐บ๐ฎ๐ป๐๐ถ๐ฐ ๐ฐ๐ฎ๐ฐ๐ต๐ถ๐ป๐ด (based on Qdrant) and switched ๐ณ๐ฟ๐ผ๐บ google/gemma-2-2b-it ๐๐ผ Qwen/Qwen2.5-1.5B-Instruct to conform to the SOTA landscape and to finally make the application based ๐ผ๐ป๐น๐ ๐ผ๐ป ๐๐ฟ๐๐น๐ ๐ผ๐ฝ๐ฒ๐ป ๐บ๐ผ๐ฑ๐ฒ๐น๐.
The pre-release is ๐ฎ๐๐ฎ๐ถ๐น๐ฎ๐ฏ๐น๐ฒ ๐ณ๐ผ๐ฟ ๐๐ฒ๐๐๐ถ๐ป๐ด and I would be really really happy if you wanted to give it a try and leave your feedback on the discussion thread on GitHub (https://github.com/AstraBert/qdurllm/discussions/8) or here on Hugging Face forum via comments under this postโจ.
Find all the information to install and launch it here ๐ https://astrabert.github.io/qdurllm/#2-installation