562 925 3332

Victor Mustar PRO

victor

victormustar

AI & ML interests

Building the UX of this website

Recent Activity

liked a Space about 1 hour ago

teapotai/teapotchat

liked a model about 1 hour ago

teapotai/teapotllm

reacted to csabakecskemeti's post with 👍 about 1 hour ago

I'm collecting llama-bench results for inference with a llama 3.1 8B q4 and q8 reference models on varoius GPUs. The results are average of 5 executions. The system varies (different motherboard and CPU ... but that probably that has little effect on the inference performance). https://devquasar.com/gpu-gguf-inference-comparison/ the exact models user are in the page I'd welcome results from other GPUs is you have access do anything else you've need in the post. Hopefully this is useful information everyone.

View all activity

Organizations

victor's activity

liked a Space about 1 hour ago

Teapotchat

💻

Teapot Chat Web Demo

liked a model about 1 hour ago

teapotai/teapotllm

Text2Text Generation • Updated about 6 hours ago • 875 • • 24

reacted to csabakecskemeti's post with 👍 about 1 hour ago

Post

1569

I'm collecting llama-bench results for inference with a llama 3.1 8B q4 and q8 reference models on varoius GPUs. The results are average of 5 executions.
The system varies (different motherboard and CPU ... but that probably that has little effect on the inference performance).

https://devquasar.com/gpu-gguf-inference-comparison/
the exact models user are in the page

I'd welcome results from other GPUs is you have access do anything else you've need in the post. Hopefully this is useful information everyone.

reacted to onekq's post with 👍 about 1 hour ago

Post

1389

I shared my view on Qwen vs DeepSeek (student vs genius), and I forgot to mention this: they are neighbors in the same city.
https://en.wikipedia.org/wiki/Hangzhou

reacted to smirki's post with 👍 about 1 hour ago

Post

434

Introducing a SMALL Reasoning React Model with State!
We did this by introducing a new form of reasoning that aligns with UI principles to do a layer of testing. For example:
"Looking back at all these pieces, we've considered state management, data structures, core functionalities etc"
And it comes in all sizes. Great for agents!
Tesslate/tessa-t1-react-reasoning-model-67e0fb72ca23e04473885c0e
Tesslate/Tessa-T1-14B
https://huggingface.co/smirki/Tessa-T1-14B-Q8_0-GGUF

reacted to MikeDoes's post with 🔥 about 1 hour ago

Post

643

🌟 Day 4: Two Models, One Privacy Mission! 🌟

The PII-Masking-1M series rolls on with two gems:

Categorical: ai4privacy/llama-ai4privacy-multilingual-categorical-anonymiser-openpii
Redaction: ai4privacy/llama-ai4privacy-multilingual-anonymiser-openpii
Join us in protecting data everywhere!

#AI #Privacy #OpenSource #Multilingual