Victor Mustar PRO
victor
AI & ML interests
Building the UX of this website
Recent Activity
liked
a Space
about 1 hour ago
teapotai/teapotchat
liked
a model
about 1 hour ago
teapotai/teapotllm
reacted
to
csabakecskemeti's
post
with 👍
about 2 hours ago
I'm collecting llama-bench results for inference with a llama 3.1 8B q4 and q8 reference models on varoius GPUs. The results are average of 5 executions.
The system varies (different motherboard and CPU ... but that probably that has little effect on the inference performance).
https://devquasar.com/gpu-gguf-inference-comparison/
the exact models user are in the page
I'd welcome results from other GPUs is you have access do anything else you've need in the post. Hopefully this is useful information everyone.
Organizations
victor's activity
Point to latest checkpoint
#96 opened about 3 hours ago
by
victor

100kB ?
5
#7 opened 3 months ago
by
prithivMLmods

How to run it locally?
3
#1 opened about 1 month ago
by
thedenisnikulin
Link from model page
#1 opened 19 days ago
by
victor

[FEEDBACK] Notifications
142
#6 opened over 2 years ago
by
victor

description?
1
#1 opened about 1 month ago
by
victor

Fix 500 error on Warm Models Endpoint
2
#5 opened about 1 month ago
by
cfahlgren1

set correct base model
#1 opened about 1 month ago
by
victor

point to newer version
#4 opened about 1 month ago
by
victor

Better description?
#10 opened about 1 month ago
by
victor

dataset? (if it's this one)
2
#1 opened about 1 month ago
by
victor

ZeroGPU?
2
#1 opened about 1 month ago
by
victor

Set base_model to deepseek-ai/DeepSeek-R1
#33 opened about 1 month ago
by
victor

Set base model
#3 opened about 2 months ago
by
victor

[Support] Community Articles
82
#5 opened about 1 year ago
by
victor

remove base_model
#1 opened about 2 months ago
by
victor

Create fix-this
#12 opened 3 months ago
by
vgybhu
Set correct base model
1
#1 opened 2 months ago
by
victor

Your feedback on HuggingChat
290
#1 opened almost 2 years ago
by
victor

remove "empty" from gallery
#1 opened 2 months ago
by
victor
