Joseph Robert Turcotte PRO
Fishtiks
AI & ML interests
Roleplaying, lorabration, abliteration, smol models, extensive filtering, unusual datasets, home usage, HPCs for AI, distributed training/federated learning, and sentience.
AI should find and label AI hallucinations with GANs so we can give them context and use.
Recent Activity
liked
a model
about 17 hours ago
teapotai/teapotllm
liked
a Space
about 17 hours ago
teapotai/teapotchat
reacted
to
csabakecskemeti's
post
with 👍
about 17 hours ago
I'm collecting llama-bench results for inference with a llama 3.1 8B q4 and q8 reference models on varoius GPUs. The results are average of 5 executions.
The system varies (different motherboard and CPU ... but that probably that has little effect on the inference performance).
https://devquasar.com/gpu-gguf-inference-comparison/
the exact models user are in the page
I'd welcome results from other GPUs is you have access do anything else you've need in the post. Hopefully this is useful information everyone.
Organizations
None yet
models
None public yet
datasets
None public yet