OpenSourceRonin's picture

26 4 7

OpenSourceRonin PRO

OpenSourceRonin

·

AI & ML interests

None yet

Recent Activity

new activity about 6 hours ago

deepseek-ai/DeepSeek-V3-0324:Can a quantized version of deepseek-v3-0324 be implemented on a machine with a cluster of 8 *A100s?

updated a model 5 days ago

VPTQ-community/Qwen2.5-72B-Instruct-v16-k65536-256-woft

updated a model 5 days ago

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

View all activity

Organizations

spaces 2

Running on Zero

VPTQ demo

Vector Post-Training Quantization (VPTQ) Demo

LLM 2Bit

2bit infer for llm

models

None public yet

datasets

None public yet