Csaba Kecskemeti PRO

csabakecskemeti

None yet

updated a model about 2 hours ago

updated a model about 3 hours ago

updated a model about 7 hours ago

Post

550

Managed to run the Q2 quantized Deepseek V3 base locally
The quants are uploading (probably ~10-12hrs) here: DevQuasar/deepseek-ai.DeepSeek-V3-Base-GGUF

Post

611

Just wondering why the number of parameters changed in the model attributes/Model size from 685B to 684B after converting deepseek-ai/DeepSeek-V3-Base from FP8 to BF16:
DevQuasar/deepseek-ai.DeepSeek-V3-Base-bf16
and not just for me:
opensourcerelease/DeepSeek-V3-Base-bf16

??

None public yet