Is BF16 checkpoint available?
#1
by
OsakanaTeishoku
- opened
Hi, thank you for the nice MoE model!
I suppose this model is in F32 checkpoint, but it is hard to download; it takes much time.
Is BF16 checkpoint available to enable faster downloading?
pretrained version is in bf16 https://huggingface.co/llm-jp/llm-jp-3-8x1.8b
Hi, thank you for your feedback!
We have updated the main branch to use BF16 checkpoints instead of FP32, so you can now download the model more quickly.
Let us know if you run into any issues!