File size: 1,063 Bytes
0b6a590 52d0956 0b6a590 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 |
---
license: agpl-3.0
pipeline_tag: text-generation
base_model: OpenDFM/ChemDFM-v1.5-8B
tags:
- chemistry
- chat
- 6bit
language:
- en
- zh
library_name: mlx
---
# ChemDFM v1.5 8B 6-bit MLX
MLX version of **ChemDFM v1.5 8B**: An Large Language Foundation Model for Chemistry
This model was converted to MLX format from [`https://huggingface.co/OpenDFM/ChemDFM-v1.5-8B`]() using mlx-lm version **0.22.1**.
ChemDFM 8B is the pioneering open-sourced dialogue foundation model for Chemistry and molecule science, which is build based on LLaMa-8B. ChemDFM outperforms the open-sourced LLMs in all the typical tasks of chemistry, and even reach comparable or higher performances of GPT-4. For more details, please refer to [paper](https://arxiv.org/abs/2401.14818).
## Use with mlx
```bash
pip install -U mlx-lm
```
```bash
python -m mlx_lm.generate --model TheCluster/ChemDFM-v1.5-8B-mlx-6bit --max-tokens 1024 --temperature 0.5 --prompt "Can you please give detailed descriptions of the molecule below?\nCl.O=C1c2c(O)cccc2-c2nn(CCNCCO)c3ccc(NCCNCCO)c1c23"
``` |