File size: 333 Bytes
255c1cb bf91ab9 255c1cb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
pipeline_tag: other
library_name: transformers
---
This is fully exp model!
```
base_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
gate_mode: random
architecture: mixtral
experts_per_token: 2
dtype: bfloat16
experts:
- source_model: beomi/EXAONE-3.5-2.4B-Instruct-Llamafied
- source_model: unsloth/Phi-3.5-mini-instruct
``` |