|
|
--- |
|
|
base_model: mistralai/Mixtral-8x22B-v0.1 |
|
|
tags: |
|
|
- Mixtral |
|
|
- instruct |
|
|
- finetune |
|
|
- chatml |
|
|
- gpt4 |
|
|
- synthetic data |
|
|
- distillation |
|
|
language: |
|
|
- en |
|
|
license: apache-2.0 |
|
|
datasets: |
|
|
- teknium/OpenHermes-2.5 |
|
|
--- |
|
|
|
|
|
# OpenHermes 2.5 - Mixtral 8x22B |
|
|
Mixtral 8x22B full SFTed on OpenHermes 2.5 dataset (https://huggingface.co/datasets/teknium/OpenHermes-2.5). |
|
|
|
|
|
Evaluations are still being ran. Download the model from branches 4th-epoch and 3rd-epoch. |
|
|
|
|
|
Prompt format is ChatML. Refer to https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B for examples. |
|
|
|
|
|
Research supported by Google's TPU Research Cloud. |
