Request
#995
by
Enderchef
- opened
Can somebody give me an axolotl config to train ykarout/Mixtral-8x7B-DeepSeek-R1-Distill on BramVanroy/CommonCrawl-CreativeCommons?
Thanks.
Enderchef
changed discussion title from
Question
to Request
LOL I love how you completely changed your questions in every edit. At least that one is possible if are willing to spent a $50000 on RunPod but there are probably better ways to spent 1 year worth of someone’s salary than running pretraining on some random model. In case you want to do so anyways take a look at https://docs.axolotl.ai/docs/dataset-formats/pretraining.html as it is surprisingly simple. But to be fair for such insane training costs you should just consult a professional AI finetuning expert. Also please stop abusing model requests for your personal questions.