how to get the base model

#5
by bedio - opened

facebook/MobileLLM-Pro does not have a base model and cannot be seen at facebook
where can i get the base model

AI at Meta org

The base model (pre-trained only) is here:
https://huggingface.co/facebook/MobileLLM-Pro/tree/main/base

You can access it in your code as:

tokenizer = AutoTokenizer.from_pretrained("facebook/MobileLLM-Pro", trust_remote_code=True, subfolder="base")
model = AutoModelForCausalLM.from_pretrained("facebook/MobileLLM-Pro", trust_remote_code=True, subfolder="base")
AI at Meta org

We changed the repository structure. The instruction tuned model should now be directly available in this repo, while the pre-trained checkpoint is moved to: https://huggingface.co/facebook/MobileLLM-Pro-base

Sign up or log in to comment