OPT-2.7B finetuned on OSCAR with LoRA
This model was finetuned on 80000 examples from the german subset of the oscar corpus. See the git repo for more info and exact hyperparameters.
To run this model, simply instantiate the facebook/opt-2.7b model as per usual and activate the adapter with PEFT:
from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("facebook/opt-2.7b")
model = PeftModel.from_pretrained(model, "bjoernp/opt2.7B-de-lora")
Refer to the OPT Documentation for more infos on how to run the model and use the processor.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.