ewof/code-alpaca-instruct-unfiltered
Viewer • Updated • 20k • 30 • 9
How to use gvij/open-llama-7b-code-alpaca-instruct with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("openlm-research/open_llama_7b")
model = PeftModel.from_pretrained(base_model, "gvij/open-llama-7b-code-alpaca-instruct")We finetuned Open Llama 7B on Code-Alpaca-Instruct Dataset (ewof/code-alpaca-instruct-unfiltered) for 3 epochs using MonsterAPI no-code LLM finetuner.
This dataset is HuggingFaceH4/CodeAlpaca_20K unfiltered, removing 36 instances of blatant alignment.
The finetuning session got completed in 75 minutes and costed us only $3 for the entire finetuning run!