Gryphe/Sonnet3.5-SlimOrcaDedupCleaned-20k
Viewer • Updated • 20k • 210 • 10
How to use mpasila/Viking-SlimInstruct-LoRA-V1-7B with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("LumiOpen/Viking-7B")
model = PeftModel.from_pretrained(base_model, "mpasila/Viking-SlimInstruct-LoRA-V1-7B")How to use mpasila/Viking-SlimInstruct-LoRA-V1-7B with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("mpasila/Viking-SlimInstruct-LoRA-V1-7B", device_map="auto")Trained on all the 6 different languages so it should hopefully be useful for all of them though the quality of the datasets probably vary a lot.
Uses ChatML as usual.
Merged: mpasila/Viking-SlimInstruct-V1-7B
Uses the following datasets:
saillab/alpaca-icelandic-cleaned, kobprof/skolegpt-instruct, tollefj/nor-instruct-cleaned, skvarre/sv-instruct-v1, Gryphe/Sonnet3.5-SlimOrcaDedupCleaned-20k, LumiOpen/instruction-collection-fin, neph1/Alpaca-Lora-GPT4-Swedish-Refined
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Base model
LumiOpen/Viking-7B