How to use Nitrals-Loras/NMT-15b-rebase-Lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("SillyTilly/ServiceNow-AI-Apriel-Nemotron-15b-Thinker-Chatml") model = PeftModel.from_pretrained(base_model, "Nitrals-Loras/NMT-15b-rebase-Lora")
