README.md

metadata

tags:
  - qlora
  - peft
  - indonesian
  - summarization
base_model: Sahabat-AI/llama3-8b-cpt-sahabatai-v1-instruct
license: apache-2.0

LLaMA3 8B — IndoSum QLoRA (Adapter)

Model ini adalah adaptor PEFT (QLoRA) yang dilatih pada dataset tuanmuda/indosum. Gunakan bersama base model: Sahabat-AI/llama3-8b-cpt-sahabatai-v1-instruct.

Cara Pakai

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_id = "Sahabat-AI/llama3-8b-cpt-sahabatai-v1-instruct"
adapter_id = "tuanmuda/llama3-8b-indosum-qlora-adapter"

tok = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(base_id, device_map="auto")
model = PeftModel.from_pretrained(base, adapter_id, device_map="auto")