README.md

metadata

tags:
  - qlora
  - peft
  - indonesian
  - summarization
base_model: aisingapore/Llama-SEA-LION-v3-8B-IT
license: apache-2.0

Llama3 SEA-LION 8B — IndoSum QLoRA (Adapter)

Model ini adalah adaptor PEFT (QLoRA) yang dilatih pada dataset tuanmuda/indosum. Gunakan bersama base model: aisingapore/Llama-SEA-LION-v3-8B-IT.

Cara Pakai

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_id = "aisingapore/Llama-SEA-LION-v3-8B-IT"
adapter_id = "tuanmuda/Llama3-SEA-LION-8b-indosum-qlora-adapter"

tok = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(base_id, device_map="auto")
model = PeftModel.from_pretrained(base, adapter_id, device_map="auto")