|
|
--- |
|
|
license: apache-2.0 |
|
|
language: |
|
|
- en |
|
|
base_model: |
|
|
- meta-llama/Llama-3.2-3B-Instruct |
|
|
pipeline_tag: text-generation |
|
|
datasets: |
|
|
- Salesforce/wikitext |
|
|
--- |
|
|
|
|
|
## Usage |
|
|
``` |
|
|
import torch |
|
|
from transformers import AutoTokenizer, AutoModelForCausalLM |
|
|
|
|
|
model_name = "ziyingchen1106/Llama-3.2-3B-Instruct-fp16-lora-wikitext" |
|
|
model = AutoModelForCausalLM.from_pretrained( |
|
|
model_name, |
|
|
torch_dtype=torch.float16, |
|
|
device_map="cuda:0" |
|
|
) |
|
|
tokenizer = AutoTokenizer.from_pretrained(model_name) |
|
|
``` |
|
|
|
|
|
## Attribution |
|
|
- Built with Llama |
|
|
- Llama 3.2 Community License © Meta Platforms, Inc. |
