Update README.md
Browse files
README.md
CHANGED
@@ -1,11 +1,11 @@
|
|
1 |
# (ALPHA) Turkish Instruct LLM Based On Facebook-XGLM
|
2 |
|
3 |
-
This is one of our early experimental models based on Facebook's XGLM, fine-tuned using PEFT LORA on a Turkish Instruction dataset.
|
4 |
|
5 |
The model provided originates from a checkpoint at the 5700th step.
|
6 |
|
7 |
## Inference
|
8 |
-
Please note, utilizing this model necessitates the download of substantial data files, necessitating a minimum of
|
9 |
|
10 |
Given its experimental nature, it is very likely that this model can produce garbage (biased & wrong) output from time to time, so **use it with caution.**
|
11 |
|
@@ -28,7 +28,9 @@ bnb_config = BitsAndBytesConfig(
|
|
28 |
model = AutoModelForCausalLM.from_pretrained("facebook/xglm-7.5B",
|
29 |
quantization_config=bnb_config,
|
30 |
device_map="auto")
|
|
|
31 |
model = PeftModel.from_pretrained(model, "myzens/XGLM_TR_FineTune_alpha")
|
|
|
32 |
tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")
|
33 |
```
|
34 |
|
|
|
1 |
# (ALPHA) Turkish Instruct LLM Based On Facebook-XGLM
|
2 |
|
3 |
+
This is one of our early experimental models based on Facebook's XGLM, fine-tuned using PEFT LORA on a Turkish Instruction dataset. Our goal is to share a Turkish LLM model in the future.
|
4 |
|
5 |
The model provided originates from a checkpoint at the 5700th step.
|
6 |
|
7 |
## Inference
|
8 |
+
Please note, utilizing this model necessitates the download of substantial data files, necessitating a minimum of 24GB VRAM.
|
9 |
|
10 |
Given its experimental nature, it is very likely that this model can produce garbage (biased & wrong) output from time to time, so **use it with caution.**
|
11 |
|
|
|
28 |
model = AutoModelForCausalLM.from_pretrained("facebook/xglm-7.5B",
|
29 |
quantization_config=bnb_config,
|
30 |
device_map="auto")
|
31 |
+
|
32 |
model = PeftModel.from_pretrained(model, "myzens/XGLM_TR_FineTune_alpha")
|
33 |
+
|
34 |
tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")
|
35 |
```
|
36 |
|