Frightera commited on
Commit
5274459
1 Parent(s): 79c39f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -1,11 +1,11 @@
1
  # (ALPHA) Turkish Instruct LLM Based On Facebook-XGLM
2
 
3
- This is one of our early experimental models based on Facebook's XGLM, fine-tuned using PEFT LORA on a Turkish Instruction dataset.
4
 
5
  The model provided originates from a checkpoint at the 5700th step.
6
 
7
  ## Inference
8
- Please note, utilizing this model necessitates the download of substantial data files, necessitating a minimum of 22GB VRAM.
9
 
10
  Given its experimental nature, it is very likely that this model can produce garbage (biased & wrong) output from time to time, so **use it with caution.**
11
 
@@ -28,7 +28,9 @@ bnb_config = BitsAndBytesConfig(
28
  model = AutoModelForCausalLM.from_pretrained("facebook/xglm-7.5B",
29
  quantization_config=bnb_config,
30
  device_map="auto")
 
31
  model = PeftModel.from_pretrained(model, "myzens/XGLM_TR_FineTune_alpha")
 
32
  tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")
33
  ```
34
 
 
1
  # (ALPHA) Turkish Instruct LLM Based On Facebook-XGLM
2
 
3
+ This is one of our early experimental models based on Facebook's XGLM, fine-tuned using PEFT LORA on a Turkish Instruction dataset. Our goal is to share a Turkish LLM model in the future.
4
 
5
  The model provided originates from a checkpoint at the 5700th step.
6
 
7
  ## Inference
8
+ Please note, utilizing this model necessitates the download of substantial data files, necessitating a minimum of 24GB VRAM.
9
 
10
  Given its experimental nature, it is very likely that this model can produce garbage (biased & wrong) output from time to time, so **use it with caution.**
11
 
 
28
  model = AutoModelForCausalLM.from_pretrained("facebook/xglm-7.5B",
29
  quantization_config=bnb_config,
30
  device_map="auto")
31
+
32
  model = PeftModel.from_pretrained(model, "myzens/XGLM_TR_FineTune_alpha")
33
+
34
  tokenizer = AutoTokenizer.from_pretrained("facebook/xglm-7.5B")
35
  ```
36