xiaodongguaAIGC commited on
Commit
f10a779
1 Parent(s): 3f41db2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -5,7 +5,33 @@ tags: []
5
 
6
  # Model Card for Model ID
7
 
8
- <!-- Provide a quick summary of what the model is/does. -->
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
 
10
 
11
 
 
5
 
6
  # Model Card for Model ID
7
 
8
+
9
+ This model use for debug, the parameter is random.
10
+
11
+ It's small only '~64MB' memory size, that is efficent for you to download and debug.
12
+
13
+ `llama-3-debug` model config modified as follow
14
+
15
+ ```python
16
+ config.intermediate_size = 128
17
+ config.hidden_size = 64
18
+ config.num_attention_heads = 2
19
+ config.num_key_value_heads = 2
20
+ config.num_hidden_layers = 1
21
+ ```
22
+
23
+ If you want to load it by this code
24
+
25
+ ```python
26
+ from transformers import AutoModelForCausalLM, AutoTokenizer
27
+ model_name = 'xiaodongguaAIGC/llama-3-debug'
28
+ model = AutoModelForCausalLM.from_pretrained(model_name)
29
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
30
+ print(model)
31
+ print(tokenizer)
32
+ ```
33
+
34
+
35
 
36
 
37