Tanabodee Limpaitoon commited on
Commit
7e65e93
1 Parent(s): 14a2946

Upload 2 files

Browse files
Files changed (2) hide show
  1. params.json +1 -0
  2. tokenizer.model +3 -0
params.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dim": 4096, "n_layers": 32, "n_heads": 32, "n_kv_heads": 8, "vocab_size": 128256, "ffn_dim_multiplier": 1.3, "multiple_of": 1024, "norm_eps": 1e-05, "rope_theta": 500000.0, "use_scaled_rope": true}
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82e9d31979e92ab929cd544440f129d9ecd797b69e327f80f17e1c50d5551b55
3
+ size 2183982