georgeyw commited on
Commit
4f0dfc2
·
1 Parent(s): 3f43e91

Upload configs/model/custom.json with huggingface_hub

Browse files
Files changed (1) hide show
  1. configs/model/custom.json +1 -0
configs/model/custom.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"d_model": 8, "d_head": 8, "n_layers": 1, "n_ctx": 32, "n_heads": 1, "d_vocab": 10, "normalization_type": "LN", "attn_only": true, "positional_embedding_type": "shortformer", "seed": 0}