deliciouscat's picture
Update README.md
f01f1f0 verified
|
raw
history blame
105 Bytes

Qwen3-8B-A1.4B-base-unhealed

MoEfied Qwen3-8B-base, and ablated attn layer 16, 29 (by 0-based index)