Update: I realized that the brain fog got me and I made an error when creating this model. This version is being archived and may be deleted at a later date. New, fixed version is on the way.
Original Card
This is an attempt to apply the pruning method that created kalomaze/Qwen3-16B-A3B to Qwen/Qwen3-30B-A3B-Base.
Pruning was done based on the assumption that the same experts could be pruned from the base model as were pruned from the instruct model. This may or may not be correct. Experts to prune were identified by matching the remaining experts in the instruct prune against the complete instruct model.
- Downloads last month
- 234
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Model tree for Columbidae/Qwen3-16B-A3B-Base-Old-Archived
Base model
Qwen/Qwen3-30B-A3B-Base