Collection of Quantized Models for MoE
Krishna Teja Chitty-Venkata
krishnateja95
AI & ML interests
LLM Optimization, Neural Architecture Search, Quantization, Pruning
Recent Activity
updated
a model
3 days ago
nm-testing/Llama-3.1-8B-Instruct-FP8-block
authored
a paper
5 days ago
MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large
Language and Vision Models
authored
a paper
5 days ago
PagedEviction: Structured Block-wise KV Cache Pruning for Efficient
Large Language Model Inference
Organizations
models
57
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64
Updated
•
7
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64
Updated
•
9
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64_searched
Updated
•
8
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64_searched
Updated
•
6
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64
Updated
•
10
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64_searched
Updated
•
9
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64
Updated
•
9
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64_searched
Updated
•
11
krishnateja95/llama_3_2_11b_lora_nas_hitab_gud_64
Updated
•
28
krishnateja95/llama_3_2_11b_lora_nas_hitab_qk_64
Updated
•
22