AWQ Models
updated
TitanML/Qwen2-7B-Instruct-AWQ
Text Generation
• 8B • Updated
• 1
• 1
TitanML/Qwen2-0.5B-Instruct-AWQ
Text Generation
• 0.6B • Updated
• 1
TitanML/Qwen2-1.5B-Instruct-AWQ
Text Generation
• 2B • Updated
• 1
TitanML/InternVL2-Llama3-76B-AWQ
Image-Text-to-Text
• Updated
• 1
TitanML/tiny-mixtral-AWQ-4bit
Text Generation
• 0.2B • Updated
• 319
TitanML/TinyLlama-1.1B-step-50K-105b-AWQ-4bit
Text Generation
• 1B • Updated
• 6
TitanML/llama-3-8b-awq-experimental
Text Generation
• 8B • Updated
• 1
TitanML/Mistral-7B-Instruct-v0.3-AWQ-4bit
Text Generation
• 7B • Updated
• 42
TitanML/Meta-Llama-3-70B-Instruct-AWQ-4bit
Text Generation
• 71B • Updated
• 1
TitanML/Llama3-8B-Chinese-Chat-AWQ-4bit
Text Generation
• 8B • Updated
• 1
TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit
Text Generation
• 71B • Updated
• 4
TitanML/ChatQA-1.5-8B-AWQ-4bit
Text Generation
• 8B • Updated
• 2
TitanML/Mistral-7B-Instruct-v0.2-AWQ-4bit
Text Generation
• 7B • Updated
• 1
TitanML/opt-125m-AWQ-4bit
Text Generation
• 0.2B • Updated
• 5
TitanML/Llama3-OpenBioLLM-70B-AWQ-4bit
Text Generation
• 71B • Updated
• 17
TitanML/Meta-Llama-3-8B-AWQ-4bit
Text Generation
• 8B • Updated
TitanML/Meta-Llama-3-8B-Instruct-AWQ-4bit
Text Generation
• 8B • Updated
• 1
TitanML/llava-1.5-13b-hf-awq
Image-Text-to-Text
• 2B • Updated
• 103
TitanML/llama2-70b-base-4bit-AWQ
Text Generation
• 69B • Updated
• 7
TitanML/llama2-13b-base-4bit-AWQ
Text Generation
• 13B • Updated
• 1
TitanML/llama2-7b-base-4bit-AWQ
Text Generation
• 7B • Updated
• 21
TitanML/llama2-70b-chat-4bit-AWQ
Text Generation
• 69B • Updated
• 2
TitanML/llama2-7b-chat-4bit-AWQ
Text Generation
• 7B • Updated
• 46