Models

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24 • 8 • 1

bartowski/Llama-3.3-70B-Instruct-exl2

Text Generation • Updated Dec 20, 2024 • 6 • 3

etemiz/Llama-3.1-70B-Instruct-GGUF

71B • Updated Dec 19, 2024 • 60

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16

Text Generation • 11B • Updated Jan 3 • 9

RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8

Text Generation • 71B • Updated Jan 3 • 29

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF

Text Generation • 71B • Updated Jan 19 • 6

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 20

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 21

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF

Text Generation • 71B • Updated Jan 19 • 11

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF

Text Generation • 71B • Updated Jan 19 • 479

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 530 • 1

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF

Text Generation • 71B • Updated Jan 19 • 10

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF

Text Generation • 71B • Updated Jan 19 • 12

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF

Text Generation • 71B • Updated Jan 19 • 15

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF

Text Generation • 71B • Updated Jan 19 • 7

roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF

Text Generation • 71B • Updated Jan 19 • 12

tensorblock/Llama-3.1-70B-Instruct-GGUF

Text Generation • 71B • Updated Jul 9 • 234

context-labs/neuralmagic-llama-3.1-70b-instruct-FP8

Text Generation • 71B • Updated Feb 24 • 1

necva/replicate-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 2

necva/replica-IEPile-Llama3.1-70B

37B • Updated Mar 10 • 4

turboderp/Llama-3.1-70B-Instruct-exl3

Updated 18 days ago • 10 • 1

jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP

11B • Updated Jun 19 • 5

jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP

15B • Updated Jun 19 • 3

jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP

19B • Updated Jun 19 • 3

RedHatAI/Llama-3.1-70B-Instruct-NVFP4

Text Generation • 41B • Updated 20 days ago • 143

RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16

Text Generation • 41B • Updated Jun 30 • 3

Hyun9junn/Llama-3.1-70B-Instruct-W4A4KV4-FlatQuant

36B • Updated Sep 30 • 4