Edit Models filters

Model Tree

TheDrummer/Anubis-70B-v1

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

20

Full-text search

Active filters: TheDrummer/Anubis-70B-v1

bartowski/Anubis-70B-v1-GGUF

Text Generation • 71B • Updated Dec 22, 2024 • 475 • 13

mradermacher/Anubis-70B-v1-GGUF

71B • Updated 26 days ago • 459 • 2

mradermacher/Anubis-70B-v1-i1-GGUF

71B • Updated Dec 22, 2024 • 127

Jellon/Anubis-70B-v1-exl2-3bpw

Updated Dec 24, 2024 • 3

Dracones/Anubis-70B-v1_exl2_8.0bpw

Text Generation • Updated Dec 25, 2024 • 2 • 1

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_6.0bpw

Text Generation • Updated Dec 25, 2024 • 4

Dracones/Anubis-70B-v1_exl2_5.0bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_4.5bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_4.0bpw

Text Generation • Updated Dec 25, 2024 • 4

Dracones/Anubis-70B-v1_exl2_3.5bpw

Text Generation • Updated Dec 25, 2024 • 6

Dracones/Anubis-70B-v1_exl2_3.0bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_2.75bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_2.5bpw

Text Generation • Updated Dec 25, 2024 • 3

Dracones/Anubis-70B-v1_exl2_2.25bpw

Text Generation • Updated Dec 25, 2024 • 2

backyardai/Anubis-70B-v1-GGUF

71B • Updated Dec 29, 2024 • 35

beezu/Anubis-70B-v1-MLX-8Bit

20B • Updated Jan 27 • 20

beezu/Anubis-70B-v1-MLX-6Bit

15B • Updated Jan 27 • 14

beezu/Anubis-70B-v1-MLX-4Bit

11B • Updated Jan 27 • 14

beezu/Anubis-70B-v1-MLX-3Bit

9B • Updated Jan 27 • 12