Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

34,949

Full-text search

Active filters: 4-bit

TheBloke/manticore-13b-chat-pyg-GPTQ

Text Generation • Updated Sep 27, 2023 • 20 • 34

TheBloke/Project-Baize-v2-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 184 • 4

TheBloke/Project-Baize-v2-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 188 • 11

TheBloke/guanaco-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 75 • 29

TheBloke/guanaco-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 63 • 75

TheBloke/guanaco-65B-GPTQ

Text Generation • Updated Sep 27, 2023 • 227 • 265

TheBloke/guanaco-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 49 • 28

TheBloke/Vigogne-Instruct-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 45 • 2

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 180 • 66

TheBloke/falcon-40b-instruct-GPTQ

Text Generation • Updated Aug 21, 2023 • 125 • 197

TheBloke/WizardLM-13B-1.0-GPTQ

Text Generation • Updated Sep 27, 2023 • 21 • 21

TheBloke/gorilla-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 25 • 26

TheBloke/Samantha-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 15 • 6

TheBloke/Samantha-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 14 • 6

TheBloke/samantha-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 13 • 20

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 652 • 581

rycont/kakaobrain__kogpt-6b-4bit

Text Generation • Updated May 30, 2023 • 13

TheBloke/samantha-falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 20 • 12

TheBloke/hippogriff-30b-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 38 • 12

exbow/TinyStories-wikitrain-ethan-2

Text Generation • Updated Jun 1, 2023 • 14

exbow/TinyStories-wikitrain-33m-ethan

Text Generation • Updated Jun 1, 2023 • 14

exbow/Neo1.3B-4bit

Text Generation • Updated Jun 5, 2023 • 11

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 410 • 87

TheBloke/WizardLM-Uncensored-Falcon-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 44 • 70

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 19 • 13

TheBloke/PMC_LLAMA-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 10 • 4

TheBloke/based-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 14 • 9

TheBloke/WizardLM-Uncensored-Falcon-40B-GPTQ

Text Generation • Updated Aug 21, 2023 • 32 • 60

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 791 • 176

TheBloke/airoboros-13b-gpt4-GPTQ

Text Generation • Updated Aug 21, 2023 • 20 • 5