Hugging Face's logo

CorticalStack
/
pastiche-crown-clown-7b-dare-6.5bpw-exl2

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card
Pastiche crown clown logo

CorticalStack/pastiche-crown-clown-7b-dare

An EXL2 6.5bpw quantised version of CorticalStack/pastiche-crown-clown-7b-dare.

An incomplete list of clients and libraries that are known to support EXL2:

  • text-generation-webui, the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
  • exllamav2, an inference library for running local LLMs on modern consumer GPUs.
Downloads last month
13
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.