failspy
/

Meta-Llama-3-8B-Instruct-abliterated-v3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Here is a 4 bit GPTQ quantized version

#5

by chplushsieh - opened Jun 3

Jun 3

https://huggingface.co/chplushsieh/Meta-Llama-3-8B-Instruct-abliterated-v3-GPTQ-4bit
for people who want to use it with GPTQ and a 8GB VRAM GPU.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment