unsloth
/

Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

Problem loading with vllm

#8 opened 8 months ago by

vram+ram

#7 opened 8 months ago by

Code

#6 opened 8 months ago by

code

#5 opened 8 months ago by

colab t4

#4 opened 8 months ago by

convert

#3 opened 8 months ago by

to gguf

#2 opened 8 months ago by

how to run

#1 opened 8 months ago by