How many tokens/s on a single 3090 card?
#5 opened 11 months ago
by
Avos0001
IQ4_XS not working, same issue as with IQ3_M and Q5_K_M
#4 opened about 1 year ago
by
deleted
Q5_K_M nonsensical/broken output in LM Studio 0.2.31
#3 opened about 1 year ago
by
deleted
EXL2 Quant
1
#2 opened about 1 year ago
by
invictus1
IQ3_M quant busted, IQ3_XXS okay
10
#1 opened about 1 year ago
by
anxcat