Lovely model, hope there is a 5.5bpw version
#1
by
cactopus
- opened
Lovely model, I hope there is a 5.5bpw version like last time as it would just fit into a 24G GPU with full context perfectly 💗
GPU resources have become a bit more scarce for me these days since I started running our chat service, but I'll try to get this done tonight or at some point over the next 2-3 days.
Maybe @sleepdeprived3 or @Darkhn can get to this sooner, though.
I'll do it if you give me the measurement Frenzy.
Getting ready to start quanting now.
It's up.
FrenzyBiscuit
changed discussion status to
closed