Gave it a whirl
#4
by
SkyStach
- opened
I had the chance the try this model out with Infermatic a while ago before they took it down and only had the FP8 version (which in my experience FP8 is kind of dumber) but before that, it performed the best out of any 70b model I've used on there. I have nothing but praise for this model.
Edit: Oops, forgot that I already posted about this model previously.
SkyStach
changed discussion status to
closed
TheDrummer
changed discussion status to
open
Is the difference between fp8 and fp16 really noticiable?
Is the difference between fp8 and fp16 really noticiable?
Very late to reply, but in my experience I could tell the difference. FP16 was a little more creative in its output. FP8 does okay and gets the job done, but FP16 was better.