Do these ggufs contain the vision mmoproj?
#1
by
ClintHardwood
- opened
If so, would it be possible to have them separate for those of us who like fp16 embeddings alongside quanted models?
the mmproj files are indeed always separate (at least afaik); the reaosn why they were missing is that llama.cvpp officially doesn't support vision for this architecture.
We've force-enabled it, and mmproj files are now available (see the download page link). If you can, we'd appreciate feedback if they work :)