From testing, all my models work best with CUDA v11.8
The possible reason for this is outlined here: https://medium.com/@bijit211987/changing-your-gpu-changes-your-llm-behavior-16408c05677a
This collection has no items.
The possible reason for this is outlined here: https://medium.com/@bijit211987/changing-your-gpu-changes-your-llm-behavior-16408c05677a