Upload configuration_deepseek.py
Transformers is throwing "OSError: unsloth/Kimi-K2-Instruct-GGUF does not appear to have a file named configuration_deepseek.py. Checkout 'https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main' for available files."
This repo is not supposed to be loaded with transformers. The one that people should use if using transformers is this one which has the configuration_deepseek.py file -> https://huggingface.co/unsloth/Kimi-K2-Instruct/tree/main
Transformers is throwing "OSError: unsloth/Kimi-K2-Instruct-GGUF does not appear to have a file named configuration_deepseek.py. Checkout 'https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF/tree/main' for available files."
That's for transformers. You can't load GGUFs directly in transformers like that :(