reach-vb/phi-2-Q2_K-GGUF

This model was converted to GGUF format from microsoft/phi-2 using llama.cpp. Refer to the original model card for more details on the model.

Use with llama.cpp

brew install ggerganov/ggerganov/llama.cpp
llama-cli --hf-repo reach-vb/phi-2-Q2_K-GGUF --model phi-2.Q2_K.gguf -p "The meaning to life and the universe is "
Downloads last month
40
GGUF
Model size
2.78B params
Architecture
phi2
Hardware compatibility
Log In to view the estimation

2-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support