YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
g0t4/ByteDance-Seed-Coder-8B-Instruct-GGUF
Based on https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Instruct
GGUF Conversion
python convert_hf_to_gguf.py --remote ByteDance-Seed/Seed-Coder-8B-Instruct \
--outtype f16 --outfile ByteDance-Seed-Coder-8B-Instruct-f16.gguf
./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q8_0.gguf Q8_0
./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q4_K_M.gguf Q4_K_M
hf upload ByteDance-Seed-Coder-8B-Instruct-GGUF .
- Downloads last month
- 90
Hardware compatibility
Log In
to view the estimation
4-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support