This is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
- Downloads last month
- 8
Model tree for jiangchengchengNLP/L3.3-MS-Nevoria-70b-FP8-Dynamic
Base model
Steelskull/L3.3-MS-Nevoria-70bThis is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
Base model
Steelskull/L3.3-MS-Nevoria-70b