This is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
- Downloads last month
- 8
Model tree for jiangchengchengNLP/L3.3-MS-Nevoria-70b-NVFP4A16
Base model
Steelskull/L3.3-MS-Nevoria-70bThis is a checkpoint for quantization using llm-compressor, supporting vllm, sglang inference.
Base model
Steelskull/L3.3-MS-Nevoria-70b