PowerInfer
/

SmallThinker-4BA0.6B-Instruct-INT4-QAT

Model card Files Files and versions Community

README.md exists but content is empty.

Downloads last month: 272

GGUF

Model size

4.27B params

Architecture

smallthinker

Hardware compatibility

Log In to view the estimation

3-bit

4-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for PowerInfer/SmallThinker-4BA0.6B-Instruct-INT4-QAT

Base model

PowerInfer/SmallThinker-4BA0.6B-Instruct

Quantized

(7)

this model