ONNX
t5
smart-tab-topic / quantize_config.json
rolf-mozilla's picture
Distillation test. lively-planet-17 (based on t5-efficient-tiny) distilled from trainer azure-frost-334 (baed on flan-t5-base)
db36e89 unverified
raw
history blame
187 Bytes
{
"modes": [
"q8"
],
"per_channel": true,
"reduce_range": true,
"block_size": null,
"is_symmetric": true,
"accuracy_level": null,
"quant_type": 1
}