File size: 136 Bytes
f4535a1 |
1 2 3 4 5 6 7 |
default_stage:
default_modifiers:
QuantizationModifier:
ignore: [lm_head]
targets: [Linear]
scheme: FP8_dynamic
|
f4535a1 |
1 2 3 4 5 6 7 |
default_stage:
default_modifiers:
QuantizationModifier:
ignore: [lm_head]
targets: [Linear]
scheme: FP8_dynamic
|