File size: 228 Bytes
304a295 |
1 2 3 4 5 6 7 8 |
default_stage:
default_modifiers:
GPTQModifier:
targets: [Linear]
ignore: ['re:.*lm_head', 're:vision_tower.*', 're:multi_modal_projector.*']
scheme: W4A16
sequential_targets: [MistralDecoderLayer]
|