Update README.md
Browse files
README.md
CHANGED
@@ -102,7 +102,7 @@ https://github.com/EleutherAI/lm-evaluation-harness#install
|
|
102 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
103 |
```
|
104 |
|
105 |
-
## float8dq
|
106 |
```
|
107 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-float8dq --tasks hellaswag --device cuda:0 --batch_size 8
|
108 |
```
|
|
|
102 |
lm_eval --model hf --model_args pretrained=microsoft/Phi-4-mini-instruct --tasks hellaswag --device cuda:0 --batch_size 8
|
103 |
```
|
104 |
|
105 |
+
## float8 dynamic activation and float8 weight quantization (float8dq)
|
106 |
```
|
107 |
lm_eval --model hf --model_args pretrained=pytorch/Phi-4-mini-instruct-float8dq --tasks hellaswag --device cuda:0 --batch_size 8
|
108 |
```
|