Update README.md
Browse files
README.md
CHANGED
@@ -102,7 +102,7 @@ pip install transformers==4.56.0
|
|
102 |
|
103 |
The following code snippet shows how to use the transformers library to load and apply the model.
|
104 |
|
105 |
-
*!!! If you want to load fp8 model with transformers, you need to change the name"ignored_layers" in config.json to "
|
106 |
|
107 |
we use tencent/Hunyuan-MT-7B for example
|
108 |
|
|
|
102 |
|
103 |
The following code snippet shows how to use the transformers library to load and apply the model.
|
104 |
|
105 |
+
*!!! If you want to load fp8 model with transformers, you need to change the name"ignored_layers" in config.json to "ignore" and upgrade the compressed-tensors to compressed-tensors-0.11.0.*
|
106 |
|
107 |
we use tencent/Hunyuan-MT-7B for example
|
108 |
|