RedHatAI
/

Voxtral-Mini-3B-2507-FP8-dynamic

Automatic Speech Recognition

text-generation-inference

automatic-speech-translation

audio-text-to-text

video-text-to-text

compressed-tensors

Model card Files Files and versions

alexmarques commited on 16 days ago

Commit

459ac81

·

verified ·

1 Parent(s): 02776bc

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -208,7 +208,7 @@ oneshot(
     recipe=recipe,
 )
-SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-FP8-DYNAMIC"
 model.save_pretrained(SAVE_DIR, save_compressed=True)
 processor.save_pretrained(SAVE_DIR)
 ```

     recipe=recipe,
 )
+SAVE_DIR = MODEL_ID.rstrip("/").split("/")[-1] + "-FP8-dynamic"
 model.save_pretrained(SAVE_DIR, save_compressed=True)
 processor.save_pretrained(SAVE_DIR)
 ```