mlx-community
/

flan-t5-base-mlx-4bit

text-generation-inference

Model card Files Files and versions

flan-t5-base-mlx-4bit / README.md

aaartii's picture

Upload folder using huggingface_hub (#1)

05b8616 verified over 1 year ago

|

187 Bytes

Google's Flan-T5 medium converted to MLX format and quantized up to 4 bits with group size 64.