This is a GGUF conversion of Google's T5 v1.1 XXL encoder model.
The weights can be used with ./llama-embedding or with the ComfyUI-GGUF custom node together with image generation models.
This is a non imatrix quant as llama.cpp doesn't support imatrix creation for T5 models at the time of writing. It's therefore recommended to use Q5_K_M or larger for the best results, although smaller models may also still provide decent results in resource constrained scenarios.
- Downloads last month
- 198
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model’s pipeline type.
Model tree for Niansuh/t5-v1_1-xxl-encoder-gguf
Base model
google/t5-v1_1-xxl