|
|
--- |
|
|
license: mit |
|
|
datasets: |
|
|
- ILSVRC/imagenet-1k |
|
|
- mlfoundations/datacomp_small |
|
|
base_model: |
|
|
- laion/CLIP-ViT-bigG-14-laion2B-39B-b160k |
|
|
--- |
|
|
|
|
|
Model Initialized from `laion/CLIP-ViT-bigG-14-laion2B-39B-b160k`. The text encoder is finetuned with LEAF at $k=1$ with $\rho=50$. |
|
|
|
|
|
To load this model use: |
|
|
|
|
|
```python |
|
|
from transformers import CLIPProcessor, CLIPModel |
|
|
|
|
|
model_name = "LEAF-CLIP/OpenCLIP-ViT-bigG-rho50-k1" |
|
|
processor_name = "laion/CLIP-ViT-bigG-14-laion2B-39B-b160k" |
|
|
|
|
|
model = CLIPModel.from_pretrained(model_name) |
|
|
processor = CLIPProcessor.from_pretrained(processor_name) |
|
|
``` |
