Boris Dayma commited on
Commit
8b264b9
1 Parent(s): db83852

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -17
README.md CHANGED
@@ -1,21 +1,12 @@
1
- ## DALL-E Mini - Generate image from text
 
 
 
2
 
3
- ## TODO
4
 
5
- * experiment with flax/jax and setup of the TPU instance that we should get shortly
6
- * work on dataset loading - [see suggested datasets](https://discuss.huggingface.co/t/dall-e-mini-version/7324/4)
7
- * Optionally create the OpenAI YFCC100M subset (see [this post](https://discuss.huggingface.co/t/dall-e-mini-version/7324/30?u=boris))
8
- * work on text/image encoding
9
- * concatenate inputs (not sure if we need fixed length for text or use a special token separating text & image)
10
- * adapt training script
11
- * create inference function
12
- * integrate CLIP for better results (only if we have the time)
13
- * work on a demo (streamlit or colab or maybe just HF widget)
14
- * document (set up repo on model hub per instructions, start on README writeup…)
15
- * help with coordinating activities & progress
16
 
 
17
 
18
- ## Dependencies Installation
19
- You should create a new python virtual environment and install the project dependencies inside the virtual env: `pip install -r requirements.txt`
20
-
21
- If you use `conda`, you can create the virtual env and install everything using: `conda env update -f environments.yaml`
 
1
+ ---
2
+ language:
3
+ - en
4
+ ---
5
 
6
+ ## DALL-E Mini - Generate images from text
7
 
8
+ Model generating images from a text prompt.
 
 
 
 
 
 
 
 
 
 
9
 
10
+ Outputs need to be decoded with [flax-community/vqgan_f16_16384](https://huggingface.co/flax-community/vqgan_f16_16384).
11
 
12
+ Model definition is currently in the [Github repo](https://github.com/borisdayma/dalle-mini) as `CustomFlaxBartForConditionalGeneration`.