sandernotenbaert/OKAI-midi-gen-v-001

Other • 0.0B • Updated Jun 13 • 8

Note For basic testing only. training_config: vocab_size: 30000 hidden_size: 256 intermediate_size: 512 num_hidden_layers: 4 num_attention_heads: 4 num_key_value_heads: 4 sliding_window: 4 max_position_embeddings: 1024 pad_token_id: 0 bos_token_id: 1 eos_token_id: 2

sandernotenbaert/OKAI-midi-gen-v-002

Other • 0.0B • Updated Jun 13 • 9

Note Contains mistake: sliding window is only 4 by accident, Miditok example uses 256.

sandernotenbaert/OKAI-midi-gen-v-003

Text Generation • 0.1B • Updated Jun 13 • 7

Note Contains mistake: sliding window is only 4 by accident, Miditok example uses 256. generated midi still very sparse and incoherent. Checkpoint 200 is the best performing one, so something definitely went wrong

sandernotenbaert/OKAI-midi-gen-v-004

Other • 0.0B • Updated Jun 13 • 7

Note Much less gaps, somewhat rhythmical, still very atonal. Definitely in the right direction! Also includes shorter lengths, 10-20s instead of 50-80, but depending on the generation config can also be 8-15min long