Any chance of creating these with RoPE/Yarn for a context size larger than 32k?
5
#2 opened about 2 months ago
by
smcleod
SOTA score
🔥
2
#1 opened about 2 months ago
by
oobabooga