dleemiller

/

word-llama-l2-supercat

like 73

Thanks! I think you would want to do additional training on top of it for ner using some model that at least computes ngrams. Otherwise, it would just be classifying the vocabulary (32k), and I'd worry that's not expressive enough. I'd bet that you could do something simple like running a linear svc over average pooled trigrams and it might do ok. That's probably where I'd start at least.