Finetuning models on posts and responses on the /r/AskNYC subreddit
Nick Doiron
monsoon-nlp
AI & ML interests
biology and multilingual models
Recent Activity
liked
a dataset
5 days ago
Rapidata/multilingual-llm-jokes-4o-claude-gemini
reacted
to
jasoncorkill's
post
with 👀
5 days ago
"Why did the bee get married?"
"Because he found his honey!"
This was the "funniest" joke out of 10'000 jokes we generated with LLMs. With 68% of respondents rating it as "funny".
Original jokes are particularly hard for LLMs, as jokes are very nuanced and a lot of context is needed to understand if something is "funny". Something that can only reliably be measured using humans.
LLMs are not equally good at generating jokes in every language. Generated English jokes turned out to be way funnier than the Japanese ones. 46% of English-speaking voters on average found the generated joke funny. The same statistic for other languages:
Vietnamese: 44%
Portuguese: 40%
Arabic: 37%
Japanese: 28%
There is not much variance in generation quality among models for any fixed language. But still Claude Sonnet 4 slightly outperforms others in Vietnamese, Arabic and Japanese and Gemini 2.5 Flash in Portuguese and English
We have release the 1 Million (!) native speaker ratings and the 10'000 jokes as a dataset for anyone to use:
https://huggingface.co/datasets/Rapidata/multilingual-llm-jokes-4o-claude-gemini
liked
a dataset
21 days ago
s-nlp/EverGreen-Multilingual
Organizations
Models and datasets relevant to genetic counselors
During a wave of monolingual models, trained these to compete with mBERT
Embeddings and NLG related to biology / amino acid sequences
-
monsoon-nlp/codellama-abliterated
Text Generation • 7B • Updated • 10 • 1 -
monsoon-nlp/codellama-abliterated-2xd
Text Generation • 7B • Updated • 7 -
Refusal in Language Models Is Mediated by a Single Direction
Paper • 2406.11717 • Published • 3 -
Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
Paper • 2502.17424 • Published • 4
Finetuning models on posts and responses on the /r/AskNYC subreddit
Embeddings and NLG related to biology / amino acid sequences
Models and datasets relevant to genetic counselors
-
monsoon-nlp/codellama-abliterated
Text Generation • 7B • Updated • 10 • 1 -
monsoon-nlp/codellama-abliterated-2xd
Text Generation • 7B • Updated • 7 -
Refusal in Language Models Is Mediated by a Single Direction
Paper • 2406.11717 • Published • 3 -
Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs
Paper • 2502.17424 • Published • 4
During a wave of monolingual models, trained these to compete with mBERT