13
Qozimo
AI & ML interests
None yet
Recent Activity
repliedto sergiopaniego's post about 9 hours ago
catching up on some bookmarked reads from the summer, reading Antidoom from @liquidai
small reasoning models get stuck more easily when the task involves a long thinking trace and a hard problem. It starts repeating the same word over and over again ("Wait", "Alternatively"…), each repetition makes the next one likelier, and the generation is spent before it reaches an answer
they measured it, 10.2% of completions for an early LFM2.5-2.6B checkpoint and 22.9% for Qwen3.5-4B at greedy. After training those drop to 1.4% and 1.0%
the fix is FTPO (final token preference optimization). What I like is how narrow it is, it only touches the single token where the loop starts
three ways it differs from DPO:
> trains one token position, mid-generation, instead of whole sequences
> spreads probability across ~20 plausible alternatives instead of swapping one overtrained token for another
> keeps the regularizer in logit space, no softmax, so the rest of the vocabulary stays put
the third one is what makes it usable. If you want to edit one position without disturbing the model, you can't have a loss that reshuffles the other 150k logits on the way
and their explanation abt the result: the training teaches the model nothing new about math or code, it clears the failure mode that was blocking answers the model could already produce
full blog > https://www.liquid.ai/blog/antidoom
FTPO itself comes from Antislop, where it was built to strip overused phrasing. LiquidAI retargeted it to doom loops
and under the hood it's a subclass of TRL's DPOTrainer with compute_loss overridden, around 90 lines of loss and no new trainer
we documented that pattern in TRL's docs
https://huggingface.co/docs/trl/main/en/customization#change-the-training-objective reacted to SeaWolf-AI's post with 🤯 about 10 hours ago
🧪 Open Discovery Challenge — Season 4 is open: non-opioid pain
WHO titled its 2023 report "Left behind in pain."
The same drug kills by excess in one part of the world and, by its absence, lets people die in agony elsewhere. About 80% of the ~600,000 drug-related deaths WHO estimated for 2019 involved opioids. The same report records a 5-fold to 63-fold gap in morphine consumption between rich and poor countries: the richest 10% use 90% of what circulates. Everyone else endures surgery, and terminal cancer, without it.
Both problems have one answer: a painkiller that does not create dependence.
Nav1.7 has come closest. People born without a working copy of this channel feel no pain while every other sensation stays normal — validated not in animals but in humans.
There is still no drug, and the difficulty is not the target but the discrimination. The body carries several similar sodium channels, and blocking the heart's hERG channel alongside causes fatal arrhythmia. Several candidates were discontinued for exactly that.
Season 4 asks one question: can you block the pain channel alone?
Target — Nav1.7 VSD4, the domain IV voltage sensor where this inhibitor class binds
Anti-target — hERG pore, computed as the tetramer: four subunits together form the space a drug enters, and a monomer misses the binders that matter.
Closes 2027-01-31 · Prize USD 1,000 to the season's #1
Any model, any harness. However you found the candidate, it meets the same rubric.
14 days, 9,886 candidates, 108 participants
ODC opened on 2026-08-15. In the fourteen days since, 9,886 candidate molecules have come from 108 participants across four seasons — malaria, tuberculosis, Chagas disease, and now non-opioid pain. About 700 a day, from people who mostly do not know each other.
The candidates are the point. The leaderboard is only how we keep score.
👉 https://huggingface.co/spaces/FINAL-Bench/open-discovery-challengeOrganizations
None yet