Bias entry for chat completions?
Has anyone made a bias entry for chat completions that can be imported into sillytavern? With some models, using that is unavoidable.
Not that I know of. And I don't see myself making one, or converting my KobolCPP list. Logit bias is a pretty unreliable way to deal with word bans, it can end up causing some collateral banning of unrelated phrases since some words share token overlaps. I wouldn't recommend it.
The bans are never bans, so even if there is collateral, the model will find some way to say what it wants. 100% it reduces this slop by some margin.
Ahh well.. i'll do it myself and if so, Ill post it up here.
Still more destructive than I would like. But please, go ahead, share it on a repo, and I can give you a boost by linking it in my index if it works well enough.