Is there a way to enable genselect or a tutorial for it?

#1
by brownb2 - opened

As title, a tutorial or readme update would be nice...

NVIDIA org

You can find the commands for how to run it in here https://nvidia.github.io/NeMo-Skills/releases/openreasoning/evaluation/#run-evaluation. We will be adding more details and documentation soon. A basic idea is very simple, you add N generation summaries back into the prompt https://github.com/NVIDIA/NeMo-Skills/blob/main/nemo_skills/prompt/config/openmath/genselect.yaml and then the model produces an index of the best solution. When you have more generations than can fit into the context, you can do either a random subsampling or a tournament between multiple generations.

You can find some more details in these papers https://arxiv.org/abs/2504.16891, https://openreview.net/forum?id=8LhnmNmUDb.

Let us know if you have further questions.

NVIDIA org
igitman changed discussion status to closed

Sign up or log in to comment