Is there a way to enable genselect or a tutorial for it?
As title, a tutorial or readme update would be nice...
You can find the commands for how to run it in here https://nvidia.github.io/NeMo-Skills/releases/openreasoning/evaluation/#run-evaluation. We will be adding more details and documentation soon. A basic idea is very simple, you add N generation summaries back into the prompt https://github.com/NVIDIA/NeMo-Skills/blob/main/nemo_skills/prompt/config/openmath/genselect.yaml and then the model produces an index of the best solution. When you have more generations than can fit into the context, you can do either a random subsampling or a tournament between multiple generations.
You can find some more details in these papers https://arxiv.org/abs/2504.16891, https://openreview.net/forum?id=8LhnmNmUDb.
Let us know if you have further questions.
There is also a little standalone script you can use https://huggingface.co/nvidia/OpenReasoning-Nemotron-14B/blob/main/genselect_hf.py