fixes the asserion error when num_beams > 1

#42

When doing beam search with num_beams > 1, this assertion will fail. Removes the assertion to allow beam search with num_beams > 1. This bug was reported in https://huggingface.co/microsoft/Phi-4-multimodal-instruct/discussions/31

gargamit changed pull request status to merged

Sign up or log in to comment