Update model_worker.py

#4
by danaaubakirova HF staff - opened

Currently, do_sample is forced to be False and top_p is commented out, resulting in identical outputs each time, which is concerning. For more varied and realistic outputs, I suggest enabling sampling by setting do_sample=True and adjusting top_p as needed. Thanks!

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment