Spaces:
Running
on
CPU Upgrade
New collection needs to be looked at. Some numbers arent adding up.
So I noticed that one of my models was not being recognized on this new collection. Im assuming this collection was made automatically with code, and there is most likely an error in the logic.
As you can see the "Around 13b" models my 14b outperforms the "failspy/Phi-3-medium-4k-instruct-abliterated-v3" model. Not that im trying to be a leaderboard hog or anything, but you want to have an accurate collection, otherwise people are being misinformed about the data.
I am curious. Is this because the qwen-14b models are 14.8b params? And the collection is only picking up, lets say, up to 14.1b params?
Not that im trying to be a leaderboard hog or anything, but you want to have an accurate collection, otherwise people are being misinformed about the data.
We really like when users share these kind of issues with us, as it allows us to make the leaderboard better for everyone - as long as you're polite we're super glad to get feedback like this! So don't worry, and thanks for your vigilance!
Hi @rombodawg ,
Thanks for reporting! Yes, it's an automatic process to form this collection, I revised this code a little bit so the collection should better represent the best models now. Please, check it out here – link
Feel free to share your thoughts!
@alozowski I just checked it out. It looked way better. more organized too. Good job 👍👍
Thank you! Really appreciate your help 🤝
Feel free to open a discussion if you have any issues or suggestions!