Ashvini Kumar Jindal's picture

Ashvini Kumar Jindal

akjindal53244

·

AI & ML interests

NLP

Recent Activity

new activity about 1 month ago

akjindal53244/Llama-3.1-Storm-8B:Adding Evaluation Results

reacted to albertvillanova's post with 👍 3 months ago

🚨 We’ve just released a new tool to compare the performance of models in the 🤗 Open LLM Leaderboard: the Comparator 🎉 https://huggingface.co/spaces/open-llm-leaderboard/comparator Want to see how two different versions of LLaMA stack up? Let’s walk through a step-by-step comparison of LLaMA-3.1 and LLaMA-3.2. 🦙🧵👇 1/ Load the Models' Results - Go to the 🤗 Open LLM Leaderboard Comparator: https://huggingface.co/spaces/open-llm-leaderboard/comparator - Search for "LLaMA-3.1" and "LLaMA-3.2" in the model dropdowns. - Press the Load button. Ready to dive into the results! 2/ Compare Metric Results in the Results Tab 📊 - Head over to the Results tab. - Here, you’ll see the performance metrics for each model, beautifully color-coded using a gradient to highlight performance differences: greener is better! 🌟 - Want to focus on a specific task? Use the Task filter to hone in on comparisons for tasks like BBH or MMLU-Pro. 3/ Check Config Alignment in the Configs Tab ⚙️ - To ensure you’re comparing apples to apples, head to the Configs tab. - Review both models’ evaluation configurations, such as metrics, datasets, prompts, few-shot configs... - If something looks off, it’s good to know before drawing conclusions! ✅ 4/ Compare Predictions by Sample in the Details Tab 🔍 - Curious about how each model responds to specific inputs? The Details tab is your go-to! - Select a Task (e.g., MuSR) and then a Subtask (e.g., Murder Mystery) and then press the Load Details button. - Check out the side-by-side predictions and dive into the nuances of each model’s outputs. 5/ With this tool, it’s never been easier to explore how small changes between model versions affect performance on a wide range of tasks. Whether you’re a researcher or enthusiast, you can instantly visualize improvements and dive into detailed comparisons. 🚀 Try the 🤗 Open LLM Leaderboard Comparator now and take your model evaluations to the next level!

new activity 4 months ago

akjindal53244/Llama-3.1-Storm-8B:Languages report ?

View all activity

Articles

Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging

Organizations

akjindal53244's activity

New activity in akjindal53244/Llama-3.1-Storm-8B about 1 month ago

Adding Evaluation Results

#9 opened about 2 months ago by

New activity in akjindal53244/Llama-3.1-Storm-8B 4 months ago

Languages report ?

#7 opened 4 months ago by

New activity in akjindal53244/Llama-3.1-Storm-8B 5 months ago

too smart ?

#4 opened 5 months ago by

New activity in akjindal53244/Llama-3.1-Storm-8B-GGUF 5 months ago

is it uncensored ?

#2 opened 5 months ago by

New activity in akjindal53244/Llama-3.1-Storm-8B 5 months ago

Ollama?

#2 opened 5 months ago by

New activity in blog-explorers/README 5 months ago

[Support] Community Articles

#5 opened 10 months ago by

New activity in arcee-ai/Llama-Spark 5 months ago

Not able to reproduce benchmark metrics

#2 opened 5 months ago by

New activity in akjindal53244/Arithmo-Mistral-7B about 1 year ago

qlora weights

#1 opened about 1 year ago by

New activity in akjindal53244/Mistral-7B-v0.1-Open-Platypus about 1 year ago

Adding Evaluation Results

#1 opened about 1 year ago by

leaderboard-pr-bot

New activity in open-llm-leaderboard-old/requests over 1 year ago

Update model type from "fine-tuned" to "instruction-tuned"

#13 opened over 1 year ago by

New activity in open-llm-leaderboard/open_llm_leaderboard over 1 year ago

Update Model Type from fine-tuned to Instruction-Tuned

#312 opened over 1 year ago by

Mistral Finetunes Are Failing

#311 opened over 1 year ago by