21 10 33

Bhadresh Savani

bhadresh-savani

https://www.linkedin.com/in/bhadreshsavani/

AI & ML interests

NLP, Deep Learning, ML

Recent Activity

liked a model about 2 months ago

Datou1111/shou_xin

reacted to lin-tan's post with 🔥 2 months ago

Can language models replace developers? #RepoCod says “Not Yet”, because GPT-4o and other LLMs have <30% accuracy/pass@1 on real-world code generation tasks. - Leaderboard https://lt-asset.github.io/REPOCOD/ - Dataset: https://huggingface.co/datasets/lt-asset/REPOCOD @jiang719 @shanchao @Yiran-Hu1007 Compared to #SWEBench, RepoCod tasks are - General code generation tasks, while SWE-Bench tasks resolve pull requests from GitHub issues. - With 2.6X more tests per task (313.5 compared to SWE-Bench’s 120.8). Compared to #HumanEval, #MBPP, #CoderEval, and #ClassEval, RepoCod has 980 instances from 11 Python projects, with - Whole function generation - Repository-level context - Validation with test cases, and - Real-world complex tasks: longest average canonical solution length (331.6 tokens) and the highest average cyclomatic complexity (9.00) Introducing hashtag #RepoCod-Lite 🐟 for faster evaluations: 200 of the toughest tasks from RepoCod with: - 67 repository-level, 67 file-level, and 66 self-contains tasks - Detailed problem descriptions (967 tokens) and long canonical solutions (918 tokens) - GPT-4o and other LLMs have < 10% accuracy/pass@1 on RepoCod-Lite tasks. - Dataset: https://huggingface.co/datasets/lt-asset/REPOCOD_Lite #LLM4code #LLM #CodeGeneration #Security

upvoted an article 5 months ago

Llama-3.1-Storm-8B: Improved SLM with Self-Curation + Model Merging

View all activity

Organizations

bhadresh-savani's activity

liked a model about 2 months ago

Datou1111/shou_xin

Text-to-Image • Updated Dec 9, 2024 • 12.5k • 850

liked 2 datasets 5 months ago

sujet-ai/Sujet-Finance-Instruct-177k

Viewer • Updated Apr 5, 2024 • 178k • 165 • 74

Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 9.57k • 1.36k

liked a Space 6 months ago

Runtime error

🚀

ROAM2FewShotChallenge

liked a model 6 months ago

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 524k • 62

liked a Space 7 months ago

Running

251

📊

Llm Pricing

liked a Space 9 months ago

Running on Zero

981

🥼👖👗

OOTDiffusion

High-quality virtual try-on ~ Your cyber fitting room

liked a Space about 1 year ago

Runtime error

219

📈

FinGPT Forecaster

liked a model about 1 year ago

FinGPT/fingpt-forecaster_dow30_llama2-7b_lora

Updated Jun 11, 2024 • 12.4k • 116

liked a Space about 1 year ago

Running on CPU Upgrade

12.3k

🏆

Open LLM Leaderboard

Track, rank and evaluate open LLMs and chatbots

liked a model over 1 year ago

stevhliu/my_awesome_billsum_model

Text2Text Generation • Updated Oct 11, 2022 • 884 • 5

liked a Space almost 2 years ago

Running

160

👀

Check My Progress Deep RL Course

liked a model almost 2 years ago

databricks/dolly-v2-12b

Text Generation • Updated Jun 30, 2023 • 3.68k • 1.96k

liked 3 datasets almost 2 years ago

liked 2 models over 2 years ago

bigscience/bloom

Text Generation • Updated Jul 28, 2023 • 2.59M • 4.83k

valhalla/t5-small-qa-qg-hl

Text2Text Generation • Updated Jun 23, 2021 • 2.3k • 12

liked a Space over 2 years ago

Runtime error

🔥

Layoutlmv3_invoice

liked a Space almost 3 years ago

Runtime error

👞

Bhadresh Savani

AI & ML interests

Recent Activity

Organizations

bhadresh-savani's activity

ROAM2FewShotChallenge

Llm Pricing

OOTDiffusion

FinGPT Forecaster

Open LLM Leaderboard

Check My Progress Deep RL Course

Layoutlmv3_invoice

Sketch2Shoes