Iftach Arbel

iarbel

AI & ML interests

Optimization Algorithms, NLP, LLMs, CV

Recent Activity

Organizations

Cimphony's profile picture Project Didi's profile picture Neradot ltd's profile picture Chaos Labs's profile picture Design Like You Mean It's profile picture

iarbel's activity

published a Space about 10 hours ago
New activity in cimphony-ai-admin/Cimphony-Mistral-Law-7B 5 months ago

Fail to run on vLLM

5
#1 opened 6 months ago by
yaronr
New activity in microsoft/Phi-3-mini-4k-instruct 8 months ago
replied to DmitryRyumin's post 10 months ago
view reply

The evaluation benchmarks use zero-shot, where usually few-shot is used. This raises the question whether the few-shot results weren't as good, compared to similar-sized models.

Hopefully the authors will release few-shot results, aligned with common practice (e.g. HF Open LLM Leaderboard)

updated a Space 12 months ago
New activity in Equall/Saul-7B-Instruct-v1 about 1 year ago

How was the evaluation executed?

1
#3 opened about 1 year ago by
iarbel