Arka Pal's picture

27 1

Arka Pal

ArkaAbacus

·

ArkaPal999

AI & ML interests

None yet

Organizations

ArkaAbacus's activity

New activity in open-llm-leaderboard/open_llm_leaderboard 11 months ago

Models disappearing from eval queue?

#805 opened 11 months ago by

New activity in abacusai/Llama-3-Smaug-8B 11 months ago

Any news about the updated model with the latest recipe?

#5 opened 11 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 12 months ago

GSM8K Evaluation has a serious bug/oversight, that is negatively impacting score of all Llama 3 models. Please consider updating to the latest commit of lm-evaluation-harness which fixes it.

#770 opened 12 months ago by

New activity in abacusai/Smaug-Llama-3-70B-Instruct 12 months ago

Smaug-LLaMa-3-8B-Instruct in the works?

#3 opened 12 months ago by

Use correct license - llama3 instead of llama2

#1 opened 12 months ago by

Prompt format?

#2 opened 12 months ago by

New activity in abacusai/Llama-3-Giraffe-70B about 1 year ago

base model

#2 opened about 1 year ago by

prompt? llama-3?

#1 opened about 1 year ago by

New activity in abacusai/Llama-3-Smaug-8B about 1 year ago

What datasets were these trained on?

#2 opened about 1 year ago by

New activity in meta-llama/Meta-Llama-3-70B-Instruct about 1 year ago

Fix chat template to add generation prompt only if the option is selected.

#4 opened about 1 year ago by

New activity in meta-llama/Meta-Llama-3-8B-Instruct about 1 year ago

Fix chat template to add generation prompt only if the option is selected

#8 opened about 1 year ago by

Fix chat template to add generation prompt only if the option is selected

#7 opened about 1 year ago by

Fix chat template to add generation prompt only if the option is selected

#6 opened about 1 year ago by

New activity in abacusai/Smaug-72B-v0.1 about 1 year ago

aaa

#25 opened about 1 year ago by

New activity in abacusai/Smaug-2-72B about 1 year ago

What is this?

#1 opened about 1 year ago by

New activity in abacusai/ARC_DPO_FewShot about 1 year ago

Unexpected error in the dataset!

#1 opened about 1 year ago by

New activity in abacusai/HellaSwag_DPO_FewShot about 1 year ago

Some unexpected error in the dataset!

#1 opened about 1 year ago by

New activity in abacusai/Smaug-72B-v0.1 about 1 year ago

Questions about architecture (+ LoRA)

#16 opened about 1 year ago by

New activity in abacusai/Smaug-72B-v0.1 over 1 year ago

which chat template should we use?

#6 opened over 1 year ago by

Smaug - Japanese Language Support

#11 opened over 1 year ago by