Live Code Bench

community

https://livecodebench.github.io/

AI & ML interests

Holistic contamination-free evaluation of Code LLMs

Recent Activity

StringChaos new activity 1 day ago

livecodebench/code_generation_lite:fix typos

StringChaos authored a paper 4 days ago

GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents

StringChaos updated a dataset about 2 months ago

livecodebench/code_generation_lite

View all activity

spaces 2

Code Generation Samples

View code problem evaluations

Leaderboard

models 0

None public yet

datasets 6

livecodebench/code_generation_lite

Updated 1 day ago • 46.5k • 42

livecodebench/execution-v2

Viewer • Updated Nov 26, 2024 • 479 • 715 • 3

livecodebench/code_generation

Viewer • Updated Jun 13, 2024 • 121 • 1.66k • 19

livecodebench/test_generation

Viewer • Updated Jun 13, 2024 • 442 • 1.43k • 4

livecodebench/submissions

Preview • Updated May 26, 2024 • 30

livecodebench/execution

Viewer • Updated Mar 12, 2024 • 479 • 473 • 4