BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks
•
44
BigCode
Enterprise
non-profit
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
bigcode's activity
SivilTaram
authored
a
paper
about 6 hours ago
terryyz
updated
8
datasets
about 7 hours ago
bigcode/bigcodebench-hard-results
Viewer
•
Updated
•
183
•
132
•
1
bigcode/bigcodebench-results
Viewer
•
Updated
•
183
•
184
•
2
bigcode/bigcodebench-hard-solve-rate
Viewer
•
Updated
•
296
•
214
•
1
bigcode/bigcodebench-hard-domain
Viewer
•
Updated
•
335
•
156
•
1
bigcode/bigcodebench-hard-perf
Viewer
•
Updated
•
335
•
240
bigcode/bigcodebench-solve-rate
Viewer
•
Updated
•
2.28k
•
317
bigcode/bigcodebench-domain
Viewer
•
Updated
•
273
•
213
bigcode/bigcodebench-perf
Viewer
•
Updated
•
273
•
132
terryyz
updated
a
Space
5 days ago
reach-vb
authored
a
paper
15 days ago
anton-l
authored
a
paper
15 days ago
thomwolf
authored
a
paper
15 days ago
terryyz
updated
a
Space
17 days ago
fix: c# and f# config
1
#3 opened 17 days ago
by
kevmo314
Muennighoff
authored
a
paper
18 days ago
thomwolf
authored
a
paper
about 1 month ago
Post
3118
💫...And we're live!💫 Seasonal newsletter from ethicsy folks at Hugging Face, exploring the ethics of "AI Agents"
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha
huybery
authored
a
paper
about 2 months ago
huybery
authored
a
paper
2 months ago