Commits · fair-forward/evals-for-every-language

Upload from GitHub Actions: More models and languages

a73f888
verified

davidpomerenke commited on 5 days ago

Upload from GitHub Actions: Results for 50 languages

3dfd880
verified

davidpomerenke commited on 6 days ago

Upload from GitHub Actions: Eavaluate on 40 languages

941d5c5
verified

davidpomerenke commited on 8 days ago

Upload from nightly evaluation run

c3be561
verified

davidpomerenke commited on 11 days ago

Upload from GitHub Actions: Add math benchmarks

549360a
verified

davidpomerenke commited on 20 days ago

Upload from GitHub Actions: More results

52abc5b
verified

davidpomerenke commited on 21 days ago

Upload from nightly evaluation run

4a34e67
verified

davidpomerenke commited on 21 days ago

Upload from GitHub Actions: Update model ranking fetching

f840423
verified

davidpomerenke commited on 21 days ago

Upload from GitHub Actions: Use FLORES+ via Huggingface

913253a
verified

davidpomerenke commited on 21 days ago

Upload from nightly evaluation run

9ee89ef
verified

davidpomerenke commited on 24 days ago

Upload from nightly evaluation run

8a4050a
verified

davidpomerenke commited on 29 days ago

Upload from GitHub Actions: New results

b311dd5
verified

davidpomerenke commited on 29 days ago

Upload from nightly evaluation run

dcb356d
verified

davidpomerenke commited on May 7

Block gemini-2.5-pro-exp-03-25

092c06a

David Pomerenke commited on May 5

Only run tasks for which there is no result yet

2f9dee1

David Pomerenke commited on May 4

Run on 40 languages, additional models

260c1a3

David Pomerenke commited on Apr 27

Run evals

b0c61ed

David Pomerenke commited on Apr 27

Run on 15 languages

f8a3dad

David Pomerenke commited on Apr 18

Add model history plot

f52ec6e

David Pomerenke commited on Apr 18

Implement MMLU task

a683732

David Pomerenke commited on Apr 18

Add Global MMLU benchmark

ce2acb0

David Pomerenke commited on Apr 17

Translation both from and to

731eddd

David Pomerenke commited on Apr 13

Add OpenRouter metadata to models

9002fc2

David Pomerenke commited on Apr 11

Run on 100 languages, adjust display

8274634

David Pomerenke commited on Apr 6

Add Dockerfile

4d13673

David Pomerenke commited on Apr 6

Language selection checkboxes & filtering in backend

d91b022

David Pomerenke commited on Apr 4

Basic backend setup with FastApi but without actual filtering

2c21cf7

David Pomerenke commited on Mar 29

spBLEU tokenizer, run on more languages

eaf2d97

David Pomerenke commited on Mar 25

Better map tooltip

92b2164

David Pomerenke commited on Mar 23

Process data for country map

723f963

David Pomerenke commited on Mar 21

Autonymns and cooler dataset search display

33469f2

David Pomerenke commited on Mar 16

More models

c5278dd

David Pomerenke commited on Mar 15

Basic language table

d1a7111

David Pomerenke commited on Mar 15

Refactor eval code into files

da6e1bc

David Pomerenke commited on Mar 15

Model table using React

ecf4195

David Pomerenke commited on Mar 15

Better results format (flatten + aggregate 3x), push results to hub

7a9c651

David Pomerenke commited on Mar 14

Run on 50 languages

80a0827

David Pomerenke commited on Mar 11

Rerun

0638620

David Pomerenke commited on Mar 9

Separate overall scores for T2T / S2T

e9a19be

David Pomerenke commited on Mar 9

Put all languages into results.json, replace pyglottolog

040dc35

David Pomerenke commited on Mar 9

Add ASR ChrF scores

4973af4

David Pomerenke commited on Mar 9

More evals

8633921

David Pomerenke commited on Mar 8

Better separation of ttt/stt in results format

e223525

David Pomerenke commited on Mar 8

Evaluate transcription

3d9cde9

David Pomerenke commited on Mar 8