Complete's picture

90

Complete

ompl44

·

AI & ML interests

None yet

Recent Activity

reacted to openfree's post with 🧠 2 days ago

Korean Exam Leaderboard: LLMs vs Civil Service and Professional Qualification Exams 📝 https://huggingface.co/spaces/openfree/Korean-Exam-Leaderboard ## 📊 What is this leaderboard? This leaderboard evaluates the performance of various AI models on 22 Korean civil service and professional qualification exams. All scores are converted to a 100-point scale to show how well different LLMs can solve actual Korean civil service and professional qualification tests! ## 🏆 Current Top Performers - **OpenAI/GPT-o1**: Bar Exam 52.5 points 🥇 - **OpenAI/GPT-4.5**: Bar Exam 49.33 points 🥈 - **OpenAI/GPT-4o**: Bar Exam 49.11 points 🥉 - **deepseek-ai/DeepSeek-R1**: Bar Exam 47.33 points ## 📋 Exams Being Evaluated The leaderboard includes various Korean civil service and professional qualification exams: - Korean Bar Exam - Senior Civil Service Grade 5 - Judicial Service Grade 5 - National Assembly Grade 5 - Judicial Scrivener - Police Executive Candidate - And more exams! ## 🤖 Models Being Evaluated We are testing a variety of models: - OpenAI: GPT-o1, GPT-o3-mini, GPT-4.5, GPT-4o - Anthropic: Claude 3.7 Sonnet - Google: Gemini 2.0 Flash/PRO/Flash Thinking - Meta: Llama 3.3 70B Instruct, Llama 3.2 90B Vision - DeepSeek: DeepSeek-R1 - Qwen: QwQ-32B, Qwen2.5 Coder - Mistral: Mistral-Small-3.1-24B - NVIDIA models: NVIDIA Nemotron variant models - And many more! ## 🔍 Why This Matters Korean civil service exams are known for their high difficulty and comprehensive knowledge assessment. These exams test deep knowledge across legal, administrative, and public service domains. Success in these exams demonstrates not just language understanding but also domain expertise and reasoning ability. ## 🧪 Evaluation Methodology 🔜 Future Plans We are continuously expanding our test coverage across all 22 exam categories. We will keep updating the scores marked "TBD" so please stay tuned!

liked a Space 2 days ago

ginigen/Workflow-Canvas

liked a Space 2 days ago

ginipick/PharmAI-Korea

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet