Model,Agg S2R,Agg MC,Agg VerilogEval S2R,Agg VerilogEval MC,Agg RTLLM,Agg VeriGen
DeepSeek R1,75.53,72.96,77.67,77.55,68.49,57.82
Llama 3.1 405B,53.23,53.88,56.55,54.35,42.26,52.35
Qwen3 236B A22B,69.16,63.42,74.83,68.36,50.48,47.15
Llama 3.(1-3) 70B,39.48,43.29,39.47,40.83,39.53,51.42
Qwen2.5 72B,49.36,47.23,50.22,50.74,46.51,35.65
QwQ 32B,62.6,39.46,65.02,38.68,54.6,42.03
Qwen2.5 32B,50.39,38.93,50.86,41.01,48.86,32.09
StarChat2 15B v0.1,38.76,38.98,36.68,35.58,45.61,50.2
DeepSeek R1 Distill Qwen 14B,23.14,23.3,24.94,24.3,17.22,20.01
CodeLlama 70B,33.04,32.86,32.2,32.27,35.81,34.8
DeepSeek Coder 33B,27.03,36.31,22.65,37.64,41.47,31.91
QwenCoder 2.5 32B,44.02,43.75,43.68,44.05,45.15,42.76
QwenCoder 2.5 14B,37.69,38.97,35.32,40.26,45.5,34.72
DeepCoder 14B,26.4,30.75,27.32,33.18,23.38,22.75
OpenCoder 8B,30.06,35.86,26.8,34.57,40.83,40.1
SeedCoder 8B,50.89,34.05,51.71,36.52,48.2,25.89
SeedCoder 8B Reasoning,43.75,47.1,47.85,46.76,30.22,48.23
QwenCoder 2.5 7B,14.15,32.86,6.57,33.0,39.16,32.4
"DeepSeek Coder 6,7B",31.87,27.89,28.88,28.99,41.75,24.27
RTLCoder Mistral,21.82,28.65,23.71,26.34,15.58,36.27
RTLCoder DeepSeek,37.22,36.64,38.33,36.13,33.58,38.33
OriGen,52.88,51.89,53.0,50.0,52.47,58.12
CodeV R1 Distill Qwen 7B,36.12,26.84,32.35,20.56,48.57,47.55
HaVen-CodeQwen,43.58,47.13,44.67,47.23,39.98,46.8
CodeV-CL-7B,14.73,33.73,12.71,30.93,21.38,42.97
CodeV-QW-7B,20.37,50.11,18.82,50.64,25.48,48.38
CodeV-DS-6.7B,19.62,47.1,14.8,46.08,35.52,50.46