results/aggregated_scores_icarus.csv

Model,Agg S2R,Agg MC,Agg VerilogEval S2R,Agg VerilogEval MC,Agg RTLLM,Agg VeriGen
DeepSeek R1-0528,76.79,77.79,78.84,79.65,70.04,71.64
DeepSeek R1,75.53,76.24,77.67,77.55,68.49,71.92
Llama 3.1 405B,53.23,55.25,56.55,54.35,42.26,58.23
Qwen3 235B A22B,69.16,66.42,74.83,68.36,50.48,60.01
Qwen2.5 72B,49.36,49.97,50.22,50.74,46.51,47.42
Llama 3.(1-3) 70B,39.48,46.29,39.47,40.83,39.53,64.29
QwQ 32B,62.6,41.92,65.02,38.68,54.6,52.6
Qwen2.5 32B,50.39,41.94,50.86,41.01,48.86,45.0
StarChat2 15B v0.1,38.76,41.72,36.68,35.58,45.61,61.96
DeepSeek R1 Distill Qwen 14B,23.14,24.94,24.94,24.3,17.22,27.07
CodeLlama 70B,33.04,35.59,32.2,32.27,35.81,46.56
DeepSeek Coder 33B,27.03,39.59,22.65,37.64,41.47,46.01
QwenCoder 2.5 32B,44.02,46.49,43.68,44.05,45.15,54.52
DeepCoder 14B,26.4,32.92,27.32,33.18,23.38,32.07
QwenCoder 2.5 14B,37.69,41.98,35.32,40.26,45.5,47.64
SeedCoder 8B,50.89,36.79,51.71,36.52,48.2,37.66
SeedCoder 8B Reasoning,43.75,49.83,47.85,46.76,30.22,59.97
OpenCoder 8B,30.06,36.95,26.8,34.57,40.83,44.8
QwenCoder 2.5 7B,14.15,34.5,6.57,33.0,39.16,39.46
DeepSeek Coder 6.7B,31.87,30.9,28.88,28.99,41.75,37.19
CodeV R1 Distill Qwen 7B,36.12,30.66,32.35,20.56,48.57,63.98
HaVen-CodeQwen,43.58,50.68,44.67,47.23,39.98,62.04
CodeV-QW-7B,20.37,52.85,18.82,50.64,25.48,60.14
RTLCoder Mistral,21.82,32.19,23.71,26.34,15.58,51.5
RTLCoder DeepSeek,37.22,40.19,38.33,36.13,33.58,53.57
OriGen,52.88,55.97,53.0,50.0,52.47,75.66
CodeV-CL-7B,14.73,35.1,12.71,30.93,21.38,48.85
CodeV-DS-6.7B,19.62,49.29,14.8,46.08,35.52,59.87