pimpalgaonkar commited on
Commit
e354153
·
verified ·
1 Parent(s): c071750

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -19
README.md CHANGED
@@ -37,25 +37,9 @@ The examples below showcase how Bespoke-MiniChart-7B can perform both visual per
37
  Bespoke-MiniChart-7B achieves state-of-the-art performance on chart understanding among models with similar sizes. In addition to that, the model can even surpass closed-models such as Gemini-1.5-Pro and Claude-3.5.
38
 
39
 
40
- | Model / Category | ChartQAPro (1637) | ChartQA (2500) | EvoChart (1250) | CharXiv (4000) | ChartX (1152) | ChartBench (2100) | MMC (808) | Average |
41
- |----------------------------------------|------------------:|---------------:|----------------:|---------------:|--------------:|------------------:|----------:|--------:|
42
- | **Open-Models (11 B and less)** | | | | | | | | |
43
- | InternVL-2.5-8B | –| **78.2** | 53.0 | 55.7 | 49.5 | 44.7 | **85.5** | – |
44
- | Qwen2-VL-7B | –| **82.1** | 54.5 | 53.5 | 50.8 | 50.8 | **83.9** | – |
45
- | Qwen2.5-VL-7B | **53.5** | **86.0** | 67.9 | 60.9 | 67.0 | 61.4 | **86.0** | **69.0**|
46
- | **Ours** | | | | | | | | |
47
- | Bespoke-MiniChart-7B | **56.7** | **89.5** | **71.8** | **66.4** | **68.9** | **66.1** | **88.4** | **72.5**|
48
- | **Open-Models (32 B and more)** | | | | | | | | |
49
- | QVQ-72B-Preview | –| **84.2** | 65.0 | 59.0 | 60.9 | 53.8 | **83.4** | – |
50
- | Qwen2.5-VL-32B | **58.4** | **89.5** | 74.3 | 66.9 | 64.5 | 59.8 | **89.6** | **71.9**|
51
- | Qwen2.5-VL-72B | **59.0** | **90.0** | **76.8** | 67.1 | **67.2** | 61.5 | **91.2** | **73.3**|
52
- | **Closed-Models** | | | | | | | | |
53
- | GPT-4o | **53.6** | 85.7 | 71.7 | 67.8 | 54.3 | 46.1 | **89.1** | 66.9 |
54
- | Gemini-1.5-flash | **53.8** | 85.6 | 67.5 | 67.7 | 63.5 | 58.1 | 82.1 | 68.3 |
55
- | Gemini-1.5-pro | **59.2** | **89.0** | 72.0 | **69.9** | 65.4 | 62.4 | 87.9 | **72.3**|
56
- | Claude-3.5 | **56.6** | 85.7 | **78.1** | **69.7** | 64.7 | 60.9 | **89.9** | **72.2**|
57
- | Claude-3.7 | **63.0** | 86.1 | **80.1** | **69.7** | **69.2** | **65.0** | 88.4 | **74.5**|
58
-
59
 
60
  # Model Use:
61
 
 
37
  Bespoke-MiniChart-7B achieves state-of-the-art performance on chart understanding among models with similar sizes. In addition to that, the model can even surpass closed-models such as Gemini-1.5-Pro and Claude-3.5.
38
 
39
 
40
+ <p align="left">
41
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6444e4417a7b94ddc2d14e1d/ZDLuOlPeOox-_EYD1h7pF.png" width="700">
42
+ </p>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
 
44
  # Model Use:
45