Hugging Face's logo

sbrzz
/
TinyLLaVA-Qwen2.5-0.5B-dinov2-small

Visual Question Answering
Safetensors
tinyllava
multimodal
Model card Files Community
1
sbrzz lbourdois commited on
Commit
3e5eb6f
·
verified ·
1 Parent(s): 1181df4

Improve language tag (#1)

Browse files

- Improve language tag (d0b65f159cad595f0790ff4cb03c0413747b5c91)


Co-authored-by: Loïck BOURDOIS <[email protected]>

Files changed (1) hide show
  1. README.md +66 -54
README.md CHANGED
@@ -1,55 +1,67 @@
1
- ---
2
- license: apache-2.0
3
- language:
4
- - en
5
- base_model:
6
- - Qwen/Qwen2.5-0.5B
7
- - facebook/dinov2-small
8
- pipeline_tag: visual-question-answering
9
- tags:
10
- - multimodal
11
- ---
12
-
13
- pretrain stage only, 1180 epochs
14
-
15
- [MMMU](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#mmmu)
16
-
17
- | Category | # Samples | Accuracy |
18
- |---------------------------------|-----------|----------|
19
- | Overall | 900 | 0.303 |
20
- | Overall-Art and Design | 120 | 0.308 |
21
- | Art | 30 | 0.200 |
22
- | Art Theory | 30 | 0.300 |
23
- | Design | 30 | 0.400 |
24
- | Music | 30 | 0.333 |
25
- | Overall-Business | 150 | 0.247 |
26
- | Accounting | 30 | 0.200 |
27
- | Economics | 30 | 0.333 |
28
- | Finance | 30 | 0.267 |
29
- | Management | 30 | 0.267 |
30
- | Marketing | 30 | 0.167 |
31
- | Overall-Science | 150 | 0.253 |
32
- | Biology | 30 | 0.233 |
33
- | Chemistry | 30 | 0.200 |
34
- | Geography | 30 | 0.200 |
35
- | Math | 30 | 0.267 |
36
- | Physics | 30 | 0.367 |
37
- | Overall-Health and Medicine | 150 | 0.327 |
38
- | Basic Medical Science | 30 | 0.433 |
39
- | Clinical Medicine | 30 | 0.233 |
40
- | Diagnostics and Laboratory Med. | 30 | 0.200 |
41
- | Pharmacy | 30 | 0.400 |
42
- | Public Health | 30 | 0.367 |
43
- | Overall-Humanities and Soc. Sci.| 120 | 0.367 |
44
- | History | 30 | 0.367 |
45
- | Literature | 30 | 0.567 |
46
- | Sociology | 30 | 0.333 |
47
- | Psychology | 30 | 0.200 |
48
- | Overall-Tech and Engineering | 210 | 0.324 |
49
- | Agriculture | 30 | 0.300 |
50
- | Architecture and Engineering | 30 | 0.300 |
51
- | Computer Science | 30 | 0.267 |
52
- | Electronics | 30 | 0.267 |
53
- | Energy and Power | 30 | 0.467 |
54
- | Materials | 30 | 0.500 |
 
 
 
 
 
 
 
 
 
 
 
 
55
  | Mechanical Engineering | 30 | 0.167 |
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - zho
5
+ - eng
6
+ - fra
7
+ - spa
8
+ - por
9
+ - deu
10
+ - ita
11
+ - rus
12
+ - jpn
13
+ - kor
14
+ - vie
15
+ - tha
16
+ - ara
17
+ base_model:
18
+ - Qwen/Qwen2.5-0.5B
19
+ - facebook/dinov2-small
20
+ pipeline_tag: visual-question-answering
21
+ tags:
22
+ - multimodal
23
+ ---
24
+
25
+ pretrain stage only, 1180 epochs
26
+
27
+ [MMMU](https://tinyllava-factory.readthedocs.io/en/latest/Evaluation.html#mmmu)
28
+
29
+ | Category | # Samples | Accuracy |
30
+ |---------------------------------|-----------|----------|
31
+ | Overall | 900 | 0.303 |
32
+ | Overall-Art and Design | 120 | 0.308 |
33
+ | Art | 30 | 0.200 |
34
+ | Art Theory | 30 | 0.300 |
35
+ | Design | 30 | 0.400 |
36
+ | Music | 30 | 0.333 |
37
+ | Overall-Business | 150 | 0.247 |
38
+ | Accounting | 30 | 0.200 |
39
+ | Economics | 30 | 0.333 |
40
+ | Finance | 30 | 0.267 |
41
+ | Management | 30 | 0.267 |
42
+ | Marketing | 30 | 0.167 |
43
+ | Overall-Science | 150 | 0.253 |
44
+ | Biology | 30 | 0.233 |
45
+ | Chemistry | 30 | 0.200 |
46
+ | Geography | 30 | 0.200 |
47
+ | Math | 30 | 0.267 |
48
+ | Physics | 30 | 0.367 |
49
+ | Overall-Health and Medicine | 150 | 0.327 |
50
+ | Basic Medical Science | 30 | 0.433 |
51
+ | Clinical Medicine | 30 | 0.233 |
52
+ | Diagnostics and Laboratory Med. | 30 | 0.200 |
53
+ | Pharmacy | 30 | 0.400 |
54
+ | Public Health | 30 | 0.367 |
55
+ | Overall-Humanities and Soc. Sci.| 120 | 0.367 |
56
+ | History | 30 | 0.367 |
57
+ | Literature | 30 | 0.567 |
58
+ | Sociology | 30 | 0.333 |
59
+ | Psychology | 30 | 0.200 |
60
+ | Overall-Tech and Engineering | 210 | 0.324 |
61
+ | Agriculture | 30 | 0.300 |
62
+ | Architecture and Engineering | 30 | 0.300 |
63
+ | Computer Science | 30 | 0.267 |
64
+ | Electronics | 30 | 0.267 |
65
+ | Energy and Power | 30 | 0.467 |
66
+ | Materials | 30 | 0.500 |
67
  | Mechanical Engineering | 30 | 0.167 |