nightmedia commited on
Commit
265af6b
·
verified ·
1 Parent(s): bb8d3b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -12,6 +12,31 @@ tags:
12
 
13
  Tuned for fast output, no emoticons, trained for 168 samples, loss avg 0.2032, final loss 0.1682
14
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
15
  This model [Qwen3-0.6B-dwq6c-mlx](https://huggingface.co/Qwen3-0.6B-dwq6c-mlx) was
16
  converted to MLX format from [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B)
17
  using mlx-lm version **0.26.0**.
 
12
 
13
  Tuned for fast output, no emoticons, trained for 168 samples, loss avg 0.2032, final loss 0.1682
14
 
15
+ Performance evaluation:
16
+
17
+ ```bash
18
+ arc_challenge:
19
+ acc 0.273, acc_norm 0.290, stderr: 0.013
20
+
21
+ arc_easy:
22
+ acc 0.412, acc_norm 0.360, stderr 0.0098
23
+
24
+ boolq:
25
+ acc 0.378, stderr 0.0084
26
+
27
+ hellaswag:
28
+ acc 0.366, acc_norm 0.425, stderr: 0.0049
29
+
30
+ openbookqa:
31
+ acc 0.190, acc_norm 0.342, stderr: 0.0212
32
+
33
+ piqa:
34
+ acc 0.657, acc_norm 0.649, stderr: 0.011
35
+
36
+ winogrande:
37
+ acc 0.542, stderr: 0.014
38
+ ```
39
+
40
  This model [Qwen3-0.6B-dwq6c-mlx](https://huggingface.co/Qwen3-0.6B-dwq6c-mlx) was
41
  converted to MLX format from [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B)
42
  using mlx-lm version **0.26.0**.