Update README.md

README.md

@@ -156,23 +156,21 @@ Please follow the [Build llama.cpp locally](https://github.com/ggerganov/llama.c
 >>> text="There are ten birds in a tree. A hunter shoots one. How many are left in the tree?"
 >>> ./llama-cli -m QwQ-32B-33B-Q4_0.gguf -p "Human:You are a helpful and harmless assistant.You should think step-by-step.$text\nAssistant:\n"  -n 512 --threads 16 -no-cnv
 ## Generated:
-## Okay, so the problem is: There are ten birds in a tree, a hunter shoots one. How many are left? Hmm, let me think.
+## Okay, let me think about this problem. So the question is: There are ten birds in a tree. A hunter shoots one. How many are left in the tree?
 ## 
-## First, the obvious answer might be nine, but maybe there's a trick here. Wait, when a hunter shoots a bird, the sound might scare the others away. So maybe all the other birds fly away. But the question says "how many are left in the tree?" If the hunter shot one, that bird is dead and probably still in the tree, right? Or does the shot make the others fly away? Let me break it down.
+## Hmm, the first thought might be that if there are ten birds and one is shot, then there would be nine left. But wait, maybe there's a trick here. Sometimes these riddles play on assumptions. Let me consider different angles.
 ## 
-## Original number: 10 birds. Hunter shoots one. If the shot causes the remaining nine to fly away, then only the dead one is left. So that would be 1. But maybe the question assumes that the other birds stay? But that doesn't make sense because gunshots are loud. Typically, when a gun is fired near birds, they fly away. So the answer is probably 1. Wait, but sometimes riddles play on words. Maybe "shoots one" but the others are still there? No, the shot would scare them. Unless the hunter misses? But the question says he shoots one, implying he hits. So the answer should be 1. Let me check again. Ten birds, shoot one, the rest fly away, so only the dead one remains. Therefore, the answer is 1. Yeah, that makes sense.
-## </think>
-## 
-## The answer is **1 bird left**. 
-## 
-## Here's the reasoning:  
-## 1. **Initial count**: 10 birds in the tree.  
-## 2. **Hunter shoots one bird**: This bird is killed and remains in the tree.  
-## 3. **Reaction of the other birds**: The loud gunshot would scare the remaining 9 birds, causing them to fly away.  
-## 
-## Thus, only the **dead bird** stays in the tree, leaving **1** bird remaining.  
-## 
-## This riddle relies on the common-sense assumption that birds would flee after a loud noise, even if one is hit. [end of text]
+## First, when the hunter shoots a bird, the sound of the gunshot might scare the other birds away. So even if one is killed, the others might fly away immediately. So maybe all the remaining birds fly away, leaving zero? But the question says the hunter shoots one, not necessarily killing it. Wait, but usually when someone shoots a bird with a gun, it's to kill it. So perhaps the bird is dead, but the others are scared away. So then the answer would be zero, because the other nine fly away, and the one that was shot is still in the tree as a dead bird? Or does the question count the dead one as "left"?
+##  
+## Wait, the question says "how many are left in the tree?" So maybe the dead one is still there, but the others flew away. So then it would be 1 left? Or if they all fly away, including the one shot, but that doesn't make sense because the shot bird is probably stuck in the tree. Hmm.
+##  
+## Alternatively, maybe the question is a classic riddle where the answer is zero because the other birds would fly away when they hear the gunshot. So even though one is shot, the rest leave, so zero remain. But does the dead bird count? The problem says "how many are left in the tree," so the dead one is still present. So maybe that's one. But maybe the question expects the answer zero because the others leave, and the dead one is still there. Wait, but the question might not consider the dead bird as "left" because it's dead. Hmm, tricky.
+##  
+## Wait, let me think again. The problem states "A hunter shoots one." So the hunter shoots one bird. The question is how many are left. The possible interpretations:
+##  
+## 1. The hunter successfully kills one bird. The other nine fly away due to the noise, so only the dead one remains. So answer is 1.
+##  
+## 2. The other birds fly away, so zero are left because the dead one is still there, but the question might not count it. Or maybe the dead one is
 
 ##BF16:
 ## Okay, so there's this riddle: "There are ten birds in a tree. A hunter shoots one. How many are left in the tree?" Hmm, let me think. At first glance, it seems like a simple subtraction problem. Ten birds minus one that's shot would leave nine. But wait, riddles often have a trick or a play on words. Maybe it's not that straightforward.
@@ -212,17 +210,17 @@ auto-round --model "QwQ-32B-int4-sym-gguf-q4-0-inc-to-hf" --eval --eval_bs 16  -
 
 |Metric	         |BF16    |INT4    |
 |:---------------|--------|--------|
-|Avg	         | 0.6600 |	0.6564 |
-|lambada_openai	 | 0.6697 |	0.6682 |
-|hellaswag	     | 0.6520 |	0.6512 |
-|piqa	         | 0.7947 |	0.8020 |
-|winorgrande	 | 0.6977 |	0.7127 |
-|truthfulqa_mc1	 | 0.4211 |	0.4174 | 
-|openbookqa	     | 0.3540 |	0.3260 |
-|boolq	         | 0.8645 |	0.8639 |
-|arc_easy	     | 0.8089 |	0.8089 |
-|arc_challenge	 | 0.5392 |	0.5162 |
-|mmlu	         | 0.7982 |	0.7972 |
+|Avg	         | 0.6600 |	0.6561 |
+|lambada_openai	 | 0.6697 |	0.6730 |
+|hellaswag	     | 0.6520 |	0.6500 |
+|piqa	         | 0.7947 |	0.8003 |
+|winorgrande	 | 0.6977 |	0.6843 |
+|truthfulqa_mc1	 | 0.4211 |	0.4186 | 
+|openbookqa	     | 0.3540 |	0.3420 |
+|boolq	         | 0.8645 |	0.8609 |
+|arc_easy	     | 0.8089 |	0.8110 |
+|arc_challenge	 | 0.5392 |	0.5256 |
+|mmlu	         | 0.7982 |	0.7955 |
 
 
 ### Generate the model
@@ -234,6 +232,8 @@ auto-round \
 --device 0 \
 --group_size 32 \
 --bits 4 \
+--iters 50 \
+--lr 5e-3 \
 --disable_eval \
 --format 'gguf:q4_0' \
 --output_dir "./tmp_autoround"