Update README.md (#1)

- Update README.md (921f2498410ea24731d7d9968d000aaf519ed668)
- Update README.md (9090e1488c31145268d822bb8166f9f3c80ffb17)
- Update README.md (d93f80d03ef27e1af39b94cac166d281bcc7f0a4)


Co-authored-by: Omri Almog <[email protected]>

README.md

@@ -1,6 +1,9 @@
 ---
 base_model:
 - meta-llama/Llama-3.1-405B-Instruct
+license: llama3.1
+pipeline_tag: text-generation
+library_name: transformers
 ---
 # Model Overview
 
@@ -77,39 +80,37 @@ python examples/llama/convert_checkpoint.py --model_dir Llama-3.1-405B-Instruct-
 trtllm-build --checkpoint_dir /ckpt --output_dir /engine
 ```
 
-* Accuracy evaluation:
-
-1) Prepare the MMLU dataset:
-```sh
-mkdir data; wget https://people.eecs.berkeley.edu/~hendrycks/data.tar -O data/mmlu.tar
-tar -xf data/mmlu.tar -C data && mv data/data data/mmlu
-```
-
-2) Measure MMLU:
-
-```sh
-python examples/mmlu.py --engine_dir ./engine --tokenizer_dir Llama-3.1-405B-Instruct-FP8/ --test_trt_llm --data_dir data/mmlu
-```
-
 * Throughputs evaluation:
 
 Please refer to the [TensorRT-LLM benchmarking documentation](https://github.com/NVIDIA/TensorRT-LLM/blob/main/benchmarks/Suite.md) for details.
 
 #### Evaluation
-The accuracy (MMLU, 5-shot) and throughputs (tokens per second, TPS) benchmark results are presented in the table below:
+
 <table>
   <tr>
    <td><strong>Precision</strong>
    </td>
    <td><strong>MMLU</strong>
    </td>
+   <td><strong>GSM8K (CoT) </strong>
+   </td>
+   <td><strong>ARC Challenge</strong>
+   </td>
+   <td><strong>IFEVAL</strong>
+   </td>
    <td><strong>TPS</strong>
    </td>
   </tr>
   <tr>
-   <td>FP16
+   <td>BF16
+   </td>
+   <td>87.3
+   </td>
+   <td>96.8
    </td>
-   <td>86.6
+   <td>96.9
+   </td>
+   <td>88.6
    </td>
    <td>275.0
    </td>
@@ -117,7 +118,13 @@ The accuracy (MMLU, 5-shot) and throughputs (tokens per second, TPS) benchmark r
   <tr>
    <td>FP8
    </td>
-   <td>86.2
+   <td>87.4
+   </td>
+   <td>96.2
+   </td>
+   <td>96.4
+   </td>
+   <td>90.4
    </td>
    <td>469.78
    </td>