Commit
·
edc3022
1
Parent(s):
65cf63b
Update README.md
Browse files
README.md
CHANGED
@@ -41,7 +41,12 @@ The 7B version of the model is a distilled version of the 14B model, specificall
|
|
41 |
|
42 |
Please note that the model was trained on unfiltered internet data. Since we do not have the capacity to vet all of it, there may be a substantial amount of objectionable content, pornography, violence, and offensive language present that we are unable to remove. Therefore, you will still need to complete your own checks on the model's safety and filter keywords in the output. Due to computational resource constraints, we are presently unable to implement RLHF for the model's ethics and safety, nor training on SFT samples that refuse to answer certain questions for restrictive fine-tuning.
|
43 |
|
44 |
-
Bonus: The model underwent some fine-tuning on the prompt format introduced in LLaVA1.5 that is unrelated to image attention calculation. Therefore, aligning the ViT Projection module with frozen
|
|
|
|
|
|
|
|
|
|
|
45 |
|
46 |
## MMLU:
|
47 |
stem ACC: 64.19
|
|
|
41 |
|
42 |
Please note that the model was trained on unfiltered internet data. Since we do not have the capacity to vet all of it, there may be a substantial amount of objectionable content, pornography, violence, and offensive language present that we are unable to remove. Therefore, you will still need to complete your own checks on the model's safety and filter keywords in the output. Due to computational resource constraints, we are presently unable to implement RLHF for the model's ethics and safety, nor training on SFT samples that refuse to answer certain questions for restrictive fine-tuning.
|
43 |
|
44 |
+
Bonus: The model underwent some fine-tuning on the prompt format introduced in LLaVA1.5 that is unrelated to image attention calculation. Therefore, aligning the ViT Projection module with frozen LM under visual instructions would enable rapid implementation of effective multimodal capabilities.
|
45 |
+
|
46 |
+
## PROMPT FORMAT:
|
47 |
+
[chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
|
48 |
+
|
49 |
+
**System Prompt must not be empty!**
|
50 |
|
51 |
## MMLU:
|
52 |
stem ACC: 64.19
|