JosephusCheung commited on
Commit
edc3022
·
1 Parent(s): 65cf63b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -41,7 +41,12 @@ The 7B version of the model is a distilled version of the 14B model, specificall
41
 
42
  Please note that the model was trained on unfiltered internet data. Since we do not have the capacity to vet all of it, there may be a substantial amount of objectionable content, pornography, violence, and offensive language present that we are unable to remove. Therefore, you will still need to complete your own checks on the model's safety and filter keywords in the output. Due to computational resource constraints, we are presently unable to implement RLHF for the model's ethics and safety, nor training on SFT samples that refuse to answer certain questions for restrictive fine-tuning.
43
 
44
- Bonus: The model underwent some fine-tuning on the prompt format introduced in LLaVA1.5 that is unrelated to image attention calculation. Therefore, aligning the ViT Projection module with frozen LMunder visual instructions would enable rapid implementation of effective multimodal capabilities.
 
 
 
 
 
45
 
46
  ## MMLU:
47
  stem ACC: 64.19
 
41
 
42
  Please note that the model was trained on unfiltered internet data. Since we do not have the capacity to vet all of it, there may be a substantial amount of objectionable content, pornography, violence, and offensive language present that we are unable to remove. Therefore, you will still need to complete your own checks on the model's safety and filter keywords in the output. Due to computational resource constraints, we are presently unable to implement RLHF for the model's ethics and safety, nor training on SFT samples that refuse to answer certain questions for restrictive fine-tuning.
43
 
44
+ Bonus: The model underwent some fine-tuning on the prompt format introduced in LLaVA1.5 that is unrelated to image attention calculation. Therefore, aligning the ViT Projection module with frozen LM under visual instructions would enable rapid implementation of effective multimodal capabilities.
45
+
46
+ ## PROMPT FORMAT:
47
+ [chatml](https://github.com/openai/openai-python/blob/main/chatml.md)
48
+
49
+ **System Prompt must not be empty!**
50
 
51
  ## MMLU:
52
  stem ACC: 64.19