Corrected doc to use

--rope-scaling '{"rope_type":"yarn","factor":4.0,"original_max_position_embeddings":32768}' --max-model-len 131072
jklj077 changed pull request status to closed
jklj077 changed pull request status to open
jklj077 changed pull request status to merged

Sign up or log in to comment