Does qwen-moe have gqa version?
Qwen1.5, no; Qwen2, yes. but qwen2 does not have an MoE of this size.
· Sign up or log in to comment
