Will there still be 32B dense models?
#18
by
lingyezhixing
- opened
The previous GLM-4-32-0414 left a deep impression on me, so will GLM4.5 also release a similar dense model?
We currently have no such plans, and we will provide updates if there are any.
Alright, but I still think dense models around 30B have the potential to achieve performance close to that of 100B-scale MOE models. Anyway, thanks for your efforts. If there are any updates, it would be greatly appreciated if you could give me a nudge here.
ZHANGYUXUAN-zR
changed discussion status to
closed