About baichuan-13b model conversion
#4
by
greatzane
- opened
Baichuan-13B uses ALiBi position encoding instead of Rotary Embedding.
Is it still possible to convert it to LLaMA format?
I think it's impossible. It seems that there is no official implementation of llama+abili model in Transformers.