fix bug 'DynamicCache' object has no attribute 'get_max_length' , updata modeling_phi3.py

#39
by Qodi - opened

fix bug max_cache_length = past_key_values.get_max_length()
AttributeError: 'DynamicCache' object has no attribute 'get_max_length'. Did you mean: 'get_seq_length'?

i am also facing the same challenge here, I am new to generative AI, how can i solve this problem

Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment