How to run llama3.1-70B-Instruct inference with mutil-gpu?

#38
by ToukesuD - opened

how to run on 4090.

Did you resolve it ?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment