can this model run on A800 ?
No
@wang35 Please try this build for A800 (80G) x 8, which makes A100/A800 support inference with FP4:
https://hub.docker.com/r/tutelgroup/deepseek-671b
· Sign up or log in to comment
