can this model run on Hopper GPU

by simonlindelta - opened Mar 6

Mar 6

can this model run on Hopper GPU

Mar 7

•

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

Mar 8

•

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

Is 5070ti with torch2.7+cu128 okay now?

Mar 8

You can but not so meaningful since Hopper doesn't have HW-supported FP4. It would be slow.

Is 5070ti with torch2.7+cu118 okay now?

cu118 doesn't support blackwell.

Mar 27

This comment has been hidden

Mar 27

This comment has been hidden (marked as Resolved)

Apr 3

•

@simonlindelta Please try this build for H100 (80G) x 8, supporting inference with FP4:

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment