microsoft
/

Phi-3.5-MoE-instruct

Text Generation

Model card Files Files and versions

How much GPU is needed to load the Phi-3.5-MoE-instruct model

#44

by cyt78 - opened Sep 24, 2024

cyt78

Sep 24, 2024

This comment has been hidden

Microsoft org Sep 24, 2024

you can try changing device_map="cuda" to device_map="auto"

cyt78

Sep 25, 2024

This comment has been hidden

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment