Hardware requirements

#125
by AnikaTaggd - opened

What are the minimum hardware requirements to run this model?

Mistral AI_ org

Hi there !! Check here: https://docs.mistral.ai/getting-started/open_weight_models/

As it is now, 16gb of VRAM minimum for full precision- However !! This does not take into account quantization, you can run quants with less hardware requirements, you might want to check it out since most people do not run the full precision model, will depend on ur use case too !

Sign up or log in to comment