Missing config.json
#6
by
wxl2001
- opened
Hi there! May I ask if the model has a config.json file?
Can confirm this error:
OSError: models\mistralai_mamba-codestral-7B-v0.1 does not appear to have a file named config.json. Checkout 'https://huggingface.co/models\mistralai_mamba-codestral-7B-v0.1/tree/None' for available files.
+1
Hey @wxl2001 @sha9921 ! What are you using to run the model, currently? mistral-inference is the current way to go, it should also be soon available on HF transformers but not yet.
Mistral-inference is specified again. But what about state-spaces/mamba? Not everyone has an Nvidia video card. State-spaces/mamba allows the use of AMD. Show an example of launching on state-spaces/mamba please!
+1