Model inference
#1
by
johnlockejrr
- opened
How to infere with this model?
Hi! You can use TGi or VLLM with docker
https://huggingface.co/docs/text-generation-inference/basic_tutorials/gated_model_access
How to infere with this model?
Hi! You can use TGi or VLLM with docker
https://huggingface.co/docs/text-generation-inference/basic_tutorials/gated_model_access