h2oai

/

h2ogpt-gm-oasst1-en-2048-falcon-40b-v1

like 30

I am using ml.g5.12xlarge instance to deploy. The model deployments fails during health checks with the below error

sagemaker.exceptions.UnexpectedStatusException: Error hosting endpoint huggingface-pytorch-tgi-inference-2023-06-22-22-26-05-836: Failed. Reason: The primary container for production variant AllTraffic did not pass the ping health check. Please check CloudWatch logs for this endpoint..