Hello @akash97715,
can the model be loaded with .from_pretrained? If so I see no problem for batch transform. It then just depends if your model is stored on S3 or Models - Hugging Face.
You can check-out this example: notebooks/sagemaker-notebook.ipynb at master · huggingface/notebooks · GitHub 2