Hi Akash - in order to use your model on Sagemaker you will have to create a model package called model.tar.gz that includes all the required model files. You can find all the info here: Deploy models to Amazon SageMaker 2
Hope that helps!
Cheers
Heiko