Hey @amangrk,
Sorry for missing your post.
Sadly, only models < 10GB are supported with direct loading from the HUB via the configuration. In addition to this, I can tell you that when you would move GPT-J 6B to s3 and then try to deploy SageMaker would timeout, expect you would go with the P4 instances but they are very expensive.
I already shared this with the AWS Team and they are looking into it.