Worked in Colab, but in Lambda I had to avoid using HuggingFacePredictor and switched to boto3. The reason for it is that I tried, but couldn’t do any of the following

add sagemaker_sdk layer to lambda because it is not supported officially
find a public lambda layer which can added via ARN to the lambda
create my own custom layer (too much learning required and I switched to boto3-based call).

Thanks again, @philschmid