Happy new year as well 
Could potentially be possible. You could confirm this by adding a requirements.txt next to your inference.py script and adding a new transformers version.
Since you are using Inferentia already, I am happy to share that there will be soon HF-specific Inferentia DLCs.