Ah, I see. No worries - you can just save the tokenizer in a variable and you’ll be able to access it throughout your inference.py code. Check this one as an example: https://github.com/marshmellow77/hf-summarization/blob/main/inference_code/inference.py 1
Hope that helps