Sir, the tutorial that you shared is great, but I am looking for something different. Since my oringal dataset is huge, I am carrying the preprocessing step using pyspark, where I assign indices to different items/tokens, and then I make padded sequences and write them in a csv to be further consumed by my model.
I am building an item2idx and idx2item dictionary before training the model.
So what exactly I am looking here for is a way to use of those dictionaries while inference after exporting the model (along with the dictionaries)