That’s amazing to hear that you are working on the TFRagModel ! do you already have a PR on this?
I’d definitely say that you should go ahead with _no_beam_search_generation and _beam_search_generation in TF (it’ll take probably at least ~2,3 weeks until I start the TF refactor and > a month until I merge it). Feel free to tag me on the TFRagModel