Inference of ONNX exported BART
As I understand correctly, one should use generate function for Seq2Seq model inference. I have exported BART to ONNX, but ONNX InferenceSession().run() returns result of BART.forward(), which is different from BART.generate(). Is there any way to get the BART.generate() from ONNX? Thanks.
The `generate` method in ONNX isn't available yet. It is on the roadmap, but it is a big item that will require quite a bit of time to solve.

You can follow the progress here: https://github.com/huggingface/transformers/pull/13578<|||||>Thanks for the response. Just a small clarification, in the pull request you mentioned is handling of beam search, if I want to use greedy decoding, I still cant have it for ONNX BART right?<|||||>Nope, for now you need to implement your own greedy search or beam search for generating.
