@dk-crazydiv and I were able to train a VisionEncoderDecoderModel to generate movie/t.v show plot from poster. We used google/vit-base-patch16-224-in21k encoder and gpt2 decoder.
We have uploaded the model to  model hub poster2plot 5
@lewtun Link to the Gradio app on  Spaces poster2plot 7
We are still working on improving the model.