How to eval the video/image sequences?
#69
by
lkllkl
- opened
Since the model can eval the single image perfectly, I wonder how to eval the video/image sequences. I change the message where the type is video and its not working.
Good day. As a starting point:
- Split the video into frames (e.g. jpg pictures) in an appropriate format.
- Pass each frame sequentially to the model with the corresponding prompt (iteratively). Save the result (can be in a list or dataframe).