Thanks for all your help,
final silly question,
I now get:
RuntimeError: Expected 3-dimensional input for 3-dimensional weight 1 1, but got 2-dimensional input of size [16, 2048] instead
I believe that this is showing the 16 (batch size) and 2048 (length of the vector), but do i need to resize this?