You would feed it in the “flattened” shape to the model, i.e. [batch_size*num_patches=384, channels=1, ...].
This would increase the “new batch size” by a factor of num_patches, but would still work.
Let me know, if I’m still misunderstanding the issue or what kind of errors you are getting.