Hi and Thanks for your reply
The state is a numpy array (128, 100) ,and the shape of tensor I’m passing to action_layer is torch.Size([1, 128, 100]).  So the input must be [1, 128]?
How do I do this? With Flatten I got this: torch.Size([1, 12800]) and same error.
With torch.rand(1, 128, 100)[ : , : , -1] I got this: torch.Size([1, 128]) but first state is a (128, 100) array and I think it’s a lot of data lost. Am I wrong?