Are you calling the Critic model with two integers in this line of code?
states = 10
actions = 10
Q = self.critic(states, actions)

If so, make sure you are passing tensors to the model in the shape [batch_size, in_features].
PS: you can post code snippets by wrapping them into three backticks ```, which makes debugging easier