BTW 1:
If this is indeed RL and your dealing with DDQN like scenario, you might need to have 2 separate networks and copy the weights from source to target
BTW 2:
Using Sequential in your example might be more suitable
class Model(nn.Module):
    def __init__(self,in_state,out_feats):
        super(Model, self).__init__()
        self.apply_1 = nn.Sequential(nn.Linear(4*in_state,32), 
                                      nn.ReLU(),
					                  nn.Linear(32,out_feats),
 					                  nn.Softmax(dim=1))
                                    
    def forward(self,inp):
        return self.apply_1(inp)

Roy.