t = polyak_constant
target_dqn_model.conv1.weight.data = t*(dqn_model.conv1.weight.data) + 
(1-t)*(target_dqn_model.conv1.weight.data)
I am doing this for each layer. I believe there must be a better method but this works for now.