Solved by Dennis in post #3 
              
              
                Hi @Unnamed, welcome to the Forum. 
yes, please feel free to have a look at the Soft Actor Critic agent tf_agents.agents.SacAgent 
There’s a target_update_tau factor (+ many more) for soft updates of the target network. 
Also used in this colab tutorial: 

Lucky Rewards, 
Dennis