Solved by Sergio_Guadarrama in post #3 
              
              
                Hi Janis, those are two different algorithms, CQL-SAC and SAC. 
CqlSacAgent implements the CQL algorithm for continuous control domains from “Conservative Q-Learning for Offline Reinforcement Learning” (Kumar, 20). 
The SACAgent uses target_entropy described in the paper and the Automating Entropy A…