@ethancaballero probably my bad and I put down the KL backwards, but yes it is supposed to be KL(average_distribution||current_distribution). I can’t make it public yet, but I’m working on a standalone implementation of ACER that I will open source in early June. I’ve added you as a collaborator, so that you can use my whole codebase rather than having to port this snippet elsewhere.