Hey,
I guess it’s been a long time and you must’ve found the solution, but here’s my implementation 274 that deals with the size_average problem.
I tried it over images from the CarRacing environment in gym, and it works pretty well.
Let me know if it’s useful to you !