@tom @InnovArul
this is a fascinating topic because if we can make scalable tied autoencoders (“coders”) then we can get twice the number of optimization steps on 1/2 the number of parameters – potentially 4x improvement …
how do you make sure tied autoencoder forward step does gradients properly? add reverse function?