Hi,
Thanks for your reply. “the intermediates using the fake input would be used to calculate the backward activations, which will be wrong”. What exactly are “backward activations” and are they created and stored during forward prop? Can I access and replace these intermediate activations mentioned in this sentence “which will create intermediate activations (outputs of layers) and store them” ???