Solved by ptrblck in post #2 
              
              
                Could you try to assign the out tensor to activations[name] instead of appending it? 
If I understand your use case correctly, you would only need to current output not all outputs from previous iterations (which might cause this error, if their computation graph was already freed).