Solved by tom in post #3 
              
              
                No, sqrt’s backward wants abs_ to calculate d sqrt(x) =  -0.5 / sqrt(x) . 
If you absolutely needed the memory, you use checkpointing for zlogit, but most of the time that type of memory optimization is not worth the effort. 
Best regards 
Thomas