Solved by agadetsky in post #3 
              
              
                @KFrank Thank you for your answer. I created PR, maybe someone will add cummax  and logcumsumexp at ATen to be efficient. At the moment I end up with the following implementation, maybe someone will need it in the future. 
import torch
import numpy as np

def cummax(x, dim):
    x_np = x.detach().cp…