Solved by jiayu in post #2 
              
              
                After digging through the log an device console I found the cause: it is hitting memory limit: on my device it is only 6MB. 
Guess that renders LibTorch hardly usable now… 
Hope this is helpful to somebody else.