Thank you.
I have two questions:


Is there any query provided by the PyTorch C++ APIs interface to check ahead how much device memory will be consumed by the model nodes and their weights?
By this way I will be able to decide ahead on which device I will inference the model.


Is there a PyTorch C++ APIs which enable to split the model nodes between multiple devices? for example split the model between the CPU & GPU…
I readed here:
PyTorch C++ Opcodes
that this interface provide the ability to use multiple GPUs.
So I thought that maybe it can be processed also by the CPU while part of it processed by the GPU.