Hi @hoyden, thanks once again for your answer. It’s a bit tricky. We need to extend the ONNX Runtime (ORT) with operators that are not yet present. This can be done since ORT has a pretty nice C/C++ extension mechanism.
To save development time/effort we are basically using Libtorch in the ORT custom operators, and thus just need to interface the input/output data formats between ORT->Torch->ORT. However, the inputs, as defined by ORT come always as const float*. We don’t have a saying in this. We can always cast away the constedness, but that is also not the nicest thing…