It depends a lot on what you are doing, but if it’s CNN/Unet-Style (so no for loops over individual pixels), my guess would be a rather very small speedup (<10%, possibly much slower) from moving from Python to C++.
Best regards
Thomas