Sorry it can be a bit misleading:


auto prediction = outputs.argmax(1); in C++ always returns 6 for every sample fed into the network - so it looks like model was not trained, or weight were not updated. But since model was loaded from file, everything should be ok but it is not.
I have just synthetised the outputs tensor, and checked if maybe my code for summing correct count or something is invalid in the C++

Output differs from Python to C++.
But even when I import model in python (which was exported from python) everything works correctly. Problem shows up only if I import model in the C++ application.