The speedup depends on the model and of course potentially other bottlenecks.
E.g. even if your model gets a speedup, your training might be bottlenecked by another part of the code, which will hide the speedup.
To check for TensorCore usage, you could use PyProf 10 (only Python) or nsys.