I’m not sure if a “true” FLOPS number can be calculated, as it depends on many vaiables (CUDA/MKL version, Driver version, model params, etc.) But the profiling tools 58 might give you a good idea of computational cost.