Should @tf.function only be used during training, or should it also be used during inference?
The function I use during inference calls the model, sends the output to a softmax. and then calls argmax. Adding @tf.function to this function works well, but does it provide any benefits?