Your understanding is correct. TensorFlow is a library for defining and executing mathematical operations on multidimensional arrays. It just so happens that much of machine learning, and especially deep learning, can be described as mathematical operations on multidimensional arrays.