That depends on many things.
For example, is the camera on the video always on the same position? Even a slightly change of perspective would change the measuring of any object in the image.
imagine that the zoom of the camera is changed, the measuring will change and for the Object Detection model it doesn’t matter, it will probably return a bigger square but that doesn’t mean that the object is bigger.
Does it makes sense?