 This can be determined by observing the relative motion of the pairs.If the motion is part of an orbit, or if the stars have similar radial velocities and the difference in their proper motions is small compared to their common proper motion, the pair is probably physical.One of the tasks that remains for visual observers of double stars is to obtain sufficient observations to prove or disprove gravitational connection.