You're right.  

while this point is easy for people to remember, most Church historians don't teach that this issue is all that big a deal or insurmountable, as you point out.

Papal authority, yes.  And also the Orthodox's roots of their own authority involved an "Emperor's" approval..and since there aren't such Emperors in place still today, there's no canonical way for them to move to reunion.