In my experience, no other VS extension even begins to affect performance to the degree ReSharper does.  JetBrains readily acknowledges the performance issues.  Is there a conflict of design between VS and ReSharper?  Perhaps.  But that their homegrown IDE build around ReSharper will work faster than VS + ReSharper is a pretty safe bet.  Apples and oranges, here.