How do I set up MS Visual Studio 2005 project dependencies such that making a change in a higher level project does not force a recompile of all other projects it depends on.

If I have 5 dll projects, which are related in various ways... Under the 'Project'->'Dependencies' I have identified the next project down, but only down one level.
When I make a small change to the higher project, a select 'Build'->'Build myLib' the lower project is also recompiled... If I specify all dependencies, then all dependent projects are also recompiled... which isn't right, is it?

If I remove the explicit dependency, the lower project won't get rebuilt, even if it should be (which is as i would expect).

What if I have several levels of dependency (A depends on B depends on C etc)?