Yes. your link times will grow. But link times are not depended on choice of language. It depends on how big your set of object files is. Depending on your platform you can optimize your build.<p>I.e. 
- use dynamic link libraries<p>- use create static libraries<p>- carefully manage your dependencies. i.e. only include what you actually need.<p>- hot reload game logic (where quick iteration is more important)<p>- compile cache.<p>- ssd disk<p>- fast processor<p>- and yes, agreed. 100kloc is still small.