Is it possible to use an Apple Time Capsule just as a network attached backup drive and not a router? Short Question : 
Is it possible to use an Apple Time Capsule just as a network attached backup drive and not a router? 

Background : 
We want to use a separate router to manage a more complex network. We where looking at not using an Apple Time Capsule and instead a 3rd party NAS (probably Synology) for Time Machine to backup to but as I've read in multiple places that backing up to a 3rd party NAS can cause the Time Machine backups to become corrupt / miss files due to the fact the HDD in a 3rd party NAS is ext4/NTFS/... and can't be OS X journaled (or what ever Time Machine prefers)

We've got a network as follows : 


TP-Link Gigabit Load Balance Router with VPN (we will also set VLANs, static IPs etc on here)
48 port Netgear gigabit network switch
multiple in wall RJ45 ports 
4x Ubiquity UAP Wi-Fi access points (some indoor some outdoor)
Yes, this is possible and actually quite simple. To prevent the Time Capsule from acting as a WiFi access point or router, and use it only as a backup disk, just open the AirPort Utility app on a Mac (Applications -> Utilities -> AirPort Utility) and do the following:


Select your Time Capsule and hit Edit.
Go to the tab labeled Wireless (not Network as zhovner suggests, as putting it in bridge mode only stops it from being a router but does not stop it from being a network access point that your devices will connect to)
From the Network Mode pop-up menu, choose Off.
Click Update, and the base station will restart and load the new settings.


The result will be a Time Capsule you can still wirelessly backup your Macs to, but does not function as a router or access points, so none of your devices will connect to it.

This is the setup that I use; I have 3 eero routers and thus needed the Time Capsule to not be an access point, and these steps stopped it from being that but let me keep backing up to it as usual.


From this wireless tab, just choose off in the Network mode pop-up and hit update.

Source is a Macworld article on the topic.