The gems will destroy themselves if unlinked for too long, or if moved too far from each other, and that's not the worst part as the other two downsides are arguably worse. To enchant these closely linked gems you have to enchant them while linking them at the same time, and you can never change or modify any enchantment on the gems after that.