Crossover of vanadium ions through the membranes of all-vanadium redox flow batteries (VRFB) is an issue that limits the performance of this type of flow battery. This paper reports on the preparation of a sol–gel derived silica nanocomposite anion exchange membrane (AEM) for VRFBs. The EDS and FT-IR characterizations confirm the presence and the uniformity of the silica nanoparticles formed in the membrane via an in situ sol–gel process. The properties of the obtained membrane, including the ion-exchange capacity, the area resistance, and the water uptake, are evaluated and compared to the pristine AEM and the Nafion cation exchange membrane (CEM). The experimental results show that the permeability of the vanadium ions through the silica nanocomposite AEM is about 20% lower than that of the pristine AEM, and one order of magnitude lower than that of the Nafion CEM. As a result, the rates of self-discharge and the capacity fading of the VRFB are substantially reduced. The Coulombic and energy efficiencies at a current density of 40mAcm−2 are, respectively, as high as 92% and 73%.