If you stumble upon this thread in 2021, you can install the latest pip wheel in Colab as follows:
!pip install torchaudio -f https://download.pytorch.org/whl/torch_stable.html

and then restart the runtime.
(Check GitHub - pytorch/audio: Data manipulation and transformation for audio signal processing, powered by PyTorch 7)