Here is my implementation of the “Conformer: Convolution-augmented Transformer 1” paper. It reduces the local inductive bias of transformer and achieves the best of both worlds (transformers for content-based global interactions and CNNs to exploit local features) by combining convolution neural networks and transformers to model both local and global dependencies

  
      

      GitHub
  

  
    

GitHub - Rishit-dagli/Conformer: An implementation of Conformer:... 9

  An implementation of Conformer: Convolution-augmented Transformer for Speech Recognition, a Transformer Variant in TensorFlow/Keras - GitHub - Rishit-dagli/Conformer: An implementation of Conformer...