The newly release AudioClip model combines, audio, text and images.
Would it be possible to train an AudioClip model using Flax/Jax?

  
      

      GitHub
  

  
    

AndreyGuzhov/AudioCLIP 6

  Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043) - AndreyGuzhov/AudioCLIP


  

  
    
    
  

  



  
      

      arXiv.org
  

  
    

AudioCLIP: Extending CLIP to Image, Text and Audio 5

  In the past, the rapidly evolving field of sound classification greatly
benefited from the application of methods from other domains. Today, we observe
the trend to fuse domain-specific tasks and approaches together, which provides
the community with...


  

  
    
    
  

  



  

      paperswithcode.com
  

  
    

Papers with Code - AudioCLIP: Extending CLIP to Image, Text and Audio 1

  Implemented in one code library.