n8henrie:

I will update soon to post my actual model in case it’s helpful for future readers.


By “soon” I apparently meant a year. Sorry! I wrote up my code and results here, hope it’s helpful:

  

      n8henrie.com – 24 Aug 21
  

  
    

Writing a Transformer Classifier in PyTorch 32

  Technology, medicine, science, superstition… and having fun. Brought to you by Nathan Henrie.