Transformers, Pytorch, Machine Learning, Deep Dives, Data Science.
1000s of lines of code. Other tutorials with custom code I found (links at the end of the article) often oversimplified use cases and didn’t tackle concepts such as masking of variable-length sequence batch handling. I therefore decided to write my own Transformer to make sure I understood the