Pinterest, Engineering, Monetization.
sequences, in order to develop effective sequence modeling techniques, we explore a range of architectures. Transformer [1]: One widely used approach is the Transformer, which serves as our baseline. We start with a single layer single head Transformer and include position embeddings based on time