Pinterest, Engineering, Monetization.
into the self-attention calculations. Sum Pooling: In terms of pooling techniques, we experiment with sum pooling, which is traditionally used in user sequence modeling due to its efficiency. We also develop a new approach called period sum pooling, where we divide the sequence into multiple