Pinterest, Engineering, Infrastructure, Open Source.
extremely large features like user-sequence features much better than torch dataloader. The improvement became more prominent as we started to incorporate more complex data-processing and downsampling logic into the data loader. After adding spam-user filtering (map-side join) and dynamic negative