Behavior Structformer: Learning Players Representations with Structured Tokenization
<|reference_start|>Behavior Structformer: Learning Players Representations with Structured Tokenization: In this paper, we introduce the Behavior Structformer, a method for modeling user behavior using structured tokenization within a Transformer-based architecture. By converting tracking events into dense tokens, this approach enhances model training efficiency and effectiveness. We demonstrate its superior performance through ablation studies and benchmarking against traditional tabular and semi-structured baselines. The results indicate that structured tokenization with sequential processing significantly improves behavior modeling.<|reference_end|>
@article{smirnov2024behavior,
    title={Behavior Structformer: Learning Players Representations with Structured
  Tokenization},
    author={Oleg Smirnov, Labinot Polisi},
    journal={arXiv preprint arXiv:2406.05274},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.05274},
    primaryClass={cs.CL cs.LG}
}