OneRec: Unifying Retrieve and Rank with Generative Recommender and
  Iterative Preference Alignment
Recently, generative retrieval-based recommendation systems have emerged as a
promising paradigm. However, most modern recommender systems adopt a
retrieve-and-rank strategy, where the generative model functions only as a
selector during the retrieval stage. In this paper, we propose OneRec, which
replaces the cascaded learning framework with a unified generative model. To
the best of our knowledge, this is the first end-to-end generative model that
significantly surpasses current complex and well-designed recommender systems
in real-world scenarios. Specifically, OneRec includes: 1) an encoder-decoder
structure, which encodes the user's historical behavior sequences and gradually
decodes the videos that the user may be interested in. We adopt sparse
Mixture-of-Experts (MoE) to scale model capacity without proportionally
increasing computational FLOPs. 2) a session-wise generation approach. In
contrast to traditional next-item prediction, we propose a session-wise
generation, which is more elegant and contextually coherent than point-by-point
generation that relies on hand-crafted rules to properly combine the generated
results. 3) an Iterative Preference Alignment module combined with Direct
Preference Optimization (DPO) to enhance the quality of the generated results.
Unlike DPO in NLP, a recommendation system typically has only one opportunity
to display results for each user's browsing request, making it impossible to
obtain positive and negative samples simultaneously. To address this
limitation, We design a reward model to simulate user generation and customize
the sampling strategy. Extensive experiments have demonstrated that a limited
number of DPO samples can align user interest preferences and significantly
improve the quality of generated results. We deployed OneRec in the main scene
of Kuaishou, achieving a 1.6\% increase in watch-time, which is a substantial
improvement.
67c6bfdf96b9f5fa18c517db
Jiaxin Deng
admin_assigned
2025-03-04T10:16:32.410Z
625f6ebee1994410eef16a42
/avatars/eaa353afe91e849adcd35656477a6462.svg
Jiaxin Deng
user
OrpheusBetter
67c6bfdf96b9f5fa18c517dc
Shiyao Wang
admin_assigned
2025-03-04T10:16:39.957Z
641f8e596d51620635e49707
/avatars/f30b24da53fea2278f343c318007bb60.svg
shiyao wang
user
oneself
67c6bfdf96b9f5fa18c517dd
Kuo Cai
claimed_verified
2025-03-04T12:01:27.669Z
65e6cc77e999cde61fcbc097
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/5NxDLRmS2cQgNeZ6ScSNW.png
CaiKuo
user
caikuo
67c6bfdf96b9f5fa18c517de
Lejian Ren
67c6bfdf96b9f5fa18c517df
Qigen Hu
claimed_verified
2025-03-06T09:27:32.108Z
6731b8a34d1ced57fa702b2a
https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/_gpl9rvuxj4tL8JJLeMZ1.png
huqigen
user
willis4hu
67c6bfdf96b9f5fa18c517e0
Weifeng Ding
admin_assigned
2025-03-04T10:17:03.422Z
64aeb9342cda6a37a4781b7d
/avatars/c1584c10ff0f9871315872245c9934fc.svg
Weifeng Ding
user
DingWF
67c6bfdf96b9f5fa18c517e1
Qiang Luo
67c6bfdf96b9f5fa18c517e2
Guorui Zhou
admin_assigned
2025-03-04T10:16:52.106Z
67c6c570cf87e2d2ebfc81aa
https://cdn-avatars.huggingface.co/v1/production/uploads/67c6c570cf87e2d2ebfc81aa/7qAstZtIT86Uwrz3u_anv.jpeg
Guorui Zhou
user
GuoruiZhou
OneRec: Unifying Retrieve and Rank with Generative Recommender and
  Iterative Preference Alignment
Recently, generative retrieval-based recommendation systems have emerged as a
promising paradigm. However, most modern recommender systems adopt a
retrieve-and-rank strategy, where the generative model functions only as a
selector during the retrieval stage. In this paper, we propose OneRec, which
replaces the cascaded learning framework with a unified generative model. To
the best of our knowledge, this is the first end-to-end generative model that
significantly surpasses current complex and well-designed recommender systems
in real-world scenarios. Specifically, OneRec includes: 1) an encoder-decoder
structure, which encodes the user's historical behavior sequences and gradually
decodes the videos that the user may be interested in. We adopt sparse
Mixture-of-Experts (MoE) to scale model capacity without proportionally
increasing computational FLOPs. 2) a session-wise generation approach. In
contrast to traditional next-item prediction, we propose a session-wise
generation, which is more elegant and contextually coherent than point-by-point
generation that relies on hand-crafted rules to properly combine the generated
results. 3) an Iterative Preference Alignment module combined with Direct
Preference Optimization (DPO) to enhance the quality of the generated results.
Unlike DPO in NLP, a recommendation system typically has only one opportunity
to display results for each user's browsing request, making it impossible to
obtain positive and negative samples simultaneously. To address this
limitation, We design a reward model to simulate user generation and customize
the sampling strategy. Extensive experiments have demonstrated that a limited
number of DPO samples can align user interest preferences and significantly
improve the quality of generated results. We deployed OneRec in the main scene
of Kuaishou, achieving a 1.6\% increase in watch-time, which is a substantial
improvement.
OneRec, an end-to-end generative model with encoder-decoder architecture, sparse Mixture-of-Experts, session-wise generation, and Iterative Preference Alignment using Direct Preference Optimization, significantly improves recommendation quality and user watch-time.
encoder-decoder sparse Mixture-of-Experts session-wise generation Iterative Preference Alignment Direct Preference Optimization reward model