## Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce

| Houye Ji   | Ye Tang                          | Zhaoxin Chen   |
|------------|----------------------------------|----------------|
| JD.COM     | JD.COM                           | JD.COM         |
| China      | China                            | China          |
| Lixi Deng  | Jun Hu                           | Lei Su         |
| JD.COM     | National University of Singapore | JD.COM         |
| China      | China                            | China          |

## ABSTRACT

## KEYWORDS

With the rapid development of the short video industry, traditional e-commerce has encountered a new paradigm, video-driven e-commerce, which leverages attractive videos for product showcases and provides both video and item services for users. Benefitting from the dynamic and visualized introduction of items, video-driven e-commerce has shown huge potential in stimulating consumer confidence and promoting sales. In this paper, we focus on the video retrieval task, facing the following challenges: (1) How to handle the heterogeneities among users, items, and videos? (2) How to mine the complementarity between items and videos for better user understanding? In this paper, we first leverage the dual graph to model the co-existing of user-video and user-item interactions in video-driven e-commerce and innovatively reduce user preference understanding to a graph matching problem. To solve it, we further propose a novel bi-level Graph Matching Network (GMN), which mainly consists of node- and preference-level graph matching. Given a user, node-level graph matching aims to match videos and items, while preference-level graph matching aims to match multiple user preferences extracted from both videos and items. Then the proposed GMN can generate and improve user embedding by aggregating matched nodes or preferences from the dual graph in a bi-level manner. Comprehensive experiments show the superiority of the proposed GMN with significant improvements over state-of-the-art approaches (e.g., AUC+1.9% and CTR+7.15%). We have developed it on a well-known video-driven e-commerce platform, serving hundreds of millions of users every day.

## CCS CONCEPTS

· Do Not Use This Code → Generate the Correct Terms for Your Paper ; Generate the Correct Terms for Your Paper ; Generate the Correct Terms for Your Paper; Generate the Correct Terms for Your Paper.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org.

Conference acronym 'XX, June 03-05, 2024, Woodstock, NY

© 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 978-1-4503-XXXX-X/18/06...$15.00 https://doi.org/XXXXXXX.XXXXXXX

Graph Neural Network, Recommendation, Video Retrieval, Graph Matching, E-commerc

## ACMReference Format:

Houye Ji, Ye Tang, Zhaoxin Chen, Lixi Deng, Jun Hu, and Lei Su. 2024. Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce. In Proceedings of Make sure to enter the correct conference title from your rights confirmation emai (Conference acronym 'XX). ACM, New York, NY, USA, 9 pages. https://doi.org/XXXXXXX.XXXXXXX

## 1 INTRODUCTION

In the era of the information explosion, the recommender system has become the most effective way to help users discover what they are interested from enormous data. As two basic Internet applications, e-commerce and content recommendation both provide the recommender service but focus on either item recommendation or content (e.g., video and live) recommendation. Recently, with the thriving of online applications, there is a surge of videodriven e-commerce [8], which integrates video and e-commerce for better services. Benefiting from vivid and attractive video shows, video-driven e-commerce provides a new business paradigm which improves user stickiness and activeness, and has become a new driving force for e-commerce development. For example, TikTok and Kuaishou integrate e-commerce with videos, while Taobao and JD.COM leverage videos to improve the user experience in traditional e-commerce. As shown in Figure 1(a), JD.COM first incentivizes authors to produce videos for related items , and then conducts video recommendations for users. Due to the large-scale video set, industrial recommendation systems usually adopt the classical two-stage architecture: retrieval and ranking [18]. Given a user, the retrieval stage aims to find thousands of candidate videos from the whole video set, then the ranking stage aims to precisely select hundreds of videos from the retrieved candidate videos.

In this paper, we focus on the video retrieval stage with the following challenges: (1) How to handle the heterogeneities among users, items, and videos? The characteristics of items (e.g., price, sales, and shop) are markedly different from videos (e.g., resolution, duration, and author) and them aim to stimulate user consumption and attract users stay, respectively. This disparity compels us to treat user-item interactions and user-video interactions with distinct considerations, given the unique characteristics each type of interaction manifests. (2) How to mine the complementarity between items and videos for better user understanding? While at a cursory glance these interactions may seem discrete, they exhibit a strong complementary nature upon closer examination. As exemplified in

(a) Video-driven E-commerce

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-ada5bf91-5a5b-4e87-a283-ad48d3608fb3.jpg)

(b) Heterogeneous User Behaviors

Figure 1: An example of video-driven e-commerce.

Figure 1, when a user interacts with both an item 𝑖 1 symbolizing a keyboard and a corresponding video 𝑣 1, it reinforces the user's profound interest in keyboards. In a contrasting scenario, if a user interacts with a beer item 𝑖 4 but directs their video interactions exclusively towards devices, such as keyboards, it suggests a potential superficial interest in the beer item.

Based on the above analysis, when performing video retrieval in video-driven e-commerce, we need to address the following new requirements:

- · Heterogeneous Interaction Modeling. Different from traditional e-commerce, the video-driven e-commerce consists of complex heterogeneous interactions among users, videos, and items. Intuitively, user interactions on videos and items will show similar patterns and preferences. As shown in Figure 1(b), user 𝑢 1 who wants to buy a keyboard will watch related videos 𝑣 1 , 𝑣 2 and click item 𝑖 1. How to model the co-existing of heterogeneous interactions is the basis of user preference understanding and video retrieval.
- · Node-level Graph Matching. As shown in Figure 1(b), video 𝑣 1 and item 𝑖 1 are both keyboard-related (high relevance) while video 𝑣 1 and item 𝑖 4 are belonging to different categories (low relevance). So, when jointly modeling heterogeneous interactions for user preference understanding, it is necessary to properly distinguish and match the relevance between videos and items.
- · Preference-level Graph Matching. Intuitively, diverse user preferences extracted from both videos and items are similar to each other. As shown in Figure 1(b), items { 𝑖 1 , 𝑖 2 , 𝑖 3 } indicate user preference on electronic products, which is similar to user preference on video { 𝑣 1 , 𝑣 2 } . But, item { 𝑖 4 } indicates user preference on food, which is different from his video preference. It is necessity to mine the the differences and relevances for user preference understanding. Particularly, how to match multiple user preferences on both videos and items is still an open problem.

In this paper, we study a newly emerging paradigm video-driven e-commerce, and then formulate it as the dual graph to model the co-existing of users, videos, and items as well as interactions among

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

Z

3

X

j

2

T

W

r

g

D

N

S

F

q

k

Y

&gt;

A

B

n

c

V

8

E

J

U

/

9

L

0

m

M

7

Q

o

y

p

I

P

C

z

u

+

O

d

f

H

G

w

v

R

K

5

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

R

F

v

c

C

A

H

3

d

Z

K

o

9

M

L

G

0

z

y

J

&gt;

B

n

V

N

S

8

E

U

r

q

/

P

g

D

w

m

7

I

Q

j

k

X

W

Y

u

+

O

2

f

T

5

p

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

p

T

M

A

q

u

L

m

Y

I

5

B

n

g

0

c

2

r

Q

Z

v

&gt;

3

V

N

S

8

E

J

U

/

9

K

F

o

+

C

D

j

w

y

O

W

z

P

f

H

G

d

7

k

R

X

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

I

A

0

3

N

v

+

7

q

y

D

/

Z

U

B

w

V

W

p

f

&gt;

n

c

S

8

E

J

r

9

L

m

M

F

Q

o

2

k

P

C

j

z

X

G

H

u

T

K

R

g

5

O

d

Y

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

V

f

A

U

v

T

C

S

O

Q

j

3

Y

H

0

&gt;

B

c

N

8

E

J

r

q

/

9

L

K

F

2

p

o

+

n

R

w

k

z

X

5

y

d

g

m

7

P

M

W

Z

I

D

u

G

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

I

V

/

Z

p

d

L

w

c

X

J

v

O

C

r

A

D

o

&gt;

B

3

N

S

8

E

W

K

k

U

9

j

0

G

Y

2

M

y

7

T

Q

5

+

z

u

m

H

q

F

g

n

R

P

f

them. After that, we reduce the user preference understanding in the dual graph to a graph matching problem. To solve it, we propose a novel G raph M atching N etwork (GMN), which mainly consists of node- and preference-level graph matchings, to improve user preference understanding.

The contributions of this work are summarized as follows:

- · To our knowledge, this is the first time that leveraging the dual graph to model the newly emerging video-driven e-commerce, and innovatively reduce the user preference understanding problem to a graph matching problem.
- · To solve this, we propose a novel Graph Matching Network, called GMN, which mainly consists of node- and preference-level graph matching. Specifically, node-level graph matching aims to mine the potential relevance between videos and items in the dual graph. Furtherly, preference-level graph matching further captures the relevance of user preferences extracted from both videos and items.
- · Extensive experimental results on both offline and online data demonstrate the superiority of the proposed GMN. Currently, it has been deployed on one of the largest video-driven e-commerce, affecting hundreds of millions of users every day.

## 2 RELATED WORK

Recommendation System (RS), which mainly focuses on user preference understanding and recommends diverse types of candidates (e.g., items and videos) to them, has accompanied diverse paradigms, such as item recommendation [5, 6, 16], video recommendation [8, 13, 15], and business-driven recommendation [9, 10]. Real-world RS usually consists of two stages: retrieval [2, 14, 18] and ranking [1, 8]. YoutubeDNN [2] retrieves videos for online video services, while MIND [14] retrieves items for e-commerce. Unlike them, we study a newly emerging video-driven e-commerce, which models the co-existing of items and videos.

Cross-domain Recommendation (CDR) attempts to learn useful knowledge from the source domain to help the target domain. Hu et al. [7] propose CoNet to perform dual transfer at the unit level. [4, 8, 18, 21] unify both source and target domains as graphstructured data and perform CDR via graph learning. Significantly different from the above works, we we first model video-driven e-commerce as a dual graph and reduce it to a graph matching problem.

Graph Neural Networks (GNNs) generalize deep learning to graph-structured data, where graph convolution [12] aims to aggregate neighbors information and update node embedding, while graph pooling [11, 19] aims to aggregate all node to update graph embedding. Recently, many works [1, 8, 18] apply GNNs to recommendation scenarios. SURGE [1] reduces user behaviors into graphs and then extracts users' core interests via cluster-aware graph pooling. Furthermore, several works [8, 18, 20] generalize GNN to multiple interactions (or domains). MGFN [20] proposes a multi-graph learning for cross domain video recommendation. Different from the above works, we first propose a novel bi-level graph matching network to align user behaviors and preferences on both videos and items for retrieval.

## 3 PRELIMINARIES

Definition 3.1. Dual Graph . The dual graph, termed as G = (G 𝑈 -𝑉 , G 𝑈 -𝐼 ) , describes the co-existing of user behaviors on both videos and items in video-driven e-commerce. Here N = N 𝑈 ∪ N 𝑉 ∪ N 𝐼 is the union set of 𝑈𝑠𝑒𝑟 , 𝑉𝑖𝑑𝑒𝑜 , and 𝐼𝑡𝑒𝑚 , respectively. Also, E = E 𝑈 -𝑉 ∪E 𝑈 -𝐼 is the edge set, where E 𝑈 -𝑉 = ⟨N 𝑈 , N ⟩ 𝑉 denotes 𝑈𝑠𝑒𝑟 𝑉𝑖𝑑𝑒𝑜 -interaction and E 𝑈 -𝐼 = ⟨N 𝑈 , N ⟩ 𝐼 denotes 𝑈𝑠𝑒𝑟 𝐼𝑡𝑒𝑚 -interaction.

Example. Figure 1(b) gives an illustrative example of the dual graph in video-driven e-commerce. Given a user 𝑢 and the dual graph G , we can obtain his neighbor sets, including N 𝑈 -𝑉 𝑢 = { 𝑣 | ⟨ 𝑢, 𝑣 ⟩ ∈ E 𝑈 -𝑉 } from G 𝑈 -𝑉 and N 𝑈 -𝐼 𝑢 = { |⟨ 𝑖 𝑢, 𝑖 ⟩ ∈ E 𝑈 -𝐼 } from G 𝑈 -𝐼 . In the dual graph, user 𝑢 1's neighbor sets are N 𝑈 -𝐼 𝑢 1 = { 𝑖 1 , 𝑖 2 , 𝑖 3 , 𝑖 4 } and N 𝑈 -𝑉 𝑢 1 = { 𝑣 1 , 𝑣 2 } , respectively. Furthermore, we also extract user-centric sub-graphs for user 𝑢 from the dual graph, termed as G 𝑢 = (G 𝑈 -𝑉 𝑢 , G 𝑈 -𝐼 𝑢 ) . In detail, G 𝑈 -𝑉 𝑢 contains multihops neighbors of user 𝑢 and himself (i.e., V 𝑈 𝑉 𝑢 = N 𝑈 -𝑉 𝑢 ∪ 𝑢 ), as well as induced edges E 𝑈 -𝑉 𝑢 . Note that, dual graphs can be widely used in many other related fields, such as the co-existing of user-music and user-movie, or even the co-existing of useritem(old/warm domain) and user-item(new/cold domain).

Finally, we formulate the video retrieval problem in video-driven e-commerce as follows:

$$\arg \max _ { v \in \mathcal { N } ^ { V } } P r ( v | u ; \mathcal { G } ), \quad \quad ( 1 ) \quad \text{H}$$

which aims to retrieve candidate videos 𝑣 from the whole video set N 𝑉 for user 𝑢 based on the dual graph G .

## 4 THE PROPOSED MODEL

In this section, we present a novel G raph M atching N etwork, which aims the to match the users' behaviors as well as preferences via both node- and preference-level graph matching. The overall framework of GMN is shown in Figure 2.

## 4.1 Embedding Initialization

In this section, we first initialize the node embeddings of users, videos, and items via feature embeddings, and then update them via GNNs. Taking embedding initialization of video 𝑣 as an example, we have:

$$x _ { v } = \left \| _ { f } x _ { v } ^ { f },$$

where | | denotes the vector concatenation, x 𝑣 and x 𝑓 𝑣 denote the initial embedding of video 𝑣 and the 𝑓 -th feature embedding of video 𝑣 , respectively. After that, we further utilize two interaction-specific GNNs (i.e., 𝐺𝑁𝑁 𝑈 -𝑉 and 𝐺𝑁𝑁 𝑈 -𝐼 ) to update corresponding embeddings. Given video 𝑣 and G 𝑈 -𝑉 , 𝐺𝑁𝑁 𝑈 -𝑉 is able to update the video x 𝑈 -𝑉 𝑣 embedding via aggregating its neighbors N 𝑈 -𝑉 𝑣 , as follows:

$$x _ { v } ^ { U - V } = G N N ^ { U - V } ( x _ { u } | u \in \mathcal { N } _ { v } ^ { U - V } ). \quad \quad ( 3 ) \quad \underset { \text{un} } { \text{me} }$$

Note that, we focus on bi-level graph matching and simply instantiate 𝐺𝑁𝑁 𝑈 -𝑉 as the 𝑀𝑒𝑎𝑛𝑃𝑜𝑜𝑙𝑖𝑛𝑔 [9, 10]. Similarly, the embedding of item 𝑖 via 𝐺𝑁𝑁 𝑈 -𝐼 is x 𝑈 -𝐼 𝑖 . For user 𝑢 , we can also get his embeddings on the dual graph x 𝑈 -𝑉 𝑢 and x 𝑈 -𝐼 𝑢 .

Until now, a method way for video retrieval is to fuse user preferences on videos and items 𝑖.𝑒., x 𝑈 -𝑉 𝑢 | | x 𝑈 -𝐼 𝑢 , and then retrieve top videos based on the similarity of their embeddings, suffering from the following weaknesses: (1) In video-driven e-commerce, video production actually revolves around items and aims to promote the item purchase. Although videos and items are different types of nodes, there exists potential relevance between them. (2) It only models each user as a single node embedding while fails to explicitly capture the graph structure surrounding users, which also provides valuable information for understanding user preferences. So, it is necessary to encode the user-centric sub-graph as a whole for video retrieval.

## 4.2 Node-level Graph Matching

In this section, we propose node-level graph matching to mine the relevance between videos and items in the dual graph, and then enhance their connections via aggregating cross-graph neighbors based on the matching scores.

To handle large-scale video-driven e-commerce, we first extract user-centric sub-graphs (i.e., G 𝑈 -𝑉 𝑢 and G 𝑈 -𝐼 𝑢 ) for user 𝑢 , and then actually perform the node-level graph matching 𝐺𝑀 𝑁𝐿 on them, shown as follows:

$$\mathbf R ^ { u } = G M _ { N L } ( \mathcal { G } _ { u } ^ { U - V }, \mathcal { G } _ { u } ^ { U - I } ).$$

Here R 𝑢 ∈ R | V 𝑈 -𝑉 𝑢 | × | V 𝑈 -𝐼 𝑢 | denotes the personalized relevance matrix of user 𝑢 in node-level. Given a user 𝑢 , the personalized relevance score 𝑟 𝑢 𝑣,𝑖 between video 𝑣 ∈ G 𝑈 -𝑉 𝑢 and item 𝑖 ∈ G 𝑈 -𝐼 𝑢 is shown as follows:

$$r _ { v, i } ^ { u } = ( { \mathbf x } _ { v } ^ { U - V } ) ^ { T } \cdot { \mathbf M } \cdot { \mathbf x } _ { i } ^ { U - I }.$$

Here (·) 𝑇 denotes the transposition operator. M is a learnable metric matrix, harmonizing the embeddings of heterogeneous nodes (video v.s. item). Obviously, the personalized relevance score 𝑟 𝑢 𝑣,𝑖 is dynamically changed with regard to users, videos, and items.

After obtaining the personalized relevance scores { 𝑟 𝑢 𝑣,𝑖 } , we normalize them via the softmax function to get the personalized matching scores 𝑠 𝑢 𝑣 ← 𝑖 and 𝑠 𝑢 𝑣 → 𝑖 , shown as follows:

$$s _ { v \leftarrow i } ^ { u } = s o f t m a x _ { i } ( r _ { v, i } ^ { u } ) = \frac { \exp ( r _ { v, i } ^ { u } ) } { \sum _ { i ^ { \prime } \in \mathcal { V } _ { u } ^ { U - 1 } } \exp ( r _ { v, i ^ { \prime } } ^ { u } ) }, \quad ( 6 )$$

$$s _ { v \rightarrow i } ^ { u } = s o f t m a x _ { v } ( r _ { v, i } ^ { u } ) = \frac { \exp ( r _ { v, i } ^ { u } ) } { \sum _ { v ^ { \prime } \in \mathcal { V } _ { u } ^ { U - V } \, \exp ( r _ { v ^ { \prime }, i } ^ { u } ) } }. \quad ( 7 )$$

Note that the above matching scores are asymmetric since they are normalized on different node sets (i.e., V 𝑈 𝐼 𝑢 and V 𝑈 𝑉 𝑢 ). Given a user 𝑢 , the personalized matching score 𝑠 𝑢 𝑣 ← 𝑖 measures the matching level from item 𝑖 to video 𝑣 . Intuitively, aggregating relevant items embeddings into video embeddings is able to the alleviate the heterogeneity and sparsity problem, improving user preference understanding and the effectiveness of video retrieval.

Taking personalized matching scores (e.g., { 𝑠 𝑢 𝑣 ← } 𝑖 ) as coefficients, we can properly summarize all information ˝ 𝑖 ∈V 𝑈 -𝐼 𝑢 𝑟 𝑢 𝑣 ← · 𝑖 x 𝑈 -𝐼 𝑖 which needs to propagate from relevant items 𝑖 ∈ G 𝑈 -𝐼 𝑢 to video 𝑣 , and then utilize it to enhance the video embedding. The final video

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

D

I

k

B

W

q

j

E

V

Q

0

M

N

8

F

P

9

&gt;

A

3

c

S

J

U

r

/

L

G

R

K

g

d

2

C

T

z

X

u

H

v

n

+

m

7

O

y

p

Y

5

o

Z

f

w

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

D

I

k

B

W

q

j

E

V

Q

0

M

N

8

F

P

9

&gt;

A

3

c

S

J

U

r

/

L

G

R

K

g

d

2

C

T

z

X

u

H

v

n

+

m

7

O

y

p

Y

5

o

Z

f

w

Figure 2: The overall framework of the proposed GMN. (a) Dual graph construction for video-driven e-commerce. (b) Initialization of embedding through feature embedding and graph neural network. (c) Node-level graph matching. (d) Preference-level graph matching. (e) Prediction and serving.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-3ceb5e1d-3bf2-4d4b-a939-a98da17c091f.jpg)

embedding h 𝑈 -𝑉 𝑣 of video 𝑣 is shown as follows:

$$\mathbf h _ { v } ^ { U - V } = x _ { v } ^ { U - V } \Big { | } \Big { | } \sum _ { i \in \mathcal { V } _ { u } ^ { U - I } } r _ { v \leftarrow i } ^ { u } \cdot x _ { i } ^ { U - I }. \quad \quad ( 8 ) \quad \frac { \kappa _ { 1 } } { \ e r e } \\ \ e m$$

where z 𝑈 -𝑉 𝑢 𝑘 1 is the embedding of the 𝑘 1-th user preference. If we set 𝑘 1 &gt; 1, then 𝐺𝑃𝑁 𝑈 -𝑉 actually extracts multiple types of user preferences. Therefore, we simply instantiate 𝐺𝑃𝑁 𝑈 -𝑉 as the MeanPooling [9] Similarly, we use 𝐺𝑃𝑁 𝑈 -𝐼 to extract 𝑘 2 preference embeddings { z 𝑈 -𝐼 𝑢 1 , · · · , z 𝑈 -𝐼 𝑢 𝑘 2 | 𝑢 𝑘 2 ∈ Z 𝑈 -𝐼 𝑢 } for user 𝑢 from G 𝑈 -𝐼 .

Also, we conduct information propagation from videos to items, and learn the final embedding h 𝑈 -𝐼 𝑖 of item 𝑖 . Although node-level graph matching is able to learn the potential connections between videos and items and improves their embeddings via bi-directional information propagation, it only focuses on node-level modeling and largely ignores the user preferences inferred from user interactions.

## 4.3 Preference-level Graph Matching

In this section, we introduce a novel method for preference-level graph matching. This method mines the relevance of user preferences for videos and items. Subsequently, this relevance is utilized in cross-graph propagation to refine preference embeddings.

4.3.1 Extracting User Preferences via Dual Graph Pooling. Specifically, we propose a novel dual graph pooling method (i.e., 𝐺𝑃𝑁 𝑈 -𝑉 and 𝐺𝑃𝑁 𝑈 -𝐼 ) to cluster user-centric sub-graphs (i.e., G 𝑈 -𝑉 𝑢 and G 𝑈 -𝐼 𝑢 ) as preference graphs, where each node indicates a cluster of similar videos or items and corresponding user preferences.

Given a user 𝑢 and G 𝑈 -𝑉 𝑢 , a graph pooling network 𝐺𝑃𝑁 𝑈 -𝑉 is able to cluster all video embeddings { h 𝑈 -𝑉 𝑣 | 𝑣 ∈ V 𝑈 -𝑉 𝑢 } into 𝑘 1 preferences, and constructs the condensed preference graph Z 𝑈 𝑉 𝑢 :

$$\mathcal { Z } _ { u } ^ { U - V } = G P N ^ { U - V } ( \mathcal { G } _ { u } ^ { U - V } ),$$

$$\{ z _ { u ^ { 1 } } ^ { U - V }, \cdots, z _ { u ^ { k _ { 1 } } } ^ { U - V } \} = G P N ^ { U - V } ( { \mathbf h } _ { v } ^ { U - V } ), \quad \ \ ( 1 0 ) \quad \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \ \$$

4.3.2 Improving Preference Embedding via Preference-level Graph Matching. Intuitively, user preferences on both videos and items also have potential relevance. So we further propose the preferencelevel graph matching 𝐺𝑀 𝑃𝐿 , which learns the preference-level relevance matrix P 𝑢 ∈ R 𝑘 1 × 𝑘 2 between preference graphs (i.e., Z 𝑈 𝑉 𝑢 and Z 𝑈 𝐼 𝑢 ), shown as follows:

$$\mathbf P ^ { u } = G M _ { P L } ( \mathcal { Z } _ { u } ^ { U - V }, \mathcal { Z } _ { u } ^ { U - I } ), \text{ \quad \ \ } ( 1 1 )$$

where each element 𝑝 𝑢 𝑘 ,𝑘 1 2 indicates the relevance between the 𝑘 1-th video preference and the 𝑘 2-th item preference of user 𝑢 , as follows:

$$p _ { k _ { 1 }, k _ { 2 } } ^ { u } = ( z _ { u ^ { k _ { 1 } } } ^ { U - V } ) ^ { T } \cdot z _ { u ^ { k _ { 2 } } } ^ { U - I }. \quad \quad ( 1 2 )$$

Then, we also normalize 𝑝 𝑢 𝑘 ,𝑘 1 2 on Z 𝑈 𝑉 𝑢 and Z 𝑈 𝐼 𝑢 via softmax, and get corresponding matching scores 𝑠 𝑢 𝑘 1 ← 𝑘 2 and 𝑠 𝑢 𝑘 1 → 𝑘 2 . Then, the embeddings of preference nodes can be enhanced via bi-directional propagation, as follows:

$$\mathrm e _ { u ^ { k _ { 1 } } } ^ { U - V } = z _ { u ^ { k _ { 1 } } } ^ { U - V } \Big { | } \Big { | } \sum _ { u ^ { k _ { 2 } } \in \mathcal { Z } _ { u } ^ { U - I } } s _ { k _ { 1 } \leftarrow k _ { 2 } } ^ { u } \cdot z _ { u ^ { k _ { 2 } } } ^ { U - I }, \quad \quad ( 1 3 )$$

$$\mathrm e _ { u ^ { k _ { 2 } } } ^ { U - I } = z _ { u ^ { k _ { 2 } } } ^ { U - I } \Big \| \sum _ { u ^ { k _ { 1 } } \in \mathcal { Z } _ { u } ^ { U - V } } s _ { k _ { 1 } \to k _ { 2 } } ^ { u } \cdot z _ { u ^ { k _ { 1 } } } ^ { U - V }. \quad \quad ( 1 4 )$$

Interactively performing graph pooling and graph matching on preference graphs for 𝐿 times, we can progressively compress the original graph into a single node (i.e., 𝑘 1 = 𝑘 2 = 1), termed as e 𝑈 -𝐼 𝑢 and e 𝑈 -𝐼 𝑢 , representing the overall user preferences.

Table 1: The statistics of the datasets.

| Dataset   | Split   | A-B              | #A         | #B         | #A-B          | #Sample(Pos)   | #Sample(All)   |
|-----------|---------|------------------|------------|------------|---------------|----------------|----------------|
| 7-days    | Train   | User-Video       | 6,980,981  | 899,550    | 129,161,919   | 14,251,161     | 71,255,805     |
| 7-days    |         | User-Item        | 6,980,981  | 11,677,996 | 367,232,916   | 14,251,161     | 71,255,805     |
| 7-days    | Val     | User-Video       | 5,765,456  | 715,610    | 36,464,192    | 11,346,739     | 56,733,695     |
| 7-days    | Val     | User-Item        | 5,765,456  | 5,086,461  | 100,117,118   | 11,346,739     | 56,733,695     |
| 30-days   | Train   | User-Video       | 18,606,436 | 1,510,227  | 512,317,947   | 47,346,557     | 236,732,785    |
| 30-days   | Train   | User-Item        | 18,606,436 | 28,000,470 | 1,478,089,983 | 47,346,557     | 236,732,785    |
| 30-days   | Val     | User-Video       | 5,765,456  | 715,610    | 36,464,192    | 11,346,739     | 56,733,695     |
| 30-days   | Val     | User-Item        | 5,765,456  | 5,086,461  | 100,117,118   | 11,346,739     | 56,733,695     |
| ML-1M     | Train   | User-Movie(Cold) | 5,884      | 729        | 123,649       | 39,912         | 154,560        |
| ML-1M     | Train   | User-Movie(Warm) | 6,038      | 3,671      | 630,768       | 39,912         | 154,560        |
| ML-1M     | Val     | User-Movie(Cold) | 5,884      | 729        | 30,912        | 7,728          | 38,640         |
| ML-1M     | Val     | User-Movie(Warm) | 6,038      | 3,671      | 157,692       | 7,728          | 38,640         |

## 4.4 Prediction and Optimization

To comprehensively understand user preferences, we fuse user preferences on both videos and items, and get the final user embedding z 𝑢 of user 𝑢 , as follows:

sub-graphs (i.e., G 𝑈 -𝑉 𝑢 and G 𝑈 -𝐼 𝑢 ) , which significantly reduce the time complexity to O(|G 𝑈 -𝑉 𝑢 | · |G 𝑈 -𝐼 𝑢 |) . Similar to the nodelevel, the time complexity of preference-level graph matching is O(|Z 𝑈 -𝑉 𝑢 | · |Z 𝑈 -𝐼 𝑢 |) .

$$z _ { u } = M L P ( \mathbf e _ { u } ^ { U - V } | | \mathbf e _ { u } ^ { U - I } | | \mathbf x _ { u } ^ { U - V } | | \mathbf x _ { u } ^ { U - I } ). \quad \text{ (15)} \quad \text{ with}$$

Since the feature of video si much simpler and more stable than users, we only perform GMN for user modeling, and the final embedding z 𝑣 of video 𝑣 is actually x 𝑈 -𝑉 𝑣 . Similar to previous works[1, 8, 17], we do not use a more sophisticated fusion network (e.g., attention-based fusion), so the effectiveness of bi-level graph matching can be clearly verified.

The estimated preference ˆ 𝑦 𝑢,𝑣 of user 𝑢 towards the target video 𝑣 is the inner product of their embeddings:

$$\hat { y } _ { u, v } = ( z _ { u } ) ^ { T } \cdot z _ { v }. \quad \quad \ ( 1 6 ) \quad \ \Gamma$$

The overall loss function is as follows:

$$\mathcal { L } = \sum _ { ( u, v, v _ { n e g } ) \in \mathcal { D } } - \ln \sigma ( \hat { y } _ { u, v } - \hat { y } _ { u, v _ { n e g } } ) + \lambda \cdot | | \Theta | | _ { 2 } ^ { 2 }, \quad ( 1 7 ) \quad \text{The} \\ \text{com} \\ \text{data}$$

where Θ denotes all trainable model parameters, and 𝜆 controls the L2 regularization strength to prevent overfitting. The whole model can be optimized via back-propagation.

## 4.5 Model Analysis

Here we give the analysis of the proposed GMN as follows:

- · Considering the characteristics of video-driven e-commerce, we first represent it as the dual graph, and then reduce user preference understanding to a bi-level graph matching problem. So, the proposed GMN focused on matching relevant nodes (e.g., videos and items) and preferences properly in a bi-level manner, rather than designing better GNN architectures to learn nodes and preferences embeddings. Similar to previous works[3, 9, 10], we adopt basic GNNs as backbones, so the effectiveness of bi-level graph matching could be clearly verified.
- · We analyze the time complexity of GMN in both the node- and preference-level graph matching. In the node-level graph matching, if we directly match all nodes between G 𝑈 -𝑉 and G 𝑈 -𝐼 , the computational cost is O(|N 𝑉 | · |N |) 𝐼 , which is unacceptable for real-world scenarios. Fortunately, we actually match user-centric
- · Then, we further analyze the space complexity of our GMN, which mainly depends on the learnable parameters in embedding matrixes, rather than deep neural networks. Assuming we have total N nodes and F features in the dual graphs, the space complexity of GMN with feature embedding is O( 𝐹 · 𝑑 ) , which is significantly less than ID embedding O( 𝑁 · 𝑑 ) . In summary, the proposed GMN is able to efficiently handle large-scale e-commerce.

## 5 OFFLINE EVALUATIONS

## 5.1 Datasets.

Although video-driven e-commerce has grown rapidly on many platforms, related data is protected by privacy and security policies. Therefore, we sample user logs from a real-world video-driven ecommerce platform, and then extract two large-scale dual graph datasets from different time periods ( 7-days , and 30-days ) for verification. We also use a public dataset MovieLens-1M released by GIFT[8] to mimic video-driven e-commerce, which takes usermovie (warm) as user-item interaction and user-movie (cold) as user-video interaction, respectively. The details of the datasets are shown in Table 1.

## 5.2 Baselines.

To validate the effectiveness of GMN, we first select single interaction based methods (i.e., YoutubeDNN[2], MIND[14], and SURGE[1]) as well as multiple interactions based methods (i.e., GIFT[8], MGFN[20], and CCDR[18]). Since MIND and SURGE cannot be directly applied to the dual graph, we also provide corresponding dual versions (i.e., MIND+ and SURGE+) for better performance. The baselines are shown below:

- · YoutubeDNN [2]: It is a classical model for large-scale video retrieval, utilizing two-tower architecture to learn the embeddings of users and videos based on their features.
- · MIND/MIND+ [14]: MIND is a classical retrieval model, which utilizes a dynamic routing mechanism to extract users'

Table 2: Qantitative results (%) of different methods. Best results are indicated in bold. Underlined values (e.g., 94 57 . ) indicate that the improvement of GMN is significant based on a paired 𝑡 -test at the significance level of 0.01 .

| Type   | Model    | 7-days   | 7-days   | 7-days   | 7-days   | 30-days   | 30-days   | 30-days   | 30-days   | MovieLens-1M   | MovieLens-1M   | MovieLens-1M   | MovieLens-1M   |
|--------|----------|----------|----------|----------|----------|-----------|-----------|-----------|-----------|----------------|----------------|----------------|----------------|
| Type   | Model    | AUC      | Prec     | Recall   | Loss     | AUC       | Prec      | Recall    | Loss      | AUC            | Prec           | Recall         | Loss           |
| Single | DNN      | 93.03    | 81.24    | 66.78    | 24.92    | 93.16     | 80.72     | 67.15     | 24.83     | 77.53          | 73.53          | 24.72          | 41.24          |
| Single | MIND     | 93.20    | 81.44    | 67.36    | 24.62    | 93.56     | 81.22     | 68.53     | 24.11     | 77.89          | 73.63          | 24.99          | 41.04          |
| Single | SURGE    | 93.30    | 81.5     | 67.71    | 24.45    | 93.65     | 81.34     | 68.83     | 23.95     | 77.93          | 73.88          | 25.12          | 40.99          |
| Multi  | MIND+    | 93.51    | 81.79    | 68.39    | 24.09    | 93.99     | 81.78     | 70.02     | 23.32     | 78.18          | 74.32          | 26.57          | 40.82          |
| Multi  | SURGE+   | 93.61    | 81.92    | 68.74    | 23.9     | 94.02     | 81.83     | 70.13     | 23.26     | 78.19          | 74.39          | 26.97          | 40.75          |
| Multi  | GIFT     | 93.82    | 82.17    | 69.46    | 23.52    | 94.13     | 81.98     | 70.49     | 23.07     | 78.21          | 74.41          | 27.67          | 40.24          |
| Multi  | MGFN     | 94.05    | 82.47    | 70.26    | 23.08    | 94.44     | 82.43     | 71.59     | 22.46     | 78.29          | 74.45          | 28.10          | 40.01          |
| Multi  | CCDR     | 94.12    | 82.56    | 70.48    | 22.96    | 94.66     | 82.80     | 72.28     | 22.01     | 78.35          | 74.88          | 29.51          | 39.87          |
| Multi  | GMN      | 94.57    | 83.21    | 72.03    | 22.07    | 95.51     | 84.27     | 74.93     | 20.19     | 78.65          | 75.12          | 30.23          | 39.39          |
| /      | Impro(%) | 1.02     | 0.78     | 2.19     | 3.87     | 1.90      | 1.78      | 3.66      | 8.26      | 1.06           | 0.32           | 2.44           | 1.21           |

diverse interests from historical behaviors. Since MIND cannot directly apply to the dual graph, we extend MIND as MIND+ to learn diverse user interests from both user-video and user-item interactions, and then concatenate them as the final user interests for video retrieval.

Table 3: The ablation studies on graph- and model-level.

- · SURGE/SURGE+ [1]: SURGE is a basic graph-based model that takes graph convolution and graph pooling to extract and fuse users' interest from user interaction for recommendation. We also extend SURGE as SURGE+ to handle the dual graph. The experimental setting is the same as MIND/MIND+.
- · GIFT [8]: It is a graph-based model that utilizes diverse types of relations 𝑟 to guide the feature propagation between coldand warm-domain for video recommendation. Here we take user-video interaction as cold-domain and user-item interaction as warm-domain for experiment.
- · MGFN [20]: It is a multi-graph based video recommendation model which encapsulates interaction patterns across scenarios via multi-graph fusion network.
- · CCDR [18]: It is a contrastive cross-domain model for retrieval, which simultaneously utilizes both intra- and interdomain contrastive learning. Here we take user-video and user-item as two domains.
- · GMN : It is our complete model, which performs both nodeand preference-level graph matching on the dual graph for video retrieval.

## 5.3 Implementation.

For all models, we random initialize parameters with Xavier initializer and select Adam as the optimizer. For a fair comparison, we use the following hyper-parameters for all models: the dimension of node embedding is 128, the learning rate is 0.0015, the L2 regularizer is 0.01, and the dropout rate is 0.75. For MIND and SURGE, we use the multiple preferences version and set the maximum number of preferences to 5. For YoutubeDNN, we use 3 layer DNN (1024-512256) for prediction. For offline evaluation, we select AUC, Precision, Recall, and Loss as evaluation metrics. We implement all models with TensorFlow 1.15 and run them on Nvidia A100 Cluster. The code of GMN and the anoymous version of the industrial dataset will be released after acceptance.

| Ablation    | 7-days   | 7-days   | 30-days   | 30-days   |
|-------------|----------|----------|-----------|-----------|
| Ablation    | AUC      | Prec     | AUC       | Prec      |
| 𝐺𝑀𝑁 \ 𝑈 - 𝑉 | 93.09    | 81.29    | 93.2      | 81.55     |
| 𝐺𝑀𝑁 \ 𝑈 - 𝐼 | 93.12    | 81.31    | 93.33     | 82.03     |
| 𝐺𝑀𝑁 \ 𝑁𝐿    | 93.96    | 82.36    | 94.13     | 82.58     |
| 𝐺𝑀𝑁 \ 𝑃𝐿    | 94.16    | 82.62    | 94.33     | 82.85     |
| GMN         | 94.57    | 83.21    | 95.51     | 84.27     |

## 5.4 Performance Comparison

The comparison results are shown in Table 2, where we have the following observations:

- · The proposed GMN consistently performs better than all baselines with significant gaps. Compared to the best performance of baselines, the improvements of GMN on AUC metric is up to 1.2%-1.9% on large-scale video-driven e-commerce, which indicates the effectiveness of both node- and preference-level modeling in the proposed GMN for video retrieval.
- · Multiple interactions based methods (i.e., MIND+ and CCDR) outperform single graph methods (i.e., MIND and SURGE). It makes sense because both user-video and user-item interactions are able to provide valuable information for understanding user preferences. By capturing the correlation between two types of interaction, GIFT, MGFN, CCDR, and GMN always show their superiority over concatenate based models (i.e., MIND+ and SURGE+).
- · GNN-based models, including SURGE, GIFT, MGFN, CCDR, and GMN, perform better than traditional DNN-based models (i.e., MIND and YoutubeDNN), indicating the effectiveness of graph structure modeling in the recommendation.

## 5.5 Ablation Study

In this section, we conduct both model-level and graph-level ablation studies for further verification, shown in Table 3.

- · Model-level. We first conduct a model-level ablation study to show how the delicate designs in GMN affect performance. As shown in Table 3, we test two variants of GMN (GMN \ 𝑁𝐿 and GMN \ 𝑃𝐿 ), which remove node- and preference-level graph matching, respectively. Obviously, GMN performs better than both

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

q

Q

o

P

F

+

Y

f

g

E

9

0

w

H

M

B

L

&gt;

A

7

c

V

N

S

8

J

3

U

r

/

T

p

z

D

d

C

I

2

X

v

5

K

R

O

j

u

W

k

G

m

Z

y

n

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

C

L

R

7

f

K

P

J

8

3

2

0

D

Q

m

o

Z

S

&gt;

A

B

n

c

V

N

E

U

r

q

/

9

F

W

y

p

I

j

k

z

X

M

Y

H

+

G

O

T

d

g

v

5

w

u

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

L

r

I

X

u

V

8

J

C

p

N

g

P

Y

K

M

5

n

j

A

&gt;

B

3

c

D

S

F

U

d

R

O

W

9

o

Q

y

T

v

+

G

/

E

k

2

7

Z

w

f

H

m

q

z

0

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

C

A

r

o

G

E

9

7

T

Y

S

I

p

V

+

j

K

R

B

y

g

&gt;

H

c

N

8

J

3

U

q

/

L

0

m

k

v

F

w

d

u

W

z

Q

P

D

5

O

M

Z

2

n

f

X

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

P

V

2

q

u

v

I

0

Q

E

Y

g

j

z

R

o

F

&gt;

A

B

/

n

c

D

L

S

N

3

W

r

K

7

Z

w

T

y

m

J

9

k

X

d

p

G

+

f

O

C

5

H

U

8

M

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

C

L

R

7

f

K

P

J

8

3

2

0

D

Q

m

o

Z

S

&gt;

A

B

n

c

V

N

E

U

r

q

/

9

F

W

y

p

I

j

k

z

X

M

Y

H

+

G

O

T

d

g

v

5

w

u

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-79ce6b2e-4118-4eae-99cf-875d14b628d7.jpg)

(a) Node-level Relevance Matrix

(b) Preference-level Relevance Matrix

Figure 3: Heatmap on both node- and preference-level relevance matrix. Darker color means higher relevance.

GMN \ 𝑃𝐿 and GMN \ 𝑁𝐿 ), which clearly verifies the superiority of node- and graph-level matching. Note that the degradation of GMN \ 𝑁𝐿 is more significant than GMN \ 𝑃𝐿 , implying that the nodelevel graph matching contributes more significantly. The reason is that node-level graph matching is able to capture the potential relevance between videos and items and integrate them seamlessly, serving as the basis of preference extraction and preference-level graph matching.

- · Graph-level. We also conduct graph-level ablation study to verify the effectiveness of dual graphs modeling, where GMN \ 𝑈 -𝑉 and GMN \ 𝑈 -𝐼 remove the user-video graph and user-item graph, respectively. Note that since graph-level ablation studies are conducted only on a single graph (user-video or user-item), so they naturally build upon model-level ablation studies. In Figure 3, we find that removing either the user-video graph or the user-item graph fails to comprehensively capture user preference, leading to suboptimal performance. It suggests the necessity of dual graph modeling in video-driven e-commerce.

## 5.6 Case Study

We further present a case study to show the potential interpretability of GMN. Taking a young boy as an example who is interested in the Apple iPhone and the Casio watch, he has interacted with related items and videos. Figure 3 shows the heatmap on both node- and preference-level relevance matrix, where darker color means higher relevance. Since item 𝑖 9 and video 𝑣 8 are both related to iPhone, the node-level relevance score 𝑟 𝑢 𝑣 ,𝑗 8 9 is high. A similar phenomenon can be observed at the preference-level (e.g., 𝑝 𝑢 1 1 , ).

## 5.7 Parameter Study

In this section, we investigate the sensitivity of parameters and report the performance of GMN on the offline 7-days dataset with various parameters in Figure 4.

- · Dimension of Metric Matrix. As shown in Figure 4(a), we test the effect of the dimension of the metric matrix M . Obviously, with the growth of the dimension, the performance of GMN continues to rise. The reason is that, a larger dimension enables the proposed GMN to properly measure the similarity between videos and items.
- · Number of User Preferences. Naturally, most users have diverse preferences, and one preference fails to comprehensively

&lt;

l

a

t

e

x

i

s

h

1

\_

b

6

4

=

"

C

A

r

o

G

E

9

7

T

Y

S

I

p

V

+

j

K

R

B

y

g

&gt;

H

c

N

8

J

3

U

q

/

L

0

m

k

v

F

w

d

u

W

z

Q

P

D

5

O

M

Z

2

n

f

X

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-f506cad3-a1ad-4773-ad7e-9a3e288f5c15.jpg)

(a)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-514e026a-21be-417c-ac96-061759cbcd89.jpg)

Dimension of Metric Matrix.

(b)

Number of User Preferences.

Figure 4: Parameter sensitivity of GMN.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-6247be0a-fbbc-4bcd-a8f5-9fc3a10fa273.jpg)

Figure 5: The online system of the proposed GMN.

describe the characteristics of users. Figure 4(b) shows that more user preferences (i.e., larger 𝑘 1) extracted from preference-level modeling improve the overall performance of GMN. And, GMN achieves the best performance when the number of user preferences is set to 4.

## 6 ONLINE EVALUATIONS

## 6.1 Online A/B Testing

We conduct A/B testing during 0907-0925 (19 days) for online evaluations, shown in Figure 6. Although MIND+ is not the strongest benchmark in offline evaluation, it is the previously deployed model, affecting hundreds of millions of users every day. Therefore, we use MIND+ as the baseline in online A/B testing. Here, we select the widely used CTR 1 to evaluate online performance. The larger CTR means users are willing to click the exposed videos recommended by our system and indicates better performance.

As shown in Figure 6, the proposed GMN consistently shows significant superiority over the previously deployed MIND+ on all days. More specifically, the average CTR of the proposed GMN is 3.74% while MIND+ achieves only 3.49%, resulting in a CTR improvement of up to 7.15%. Following [8], we also use TP99 2 response time to evaluate the efficiency of our system, shown in Figure 7. Full-day observation shows that the response time of the proposed GMN

1 𝐶𝑇𝑅 = Number of clicked videos Number of exposed videos × 100 % ( )

2 TP99 is a minimum time that 99% of queries have been served.

Figure 6: The results of online A/B testing experiments.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-0a47d36c-7a4c-46f7-a11f-ea5e844706d4.jpg)

Figure 7: The response time of online serving.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00346v1-figure-fbb77f24-f01f-414a-bf18-a39ccb677e6c.jpg)

system is only about 1 ms higher than the previously developed MIND+, meeting response time requirements and ensuring user experience. Currently, we have deployed GMN on a well-known video-driven e-commerce platform, affecting hundreds of millions of users every day.

## 6.2 System Architecture and Online Serving.

Here we present how to deploy the proposed GMN system for real-world video-driven e-commerce, shown in Figure 5. For offline training, we collect real-world user clicks as positive samples and random sample several videos as negative samples. Then, we sample user-centric sub-graphs and associate them with training samples. as training data. The trained model will be divided into two parts and developed in different platforms: (1) The user part, which is developed to the model center, will generate user embedding based on real-time user behavior. (2) The video part, which is developed to the retrieval center, will retrieve candidate videos based on user embedding.

## 7 CONCLUSION

The thriving of e-commerce is accompanied by a newly emerging paradigm, video-driven e-commerce, which utilizes attractive videos to improve user experience and stimulate consumption. In this paper, we propose the dual graph to represent video-driven e-commerce and innovatively reduce the user preference understanding problem to a graph matching problem. To solve it, we further propose a novel Graph Matching Network (GMN), which mainly consists of node- and preference-level graph matching. By properly matching the heterogeneous interactions and preferences, the proposed GMN achieves significant improvements over the state-of-the-art models in both offline and online evaluation (e.g., AUC+1.9% and CTR+7.15%). Currently, the proposed GMN has been developed in a well-known video-driven e-commerce platform, affecting hundreds of millions of users every day.

Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce

## REFERENCES

- [1] Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang Song, Depeng Jin, and Yong Li. 2021. Sequential recommendation with graph neural networks. In SIGIR . 378-387.
- [2] Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In RecSys . 191-198.
- [3] Yu Gong, Yu Zhu, Lu Duan, Qingwen Liu, Ziyu Guan, Fei Sun, Wenwu Ou, and Kenny Q Zhu. 2019. Exact-K Recommendation via Maximal Clique Optimization. In KDD .
- [4] Lei Guo, Li Tang, Tong Chen, Lei Zhu, Quoc Viet Hung Nguyen, and Hongzhi Yin. 2021. DA-GCN: A domain-aware attentive graph convolution network for shared-account cross-domain sequential recommendation. IJCAI .
- [5] Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In SIGIR .
- [6] Binbin Hu, Chuan Shi, Wayne Xin Zhao, and Philip S Yu. 2018. Leveraging Metapath based Context for Top-N Recommendation with A Neural Co-Attention Model. In KDD . 1531-1540.
- [7] Guangneng Hu, Yu Zhang, and Qiang Yang. 2018. Conet: Collaborative cross networks for cross-domain recommendation. In CIKM . 667-676.
- [8] Sihao Hu, Yi Cao, Yu Gong, Zhao Li, Yazheng Yang, Qingwen Liu, Wengwu Ou, and Shouling Ji. 2022. GIFT: Graph-guIded Feature Transfer for Cold-Start Video Click-Through Rate Prediction. In CIKM .
- [9] Houye Ji, Junxiong Zhu, Chuan Shi, Xiao Wang, Bai Wang, Chaoyu Zhang, Zixuan Zhu, Feng Zhang, and Yanghua Li. 2021. Large-scale Comb-K Recommendation. In WWW .
- [10] Houye Ji, Junxiong Zhu, Xiao Wang, Chuan Shi, Bai Wang, Xiaoye Tan, Yanghua Li, and Shaojian He. 2021. Who You Would Like to Share With? A Study of Share Recommendation in Social E-commerce. In AAAI .
- [11] Amir Hosein Khasahmadi, Kaveh Hassani, Parsa Moradi, Leo Lee, and Quaid Morris. 2020. Memory-Based Graph Networks. ICLR .
- [12] Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR .
- [13] Beibei Li, Beihong Jin, Jiageng Song, Yisong Yu, Yiyuan Zheng, and Wei Zhuo. 2022. Improving Micro-video Recommendation via Contrastive Multiple Interests. In SIGIR .
- [14] Chao Li, Zhiyuan Liu, Mengmeng Wu, Yuchi Xu, Huan Zhao, Pipei Huang, Guoliang Kang, Qiwei Chen, Wei Li, and Dik Lun Lee. 2019. Multi-interest network with dynamic routing for recommendation at Tmall. In CIKM . 26152623.
- [15] Yinwei Wei, Wenqi Liu, Fan Liu, Xiang Wang, Liqiang Nie, and Tat-Seng Chua. 2023. LightGT: A Light Graph Transformer for Multimedia Recommendation. In SIGIR .
- [16] Linghao Xia, Chao Huang, Chunzhen Huang, Kangyi Lin, Tao Yu, and Ben Kao. 2023. Automated Self-Supervised Learning for Recommendation. In WWW .
- [17] Yaxian Xia, Yi Cao, Sihao Hu, Tong Liu, and Lingling Lu. 2023. Deep IntentionAware Network for Click-Through Rate Prediction.
- [18] Ruobing Xie, Qi Liu, Liangdong Wang, Shukai Liu, Bo Zhang, and Leyu Lin. 2022. Contrastive cross-domain recommendation in matching. In KDD . 4226-4236.
- [19] Zhitao Ying, Jiaxuan You, Christopher Morris, Xiang Ren, Will Hamilton, and Jure Leskovec. 2018. Hierarchical graph representation learning with differentiable pooling. In NIPS . 4800-4810.
- [20] Fan Zhang, Qiuying Peng, Yulin Wu, Zheng Pan, Rong Zeng, Da Lin, and Yue Qi. 2022. Multi-Graph based Multi-Scenario Recommendation in Large-scale Online Video Services. In WWW .
- [21] Cheng Zhao, Chenliang Li, and Cong Fu. 2019. Cross-domain recommendation via preference propagation graphnet. In CIKM . 2165-2168.

Received 20 February 2007; revised 12 March 2009; accepted 5 June 2009
Houye Ji Ye Tang Zhaoxin Chen Lixi Deng Jun Hu Lei Su
Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce
With the rapid development of the short video industry, traditional
e-commerce has encountered a new paradigm, video-driven e-commerce, which
leverages attractive videos for product showcases and provides both video and
item services for users. Benefitting from the dynamic and visualized
introduction of items,video-driven e-commerce has shown huge potential in
stimulating consumer confidence and promoting sales. In this paper, we focus on
the video retrieval task, facing the following challenges: (1) Howto handle the
heterogeneities among users, items, and videos? (2)How to mine the
complementarity between items and videos for better user understanding? In this
paper, we first leverage the dual graph to model the co-existing of user-video
and user-item interactions in video-driven e-commerce and innovatively reduce
user preference understanding to a graph matching problem. To solve it, we
further propose a novel bi-level Graph Matching Network(GMN), which mainly
consists of node- and preference-level graph matching. Given a user, node-level
graph matching aims to match videos and items, while preference-level graph
matching aims to match multiple user preferences extracted from both videos and
items. Then the proposed GMN can generate and improve user embedding by
aggregating matched nodes or preferences from the dual graph in a bi-level
manner. Comprehensive experiments show the superiority of the proposed GMN with
significant improvements over state-of-the-art approaches (e.g., AUC+1.9% and
CTR+7.15%). We have developed it on a well-known video-driven e-commerce
platform, serving hundreds of millions of users every day