## VecAug: Unveiling Camouflaged Frauds with Cohort Augmentation for Enhanced Detection

## Fei Xiao

## Shaofeng Cai ∗

National University of Singapore &amp; Shopee Singapore fxiao004@comp.nus.edu.sg

Gang Chen Zhejiang University Hangzhou, China cg@zju.edu.cn

H. V. Jagadish University of Michigan Ann Arbor, USA jag@umich.edu

National University of Singapore Singapore shaofeng@comp.nus.edu.sg

## Beng Chin Ooi

National University of Singapore Singapore ooibc@comp.nus.edu.sg

## ABSTRACT

Meihui Zhang Beijing Institute of Technology Beijing, China meihui\_zhang@bit.edu.cn

## KEYWORDS

Fraud detection presents a challenging task characterized by everevolving fraud patterns and scarce labeled data. Existing methods predominantly rely on graph-based or sequence-based approaches. While graph-based approaches connect users through shared entities to capture structural information, they remain vulnerable to fraudsters who can disrupt or manipulate these connections. In contrast, sequence-based approaches analyze users' behavioral patterns, offering robustness against tampering but overlooking the interactions between similar users. Inspired by cohort analysis in retention and healthcare, this paper introduces VecAug, a novel cohort-augmented learning framework that addresses these challenges by enhancing the representation learning of target users with personalized cohort information. To this end, we first propose a vector burn-in technique for automatic cohort identification , which retrieves a task-specific cohort for each target user. Then, to fully exploit the cohort information, we introduce an attentive cohort aggregation technique for augmenting target user representations. To improve the robustness of such cohort augmentation, we also propose a novel label-aware cohort neighbor separation mechanism to distance negative cohort neighbors and calibrate the aggregated cohort information. By integrating this cohort information with target user representations, VecAug enhances the modeling capacity and generalization capabilities of the model to be augmented. Our framework is flexible and can be seamlessly integrated with existing fraud detection models. We deploy our framework on e-commerce platforms and evaluate it on three fraud detection datasets, and results show that VecAug improves the detection performance of base models by up to 2.48% in AUC and 22.5% in R@P0 9, outperforming . state-of-the-art methods significantly.

## CCS CONCEPTS

- · Applied computing → Electronic commerce .

∗ Corresponding author

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-c064f731-dc95-4eed-8646-c3ee61ac38cc.jpg)

This work is licensed under a Creative Commons Attribution International 4.0 License.

KDD '24, August 25-29, 2024, Barcelona, Spain © 2024 Copyright held by the owner/author(s). ACM ISBN 979-8-4007-0490-1/24/08. https://doi.org/10.1145/3637528.3671527

User Modeling, Cohort Analysis, Fraud Detection, Retrieval Augmented Detection, Personalized Cohort Augmentation

## ACMReference Format:

Fei Xiao, Shaofeng Cai, Gang Chen, H. V. Jagadish, Beng Chin Ooi, and Meihui Zhang. 2024. VecAug: Unveiling Camouflaged Frauds with Cohort Augmentation for Enhanced Detection. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD '24), August 25-29, 2024, Barcelona, Spain. ACM, New York, NY, USA, 12 pages. https://doi.org/10.1145/3637528.3671527

## 1 INTRODUCTION

Fraudulent transactions pose a serious threat to e-commerce platforms, as they cause economic losses, damage reputations, and harm user experiences [14, 26]. According to a recent report, fraud costs 2.9% of global e-commerce revenue in 2023 1 . This is especially concerning for the fast-growing Southeast Asian market, which is expected to have 140 million new consumers by 2030 2 . However, detecting fraud in real-world scenarios remains challenging due to the dynamic nature of fraud patterns and the scarcity of labeled data [26].

To address the sparse transaction data issue and identify potential fraudsters among new users, numerous fraud detection systems have been developed, leveraging advanced machine learning algorithms and integrating diverse data sources for comprehensive analysis and detection. These systems typically fall into two categories: graph-based approaches [4, 5, 9, 15, 17, 19, 21, 31] and sequencebased methodologies [3, 11-14, 25, 26, 34]. Graph-based systems connect users based on shared identity features, such as devices, IPs, and phones, and use graph neural networks (GNNs) to capture the structural information. However, certain fraudsters employ sophisticated techniques, such as device information manipulation or VPN usage, to evade explicit connections. They also imitate the behaviors of legitimate users, such as clicking on the same products or pages or using similar IPs, to camouflage themselves [5, 17]. These fraudsters are hard to identify using graph-based methods and lower the effectiveness of GNN-based approaches. In contrast, sequence-based systems analyze users' behavioral sequences, which are more resilient to manipulation than individual features [13, 14, 27]. Nonetheless,

1 https://www.identiq.com/blog/ecommerce-fraud-prevention-report

2 https://www.linkedin.com/pulse/why-southeast-asia-expected-worlds-next-ecommerce-powerhouse/

Figure 1: A toy example depicting the behavioral sequences of three users: User B and User C have similar behavior sequences, whereas User A has quite different ones.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-52c7ed72-2f99-4eb1-94bd-a7b6587b9de8.jpg)

sequence-based models often overlook cross-user interactions between the target user and similar peers, thus failing to fully exploit the information from similar users. Therefore, we need tailored approaches to connect well-camouflaged fraudsters with similar users and use their data for more accurate user representations.

In this paper, we present VecAug, a novel learning-based cohort augmentation framework for fraud detection using cohort information. Our framework is inspired by cohort analysis, which is widely used in retention and healthcare applications to study the relationships and behaviors of users based on their activity patterns. Unlike traditional cohort analysis methods that group users into different cohorts based on a set of traits or a specific event, our framework constructs implicit user cohorts based on the relevance of their behavioral sequences. In this manner, we can identify potential fraudsters who exhibit similar fraudulent behaviors, regardless of their identity features, such as devices, IPs, and phones. For example, Figure 1 illustrates the behavioral sequences of three users, where User B and User C both search for the same products, make quick payments, and leave positive reviews. They can be regarded as personalized cohort neighbors of each other and their information can be shared to enhance the homophily for fraud prediction. In contrast, User A performs product searches and comparisons before buying, behaving more like a normal user and should not be included in their cohort neighbors.

As illustrated in Figure 2, VecAug has four phases: the vector burn-in phase, the cohort identification phase, the cohort-augmented training phase, and the prediction phase. In the vector burn-in phase, we use a novel technique to generate task-specific cohort vectors for all training samples and store them in a vector database E 𝑝𝑜𝑜𝑙 along with their fraud labels. This technique separates the optimization of embedding vectors from their use in the later cohort augmentation, which improves the training efficiency and effectiveness. In the cohort identification phase, we select 𝐾 augmentation neighbors and 𝐾 negative neighbors for each target user from the vector pool, based on their similarity and label discrepancy. The augmentation neighbors are used to enrich the representation of the target user, while the negative neighbors are used to create a contrastive learning objective. In the cohort-augmented training phase, VecAug performs attentive neighbor aggregation to combine the cohort information from the augmentation neighbors, and labelaware neighbor separation to push away the representations of the negative neighbors. By doing so, VecAug learns a more robust and discriminative model for fraud detection. In the prediction phase, VecAug can rapidly retrieve the augmentation neighbors from the vector pool and use them to improve the prediction of the target user. In summary, we make the following contributions:

- · We introduce VecAug, a pioneering cohort augmentation framework that improves the prediction performance of existing fraud detection methods by incorporating rich cohort neighborhood information and task-specific embedding vectors.
- · We develop a novel vector burn-in technique that identifies personalized cohorts based on behavioral sequences and detects fraudsters who evade connections by identity features.
- · We propose a novel label-aware neighbor separation technique that reduces noise from neighbors of opposite classes and improves cohort-augmented learning robustness.
- · We test VecAug on the state-of-the-art deep learning models in fraud detection and observe substantial performance improvement. VecAug enhances base models by up to 2.48% in AUC and 22.5% in R@P0 9, with negligible computational overhead. .

We organize this paper as follows. Section 2 introduces the fraud detection tasks and the cohort augmentation concept. Section 3 explains VecAug's technical aspects and shows how personalized cohorts help detect camouflaged fraudsters. Section 4 presents experimental results of integrating VecAug with four base models to demonstrate its effectiveness. Section 5 discusses the related work on fraud detection, and section 6 concludes this paper.

## 2 PROBLEM DEFINITION

In this section, we first formulate the fraud detection task on user behavioral data. Next, we introduce the idea of learning-based cohort augmentation for fraud detection, followed by the definition of augmentation neighbors and negative neighbors .

## 2.1 Fraud Detection

Fraud Detection on Behavioral Data. For a target user 𝑢 𝑖 ∈ U , a common fraud behavior detection system takes the user's behavioral sequence as input: xi = { 𝑠 0 , 𝑠 1 , · · · , 𝑠 𝑚 -1 } , where 𝑠 𝑖 ∈ S represents user's action and 𝑚 is the length of the sequence. The fraud detection task over behavioral data aims to detect whether users engage in suspicious activities given their behavioral sequences. Each user 𝑢 𝑖 is characterized by a corresponding behavioral sequence xi and a ground-truth label 𝑦 𝑖 . Identifying fake reviews is a specific instance of fraud behavior detection, where actions correspond to purchases of different products.

## 2.2 Cohort Augmentation for Fraud Detection

In the cohort augmentation framework VecAug, we retrieve a personalized cohort for each user, aiming to exploit the implicit relationships between target users and their hidden connections. Specifically, the personalized cohort comprises 𝐾 augmentation neighbors , which are utilized to enhance target user representations, and 𝐾 negative neighbors , which contribute to the creation of an effective contrastive loss for distinguishing neighbors with different labels from the target user.

Definition 1. Learning-based Cohort Augmentation. Given the behavioral sequence of 𝑢 𝑖 in the e-commerce platform as x 𝑖 =

VecAug: Unveiling Camouflaged Frauds with Cohort Augmentation for Enhanced Detection

Figure 2: The proposed learning-based cohort augmentation framework VecAug. VecAug seamlessly integrates with any existing fraud detection models to uncover hidden connections between users and utilize cohort information for enhanced fraud detection.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-47a27438-26f8-492c-8d5a-de423cf74b7a.jpg)

{ 𝑠 1 , 𝑠 2 , · · · , 𝑠 𝑛 } and the corresponding label y 𝑖 , the objective of cohort augmentation is to pinpoint similar fraudulent users controlled by the same entity as the target fraud users, and to identify additional normal users who resemble the target normal user, leveraging their information to enhance the predictive performance of the model. We can formulate learning-based cohort augmentation as:

$$\dots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \\ \dots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdot \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \ddots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots \cdots.$$

where 𝑓 (·) is the augmented learning function parameterized by W 𝑓 ; 𝑔 (·) is the representation learning function of the base model with parameters W e 𝑔 ; 𝑖 and E 𝑎 𝑖 are the vector of the target user and the set of task-specific cohort augmentation neighbors in the vector burn-in space respectively, derived by a separately trained vector burn-in model; ˆ︁ y 𝑎 𝑖 represents the cohort-augmented prediction logit. The main motivation for introducing the personalized learningbased cohorts is to leverage the supplementary information of similar samples E 𝑎 𝑖 for enhancing the representation power and robustness of the representation learning function 𝑔 (·) .

Definition 2. Augmentation Neighbors. The augmentation neighbors, denoted as N 𝑎𝑢𝑔 ( 𝑢 , 𝐾 𝑖 ) , are 𝐾 training samples that have similar fraud behaviors to the target sample 𝑢 𝑖 , as measured by the distance between their burn-in vectors. The augmentation neighbors can have the same or different labels as 𝑢 𝑖 (fraudulent or non-fraudulent). The augmentation neighbors help to improve the representation learning of the target sample by providing cohort information. The set of burn-in vectors of the augmentation neighbors is denoted as E 𝑎 𝑖 .

Definition 3. Negative Neighbors. The negative neighbors, denoted as N 𝑛𝑒𝑔 ( 𝑢 , 𝐾 𝑖 ) , are 𝐾 training samples that have opposite labels from the target sample 𝑢 𝑖 but have similar fraud behaviors, based on the distance between their burn-in vectors. The negative neighbors are used to improve the robustness and stability of cohort-augmented learning by minimizing the mutual information

Augmentation Neighbor Vectors Training and Testing Set Negative Neighbor Vectors

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-499f76e3-1ef0-453c-9635-b88325cc5ddb.jpg)

Figure 3: The detailed illustration of cohort augmentation module and prediction module. The neighbor transformation blocks are identical. The dashed arrows denote computational flows involved only in the augmented training phase.

between the cohort data and the target user. The set of burn-in vectors of the negative neighbors is denoted as E 𝑛 𝑖 .

## 3 METHODOLOGIES

This section introduces VecAug, a novel framework that aims to boost the performance of existing fraud detection methods by enhancing their discrimination capability. We describe each module of VecAug and how they are trained to achieve this goal.

## 3.1 Overall Framework

The illustration of VecAug for enhanced fraud detection tasks in Figure 2 presents the four main modules operating in distinct phases: the vector burn-in phase, the cohort identification phase, the augmented training phase, and the prediction phase. First, the vector burn-in module will generate fraud-specific vectors e 𝑖 via an auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) and store the resultant embedding vectors of all training samples in the vector database E 𝑝𝑜𝑜𝑙 . For each user 𝑢 𝑖 , VecAug identifies its 𝐾 augmentation neighbor vectors E 𝑎 𝑖 and 𝐾 negative neighbor vectors E 𝑛 𝑖 from E 𝑝𝑜𝑜𝑙 . These vectors capture the relationship between users based on their fraud behaviors. Next, in the augmented training phase as shown in Figure 3, VecAug aggregates the information of E 𝑎 𝑖 to augment the latent representation h 𝑖 of x 𝑖 obtained via the main encoder 𝑔 (·) . To address camouflaged frauds, VecAug applies a label-aware neighbor separation mechanism to push away the 𝐾 negative neighbors in the augmented representation space, which reduces the influence of fraudsters who imitate normal users and improves detection accuracy. Finally, in the prediction phase, only the augmentation neighbor vectors E 𝑎 𝑖 will be retrieved to augment the target user representation h 𝑖 for the final prediction. For clarity, the outputs of the auxiliary encoder and the main encoder are called vector and representation , respectively.

Figure 4: The augmentation neighbors and negative neighbors for the target sample 𝑢 𝑖 in vector burn-in space and augmented representation space.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-d1d7c909-57cd-4ea5-be74-0eafb1f8a977.jpg)

## 3.2 Vector Burn-in Phase

To generate embedding vectors that can identify cohorts of fraudsters, we propose a novel vector burn-in technique that captures the fraud behaviors within each sample. Specifically, we train an auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) and an output layer 𝜙 𝑎𝑢𝑥 using backpropagation in a supervised manner to obtain embedding vectors, i.e., e 𝑖 = 𝑔 𝑎𝑢𝑥 ( x 𝑖 ) . These vectors encode fraud-related information that is useful for subsequent cohort-augmented learning. The auxiliary encoder can leverage existing fraud detection models, such as those proposed in [14, 27, 34] or traditional sequence learning methods in [18, 20], to obtain the fraud-specific embedding of samples and use a multilayer perceptron (MLP) as the output layer to generate prediction logits:

↦

$$\widehat { y } _ { i } = \phi _ { a u x } ( \mathbf e _ { i } ), \quad \phi _ { a u x } \colon \mathbb { R } ^ { n _ { d } } \mapsto \mathbb { R } \quad \quad ( 2 ) \quad \text{wt}$$

where 𝑛 𝑑 is the dimension of the embedding vectors. Binary cross entropy (BCE) is typically adopted as the objective function for the fraud detection task and is optimized via gradient descent. In this way, task-specific embedding vectors can be generated, and the corresponding latent embedding space is called vector burn-in space , which will not be optimized in the augmented training phase. The novel vector burn-in technique effectively decouples cohort identification from the base model training process, eliminating early training noise, and ensuring more accurate cohort neighbors.

## 3.3 Cohort Identification Phase

The embedding vectors of training samples, denoted as e 𝑖 , along with their corresponding labels y 𝑖 , are stored in a vector database E 𝑝𝑜𝑜𝑙 . To identify the cohorts specific to fraudulent activities, the target sample is fed into 𝑔 𝑎𝑢𝑥 (·) , generating a vector query to search for 𝐾 augmentation neighbors in E 𝑝𝑜𝑜𝑙 . During this phase, the Euclidean distance metric is employed for retrieving the cohort neighbors. However, cohort augmentation for fraud detection faces a key challenge: the potential degradation of prediction performance. This can occur when incorporating information from well-camouflaged fraudsters with that of normal users, or when excessively integrating normal user behavior information to enhance the representation learning of fraudsters. To mitigate this challenge, we adopt a strategy that involves retrieving both 𝐾 augmentation neighbors and 𝐾 negative neighbors for each target user during training. This strategy enables the model to discern the behavior disparities between well-camouflaged fraudsters and normal users. We construct a tailored contrastive loss to achieve this goal, which is illustrated in Figure 3 and explained in Section 3.6. Here, E 𝑎 𝑖 and E 𝑛 𝑖 represent the augmentation neighbor vectors and negative neighbor vectors, respectively. It is worth noting that during inference for augmented learning, only the augmentation neighbors E 𝑎 𝑖 are retrieved, as the labels of testing samples are not available to identify the negative neighbors E 𝑛 𝑖 .

## 3.4 Cohort-Augmented Training Phase

To harness the potential of neighboring vector information and effectively augment the target sample modeling, we perform an attentive neighbor aggregation for the 𝐾 augmentation neighbors and propose a label-aware neighbor separation mechanism to distance the 𝐾 negative neighbors. We first transform the augmentation neighbor vectors and the negative neighbor vectors to the augmented representation space , which is the new representation space derived from the main encoder 𝑔 (·) :

$$H _ { i } ^ { a } = W ^ { a u g } E _ { i } ^ { a } + b ^ { a u g }$$

where W 𝑎𝑢𝑔 ∈ R 𝑛 𝑑 × 𝑛 𝑑 is the weight vector, b 𝑎𝑢𝑔 ∈ R 𝑛 𝑑 is the bias term, and H 𝑎 𝑖 is the representations of the augmentation neighbors. Then we attentively aggregate information from the augmentation neighbors to the target sample using the following equations:

$$\alpha _ { i, k } = \text{Softmax} ( h _ { i, k } ^ { T } W ^ { a t t } h _ { i } ), \quad h _ { i, k } \in H _ { i } ^ { a } \\ h _ { i } ^ { a } = \sum _ { k = 1 } ^ { K } \alpha _ { i, k } \cdot h _ { i, k } \\ \text{ere} \, h \,. \text{ is the representation of the $k$-th argumentation nei$ohr}$$

where h 𝑖,𝑘 is the representation of the 𝑘 -th augmentation neighbor in the augmented representation space, and h 𝑖 is the new representation of the target sample x 𝑖 obtained via the main encoder 𝑔 (·) , i.e., h 𝑖 = 𝑔 ( x 𝑖 ) . W 𝑎𝑡𝑡 ∈ R 𝑛 𝑑 × 𝑛 𝑑 is the bilinear attention weight matrix, and 𝛼 𝑖,𝑘 corresponds to the attention weight for h 𝑖,𝑘 . h 𝑎 𝑖 and h 𝑖 will then be fused to generate the cohort-augmented logits in the final prediction module.

The incorporation of neighboring vector information can substantially enhance the model's learning capacity, but it may also compromise its disambiguation capability. As illustrated in Figure 4, the neighboring samples for 𝑢 𝑖 may encompass samples from opposite classes. To mitigate the adverse effects of noisy information from the augmentation neighbors, we build a contrastive objective to separate the negative neighbors in the augmented representation space. Specifically, we adopt the same transformation layer to obtain representations H 𝑛 𝑖 for the negative neighbors. Subsequently, we perform a pairwise summation of the target user representation and the negative neighbors' representations. These negativeneighbor-augmented user representations are then fed into the main output layer to generate 𝐾 negative-neighbor-augmented logits for supervised contrastive learning. The construction of the supervised contrastive loss will be elaborated in Section 3.6.

## 3.5 Prediction Phase

The target sample representation h 𝑖 and the corresponding augmentation neighbor representation h 𝑎 𝑖 will be fed into an output layer to generate cohort-augmented logit:

↦

$$\hat { y } _ { i } ^ { a } = \phi _ { m a i n } ^ { a } ( \mathbf h _ { i } + \mathbf h _ { i } ^ { a } ), \ \phi _ { m a i n } ^ { a } \colon \mathbb { R } ^ { n _ { d } } \mapsto \mathbb { R } \quad \ \ ( 5 ) \quad \text{abc}$$

Wefuse the two representations via a summation, which empirically is more efficient and stable than concatenation. The output layer 𝜙 𝑎 𝑚𝑎𝑖𝑛 will capture the task-specific information from the target sample and augmentation neighbors. Meanwhile, we can obtain the negative-neighbor-augmented logits ˆ︁ Y 𝑛 𝑖 ∈ R 𝑛 𝑝 × 𝐾 by feeding the sum of target user representation and the 𝐾 negative neighbors' representations into the main output layer.

## 3.6 Multi-Objective Joint Training

We use a joint training scheme for VecAug that combines different objectives in one framework for effective fraud detection. This helps VecAug to capture intricate fraud behaviors and improve robustness against camouflaged frauds.

Task #1: Main Supervised Prediction. For a fraud detection task, we use BCE as a main objective function:

$$\mathcal { L } _ { m a i n } ^ { a } = - \frac { 1 } { N } \sum _ { \mathcal { T } _ { t r a i n } } y _ { i } l o g ( \sigma ( \widehat { y } _ { i } ^ { a } ) ) + ( 1 - y _ { i } ) l o g ( 1 - \sigma ( \widehat { y } _ { i } ^ { a } ) ) \quad ( 6 ) \quad \begin{pmatrix} \ln o u \\ \text{els w} \\ \text{coho} \end{pmatrix}$$

where y 𝑖 and ˆ︁ y 𝑎 𝑖 are the ground truth label and cohort-augmented prediction logit respectively. 𝑁 is the number of training samples, and 𝜎 (·) is the sigmoid function. With this objective function, VecAug can be trained effectively via gradient-based optimizers.

Task #2: Supervised Contrastive Learning. Weintroduce a labelaware neighbor separation mechanism to counter the negative effect of noisy information from augmentation neighbors. For this objective function, any negative-neighbor-augmented logit ˆ︁ y 𝑛 𝑖,𝑘 in ˆ︁ Y 𝑛 𝑖 should incur greater losses than ˆ︁ y 𝑎 𝑖 , considering the ground truth y 𝑖 of the target sample. Drawing inspiration from prior works [28], we construct the contrastive loss on the prediction logits rather than the cohort-augmented representations, as presented below:

$$\mathcal { L } _ { s c c l } = - \frac { 1 } { N } \sum _ { \mathcal { T } _ { t r a i n } } \log \frac { \exp ( - \frac { d ( y _ { i }, \widehat { y } _ { i } ^ { a } ) } { \tau } ) } { \exp ( - \frac { d ( y _ { i }, \widehat { y } _ { i } ^ { a } ) } { \tau } ) + \sum _ { k = 1 } ^ { K } \exp ( - \frac { d ( y _ { i }, \widehat { y } _ { i, k } ^ { n } ) } { \tau } ) } } { ( 7 ) } \quad \begin{array} { c } g r \in \\ 4. 1. 1 \\ t o v i \end{array} }$$

where d ( y 𝑖 , ˆ︁ y 𝑎 𝑖 ) represents the distance of the ground-truth logits and cohort-augmented logits, and 𝜏 is the temperature hyperparameter. With low temperatures, the loss is dominated by closer cohort-augmented logits. This method enables supervised contrastive learning and prevents the cohort augmented representation from diverging too much from the original burn-in vector. In this manner, the personalized cohort from the burn-in phase remains useful in the augmentation phase.

Task #3: Latent Space Alignment. Since cohort identification depends on vector distances between the target sample and candidates, it may deviate slightly from distances in the augmented representation space, potentially reducing the relevance of neighbor information to the current prediction task. To rectify this inconsistency, we introduce auxiliary vector regularization for consistent distances in both vector burn-in and cohort-augmented learning phases:

$$\mathcal { L } _ { a l i g n } = \frac { 1 } { N } \sum _ { \mathcal { T } _ { t r a i n } } \| \mathbf e _ { i } - \mathbf h _ { i } \| ^ { 2 } \quad \quad ( 8 ) \quad \frac { \frac { \cdot \cdot \cdot } { 3 _ { \mathbf h } } } { \frac { \cdot \cdot } { 4 _ { \mathbf h } } }$$

The final objective function of VecAug is the summation of the above three tasks and the canonical weight decay regularization:

$$\mathcal { L } = \mathcal { L } _ { m a i n } ^ { a } + \alpha \mathcal { L } _ { s c c l } + \beta \mathcal { L } _ { a l i g n } + \lambda \left \| \theta \right \| ^ { 2 } \text{ \quad \ \ } ( 9 )$$

where 𝛼 and 𝛽 are the hyperparameters that control the weights of the contrastive loss and auxiliary reconstruction loss respectively, 𝜃 is the set of all model parameters, and 𝜆 is the weight regularization strength.

Prediction Phase. In the final prediction phase, VecAug first obtains the burn-in vector of the target sample e 𝑖 as a query to retrieve the augmentation neighbors. Next, the augmentation neighbor vectors E 𝑎 𝑖 are transformed into the augmented representation space H 𝑎 𝑖 and fused with the new representations h 𝑖 of the target sample. Finally, the augmented representation is fed into the output layer to predict the fraud probability.

## 4 EXPERIMENTS

In our study, we integrate four established fraud detection models with VecAug to assess the effect of the proposed label-aware cohort augmentation on detecting hidden fraudsters. Particularly, our experiments are devised to answer the key research questions (RQs) as follows:

- · RQ1: Can VecAug improve the existing sequence-based fraud detection model's performance without harming the legitimate users' activities?
- · RQ2: How do cohort augmentation and label-aware neighbor separation mechanisms contribute to fraud detection tasks?
- · RQ3: How does VecAug perform as compared with existing neighbor augmentation approaches?
- · RQ4: How does the size of augmentation and negative neighbor sets impact VecAug's performance in fraud detection?
- · RQ5: How effective is VecAug at unveiling fraud camouflage in graph-based fraud detection methods?

## 4.1 Experimental Setup

4.1.1 Datasets. We mainly use two private and one public datasets to evaluate our proposed method. The private datasets are obtained from Shopee 3 , the largest online e-commerce platform in Southeast Asia. Each user is assigned a risk score by a fraud detection model based on their daily activities or purchasing history. The public dataset is the Amazon 4 dataset [1, 2, 10], which is widely used for fake review detection. Fake review detection is a specific case of fraudulent behavior detection, where each action is a product review. We compare the performance of the base models with and without VecAug on the three datasets to demonstrate its effectiveness.

Shopee Dataset . The large-scale industrial datasets collected from Shopee adhere strictly to security and privacy protocols. These datasets consist of historical activity logs originating from the same geographical regions, albeit varying in size, designated as Shopeelarge and Shopee-small , spanning a specified timeframe. Table 1 provides an overview of the dataset statistics. For fraud behavior detection, each user is represented by 300 records, each containing

3 https://en.wikipedia.org/wiki/Shopee

4 https://en.wikipedia.org/wiki/Amazon\_(company)

Table 1: Statistics of datasets used in the fraud detection task. The Pos. rate is the ratio of fraud users.

| Datasets     | #Users   |   #Action types | #Actions   |   #Fields | Pos. rate   |
|--------------|----------|-----------------|------------|-----------|-------------|
| Shopee-small | 16k      |             653 | 4.8M       |        11 | 1%          |
| Shopee-large | 1.05M    |             653 | 315M       |        11 | 1%          |
| Amazon       | 18k      |          719820 | 13.3M      |         3 | 6.86%       |

details such as actions taken, timestamps, and associated attributes. These actions encompass a spectrum of user interactions within the Shopee platform, including "visit homepage", "refund request", and --"password reset request". The fraud rate in the table is our sampled --fraud rate for the experiments, not the actual fraud rate on Shopee.

We also collected a user-device interaction graph from Shopee, comprising 100k users and 54k devices. This graph dataset serves to validate the effectiveness of VecAug in uncovering fraud camouflage. We employ two graph neural networks for fraud detection on this dataset. Subsequently, we integrate these GNNs with VecAug to observe performance improvements. To simulate fraudsters' camouflage strategies, we sub-sample the Shopee graph by removing 3758 edges between certain fraudulent accounts and devices. Finally, we compare the performance of the two GNNs and their integration with VecAug on this sub-sampled Shopee graph.

Amazon Dataset . The Amazon dataset comprises diverse product reviews from categories such as electronics, books, CDs, and movies 5 . Extensive use case analyses conducted in previous studies [1, 2, 10] have revealed patterns of fraudulent activities, including repeated purchases of identical items and the rapid submission of reviews. Utilizing the filtering algorithms in [5, 32], users are labeled based on their helpful vote percentages, with those below 20% as fake users and those above 80% as normal users.

4.1.2 Baseline Methods. We integrate VecAug with four sequencebased fraud detection models and compare its performance to two existing neighbor augmented learning methods. Additionally, we utilize two graph neural networks to validate the effectiveness of VecAug in uncovering camouflaged fraud. Ablation tests are also conducted to show the efficacy of the techniques proposed in VecAug.

Sequence-based fraud detection base models. (1) BiLSTM [18] applies bidirectional LSTM to capture the dependency information among sequential data for fraud detection. (2) LIC Tree-LSTM [14] builds a behavior tree for the user's behavioral sequence and studies fraud transaction detection with local intention calibration. (3) HEN [34] uses field-level extractor and action-level extractor to hierarchically learn users' intentions and identify high-risk behavior sequences. (4) MINT [27] employs a time-aware behavior graph to model user's behavioral data and utilizes a multi-view graph neural network to detect fraudulent behaviors.

Graph-based fraud detection base models. (1) GraphSAGE [8] performs inductive learning on graphs by sampling and aggregating node representations. (2) GeniePath [16] integrates LSTMs into GCN layers to adaptively aggregate neighborhood information.

5 https://jmcauley.ucsd.edu/data/amazon/

Table 2: The hyperparameters selected for VecAug on different fraud detection methods and three distinct datasets.

| Datasets     | BiLSTM   | BiLSTM   | LIC Tree-LSTM   | LIC Tree-LSTM   | HEN   | HEN      | MINT          | MINT   |
|--------------|----------|----------|-----------------|-----------------|-------|----------|---------------|--------|
|              | 𝛼        | 𝛽        | 𝛼               | 𝛽               | 𝛼     | 𝛽        | 𝛼 𝛽           |        |
| Shopee-small | 0.01     | 0.00001  | 0.01            | 0.00001         | 0.001 | 0.00001  | 0.001 0.00001 |        |
| Shopee-large | 0.001    | 0.000001 | 0.001           | 0.000001        | 0.001 | 0.000001 | 0.001 0.00001 |        |
| Amazon       | 0.01     | 0.00001  | 0.01            | 0.00001         | 0.01  | 0.00001  | 0.001 0.00001 |        |

Existing neighbor augmentation methods. (1) GRASP [30] divides samples into different clusters and uses the cluster representations to enrich sample representations. (2) CSRM [24] dynamically retrieves different neighbors' information during model training for augmented learning.

Ablations. VecAug 𝐵𝐼 is a variant of VecAug that adopts a vanilla cohort augmentation architecture with a vector burn-in mechanism. VecAug 𝐿𝐴 is a variant of VecAug that only introduces the labelaware neighbor separation mechanism.

4.1.3 Implementation Details. In our implementation, we utilize PyTorch for all models and Milvus [23] to store embedding vectors. For the datasets, the split ratio of the training/validation/testing set is 60%/20%/20%. We employ the Adam optimizer and initialize model parameters with Xavier initialization. Early stopping is applied if the validation performance does not improve for 20 epochs. The settings of the fraud detection task follow the practice in [14, 27]. The embedding dimension of users' behavioral action is set to 64, the batch size to 128, the learning rate to 0.0001, and the maximum behavioral sequence length to 300. The regularization strength is set to 1 𝑒 -5. The number of nearest neighbors 𝐾 is also set to five for all models and datasets.

We used grid search to optimize three key hyperparameters for VecAug with different base models: the contrastive loss weight 𝛼 , the auxiliary reconstruction loss weight 𝛽 , and the temperature 𝜏 . These hyperparameters control the importance of the contrastive objective, the balance between cohort-augmented learning and latent space alignment, and the focus on close or far-away cohort neighbors, respectively. We search 𝛼 in (0.00001, 0.0001, 0.001, 0.01, 0.1, 1.0), 𝛽 in (0.0000001, 0.000001, 0.00001, 0.0001, 0.001), and 𝜏 in (0.1, 0.3, 1.0, 3.0, 10.0). These ranges were chosen to cover a wide spectrum of possible values for different fraud detection models. Wefound that 𝜏 = 1 was the best value for all models. Table 2 shows the values of 𝛼 and 𝛽 selected for VecAug with various base models and datasets.

4.1.4 Evaluation Metrics. For fraud detection tasks, we evaluate all methods with two widely used metrics: AUC (Area Under ROC) and R@P . AUC signifies the probability that positive cases' predictions 𝑘 are ranked ahead of negative cases. R@P 𝑘 represents the recall rate when precision equals 𝑘 . In our fraud detection scenario, the goal is to identify as many suspicious entities as possible while not disrupting the regular operations of benign entities. We set 𝑘 to 0.9 for all experiments. A superior cohort-augmented learning framework is expected to achieve higher AUC values than base

Table 3: Experimental results of different sequence-based fraud detection methods with (w/) and without (w/o) VecAug on the three datasets. The best results are highlighted in boldface.

| Datasets     | Metric    | BiLSTM   | BiLSTM   | BiLSTM   | LIC Tree-LSTM   | LIC Tree-LSTM   | LIC Tree-LSTM   | LIC Tree-LSTM   | HEN    | HEN    | MINT   | MINT   | MINT   |
|--------------|-----------|----------|----------|----------|-----------------|-----------------|-----------------|-----------------|--------|--------|--------|--------|--------|
| Datasets     | Metric    | w/o      | w/       | Imprv.   | w/o             | w/              | Imprv.          | w/o             | w/     | Imprv. | w/o    | w/     | Imprv. |
| Shopee-small | AUC       | 0.8567   | 0.8678   | 1.30%    | 0.8489          | 0.8577          | 1.04%           | 0.8611          | 0.8730 | 1.38%  | 0.8892 | 0.8971 | 0.89%  |
| Shopee-small | R@P 0 . 9 | 0.4789   | 0.5103   | 6.56%    | 0.4201          | 0.4578          | 8.97%           | 0.4737          | 0.4983 | 5.19%  | 0.5102 | 0.5387 | 5.59%  |
|              | AUC       | 0.8778   | 0.8869   | 1.04%    | 0.8723          | 0.8822          | 1.13%           | 0.8805          | 0.8898 | 1.06%  | 0.9087 | 0.9175 | 0.97%  |
|              | R@P 0 . 9 | 0.5267   | 0.5536   | 5.11%    | 0.4149          | 0.4378          | 5.52%           | 0.5304          | 0.5673 | 6.96%  | 0.5735 | 0.5982 | 4.31%  |
|              | AUC       | 0.8788   | 0.8917   | 1.47%    | 0.8656          | 0.8871          | 2.48%           | 0.8811          | 0.8967 | 1.77%  | 0.9134 | 0.9245 | 1.22%  |
|              | R@P 0 . 9 | 0.2231   | 0.2513   | 12.64%   | 0.1938          | 0.2374          | 22.50%          | 0.2411          | 0.2578 | 6.93%  | 0.3135 | 0.3317 | 5.81%  |

Figure 5: Performance comparison of VecAug and its two variants in fraud detection tasks.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-7b7207dc-ecca-4963-92f3-eafdb02f6bbd.jpg)

models and notably enhance the recall rate over base models when precision values are set to 0.9.

## 4.2 Effectiveness of Cohort Augmentation(RQ1)

Table 3 shows the fraud detection performance of four state-of-theart baselines with and without VecAug. VecAug improves both the AUC and R@P0 9 of the base models significantly. On the Shopee . datasets, the AUC increases by at least 0.89% and R@P0 9 by more . than 4.31%. On the Amazon dataset, the AUC rises by at least 1.22% and R@P0 9 . by 5.81%. Notably, the substantial enhancement in R@P0 9 indicates that VecAug aids in identifying more fraudsters . who escape the detection of base models. These fraudsters mimic the behavior of normal users to avoid being caught. VecAug uses the task-specific embedding vectors of the base models to create personalized implicit user cohorts, linking camouflaged fraudsters implicitly to other users who are controlled by the same individuals or groups. Unlike conventional GNN-based approaches vulnerable to intentionally masked identity features of fraudsters, our cohort identification methods rely on learned user behavioral representations to detect the camouflaged fraudsters effectively. For example, in Shopee, users with similar behavioral sequences may have similar user representations learned by base models. However, the base models cannot adequately separate fraud from normal users due to the presence of many camouflaged fraudsters. VecAug connects camouflaged fraudsters to labeled fraud users and separates them from similar normal users using a label-aware neighbor separation mechanism, which enables better discrimination between suspicious and normal behaviors.

## 4.3 Ablation Studies (RQ2)

We conduct ablation studies on VecAug to demonstrate the impact of vector burn-in cohort augmentation and label-aware neighbor separation on its performance.

4.3.1 Vector Burn-in for Cohort Augmentation. Figure 5 demonstrates that the vector burn-in technique alone substantially improves base model performance. This indicates that the learningbased cohort approach is effective for fraud detection. By constructing event-based networks for each user, we can leverage the similarities among users to infer their labels. Moreover, we can link unseen suspicious activities to existing samples, and obtain more relevant information for prediction. Fraud detection is a binary task, but fraud behavioral patterns are diverse and complex. The user behavioral representations learned from any base models will not form two clear clusters. Instead, they will form many clusters of varying sizes, especially for user accounts operated by the same person or group. Normal users' representations are usually more distinct from each other. Therefore, if we construct a personalized cohort for each user, it will mainly affect fraud users and make their clusters more compact. Fraud users not affiliated with any cluster are connected to other fraud users who are similar to them. This has minimal impact on normal users, who are less likely to be operated by a common entity, and whose cohort-augmented representation will not change much. As a result, we can detect more fraudulent users without compromising the performance of normal users.

4.3.2 Label-aware Neighbor Separation Mechanism. Figure 5 demonstrates a significant enhancement in both AUC and R@P0 9 met-. rics across both datasets upon integrating MINT with VecAug 𝐿𝐴 . While cohort augmentation fosters connections between various fraudsters and enhances learned representations, it may inadvertently link adept fraudsters with normal users exhibiting similar behavioral patterns. This scenario introduces considerable noise through direct message passing between fraudulent and normal users, thereby notably compromising model performance. To mitigate this issue, the label-aware neighbor separation mechanism deliberately distances these challenging negative neighbors during cohort augmentation via a supervised contrastive loss. Given the original base models' inability to discern target users from their difficult negative counterparts, the contrastive objective function serves to recalibrate the learning bias, prioritizing the treatment

Figure 6: Comparison of the effectiveness of VecAug, GRASP, and CSRM in enhancing the discriminative ability of the existing fraud detection models.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-ff82bfdc-3a57-4ff5-aeba-05dd6da9b9d3.jpg)

of these negative pairs and effectively separating them within the augmented learning space. This calibration is achieved through the construction of the contrastive loss on the augmented prediction logits, primarily influencing the output layers while also exerting a lesser influence on the encoder training.

## 4.4 Comparison with Existing Neighbor Augmentation Methods (RQ3)

In this subsection, we compare the effectiveness of VecAug with two existing methods that use neighborhood information to enhance target users: GRASP [30] and CSRM [24]. Figure 6 illustrates the performance comparisons. GRASP clusters the samples into groups based on the task-specific vectors using K-Means, and uses the centroid vectors as group representations. It constructs a KNN graph for different groups, with each user aggregating information from its group and other connected groups. However, GRASP functions as a three-layer graph neural network and passes excessive information from the neighbors to the target users, leading to severe over-smoothing. Moreover, GRASP compromises users' personalized behavioral patterns and performs worse than the base model on both datasets. CSRM dynamically retrieves the nearest neighbors for each user, demonstrating more effective neighbor augmentation than GRASP. However, CSRM encounters challenges in accurately utilizing the neighbors' information in the early stages of training, which can lead to erroneous results. It also fails to identify the most useful augmentation neighbors for the target user. Our VecAug solves these problems by introducing a new vector burn-in technique for more precise cohort identification and a label-aware contrastive neighbor separation mechanism for mitigating the negative effect of noisy information. From Figure 6, we can see that VecAug outperforms and is more consistent than both the previous neighbors-augmented learning methods in fraud detection.

## 4.5 Influence of Cohort Size (RQ4)

In this section, we investigate the impact of cohort size variation on the effectiveness of VecAug. The results obtained from two fraud detection models on the Shopee-small dataset are illustrated in Figure 7. It is evident that the performance of the proposed label-aware cohort-augmented learning framework remains highly robust across varying cohort sizes once the cohort size exceeds a

Figure 7: Performance improvements of HEN and MINT on Shopee-small after integration with VecAug, depicted in AUC across various cohort sizes.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-7749a179-cc12-41f3-a4ff-41278f4cbd3f.jpg)

certain threshold. Specifically, AUC values demonstrate an increasing trend with cohort size, plateauing when 𝐾 reaches four. With a smaller cohort, meaningful information is aggregated from training samples to enrich the representation of the target sample. However, as the cohort size increases, both valuable and noisy information is introduced to the target users, resulting in performance gains that saturate at 𝐾 =4. Initially, most information learned from augmentation neighbors closely aligns with the target users, thereby enhancing their representation. Yet, with an increased cohort size, the likelihood of encountering augmentation neighbors with opposite labels to the target users rises, potentially compromising the effectiveness of newly augmented neighbors. However, the implementation of a label-aware neighbor separation scheme helps mitigate the adverse effects of noisy information introduced by the negative neighbors. When the impacts of negative neighbors and the label-aware neighbor separation scheme are comparable, the performance of VecAug remains relatively stable across varying cohort sizes. In summary, our proposed VecAug effectively enhances the learning capacity of base models and exhibits robust performance, irrespective of cohort size variations.

## 4.6 Studies of Unveiling Camouflaged Fraud (RQ5)

To validate the VecAug's effectiveness in unveiling the camouflage of frauds, we simulate fraudsters' camouflage strategies by selectively removing 3758 edges between certain fraudulent accounts and devices in the Shopee-graph dataset. We then compare the performance of GraphSAGE and GeniePath with and without VecAug integration on both the original Shopee-graph and the sub-sampled Shopee-graph datasets. The comparison results in Table 4 reveal that both GraphSAGE and GeniePath experience severe degradation when fraudster-device connections are deliberately removed. However, the integration of VecAug significantly enhances the effectiveness of GraphSAGE and GeniePath on the sub-sampled Shopee-graph. Specifically, VecAug enables GraphSAGE to recover 86.3% (3242/3758) and GeniePath to recover 82.9% (3115/3758) of the deliberately removed connections. This leads to R@P0 9 . improvements of 47.61% and 40.02%, highlighting VecAug's strength in identifying more fraudulent users and thus unveiling the camouflaged fraud. Furthermore, the comparison between the base GNN models and their integration with VecAug demonstrates that

Table 4: GraphSAGE and GeniePath performance with and without VecAug integration on Shopee-graph and subsampled Shopee-graph.

| Models    | Datasets   | Shopee-graph   | Shopee-graph   | Sub-sampled Shopee-graph   | Sub-sampled Shopee-graph   |
|-----------|------------|----------------|----------------|----------------------------|----------------------------|
|           | Metric     | AUC            | R@P 0 . 9      | AUC                        | R@P 0 . 9                  |
| GraphSAGE | w/o        | 0.8536         | 0.3417         | 0.8051                     | 0.2243                     |
| GraphSAGE | w/         | 0.8623         | 0.3638         | 0.8486                     | 0.3311                     |
| GraphSAGE | Imprv.     | 1.02%          | 6.47%          | 5.40%                      | 47.61%                     |
| GeniePath | w/o        | 0.8714         | 0.3756         | 0.8194                     | 0.2541                     |
| GeniePath | w/         | 0.8789         | 0.3887         | 0.8573                     | 0.3558                     |
| GeniePath | Imprv.     | 0.86%          | 3.49%          | 4.63%                      | 40.02%                     |

VecAug can also augment the learning capabilities of GNN-based models in fraud detection.

## 4.7 Efficiency of VecAug with Integrating Vector Database

We assess the training and inference efficiency of VecAug with and without Milvus in this subsection, integrating with MINT on the Shopee-large dataset. We performed experiments over 20 epochs for both cases and measured the throughput (number of training/inference tuples processed per second) for both CPU and GPU. To ensure fair comparisons, we maintained a consistent batch size of 512 across all experiments to maximize the GPU computational capacity. For Milvus, we employed HNSW as the index for vector search, known for its high accuracy and efficient indexing capabilities. In contrast, for the scenario without a vector database, we utilized PyTorch's built-in functions for cohort neighbor searches. The throughput comparison results, as depicted in Figure 8, demonstrate that VecAug exhibits significantly improved efficiencies when integrated with a vector database compared to VecAug operating without one. Specifically, the solution of VecAug with Milvus achieves significantly higher training and inference efficiency, with speedups of up to 21.3x and 26.6x of CPU and GPU respectively, and incurs no extra infra investment. Our experimental results highlight VecAug's seamless integration with existing fraud detection methods and its effective combination with vector databases, providing a more efficient approach to fraud detection.

## 5 RELATED WORK

Fraud detection tasks analyze users' behavioral data and transaction history to identify fraudulent activities, such as fake reviews, brushing, fraud payments, etc. Existing fraud detection systems fall into two categories: graph-based and sequence-based. Graph-based methods [4-6, 9, 15, 17, 19, 21, 22, 29, 31] use predefined features like devices, IPs, and purchase patterns to connect users, but these features may not reflect behavioral similarity and are easy to manipulate by fraudsters [5, 22]. In contrast, sequence-based methods use recurrent neural networks (RNNs) [3, 11, 12, 14, 25, 26] or attention-based mechanisms [7, 13, 14, 33, 34] to capture temporal and sequential behavior patterns, which are more robust against manipulation. For example, some studies utilize behavior trees

Figure 8: Throughput comparison of VecAug with and without vector database (with index HNSW).

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-121f88d9-220c-4097-aeb8-106f01dff5aa.jpg)

or Tree-LSTM [13, 14] to extract user intentions from sequences, while others propose hierarchical explainable networks [34] to predict payment risks using critical historical behavioral sequences. More recent works [26] design a general user behavior modeling framework to pre-train users' behavior data and learn the robust representation for fraud detection. However, sequence-based methods often neglect user interactions, which are crucial for detecting over-consistent behavior patterns in real-world fraud scenarios. To address this, we propose a learning-based cohort augmentation method, which constructs personalized cohorts for each user based on the relevance of their behavioral sequences. In this manner, we can capture the subtle and dynamic patterns of fraudulent behaviors, and enhance the representation of each user.

## 6 CONCLUSIONS

This paper introduces VecAug, a label-aware cohort-augmented learning framework designed to enhance the fraud detection model's capability in revealing camouflaged frauds. Unlike conventional neighbor augmentation approaches, VecAug seamlessly integrates with existing models, offering a versatile solution to enrich user representations. VecAug incorporates a task-specific vector burnin technique, enabling it to select augmentation neighbors and negative neighbors automatically for each training user. To refine the aggregated cohort information, VecAug employs a label-aware neighbor separation mechanism, effectively distancing the negative neighbor representations in the augmented space. It addresses the limitations of conventional fraud detection methods by using learned behavior similarity instead of identity features to build connections between users, effectively handling noise and outliers, and explicitly considering label information during augmentation. Comprehensive experiments and evaluations have demonstrated VecAug's effectiveness and advantages in real-world fraud detection tasks. In summary, VecAug provides a robust approach to enhance the distinguishing ability of existing fraud detection models, providing a promising strategy for detecting camouflaged fraudsters.

## ACKNOWLEDGMENTS

This research is supported by Shopee Singapore Private Limited, the Singapore Economic Development Board, and the Singapore Ministry of Education Academic Research Fund Tier 3 under MOE's official grant number MOE2017-T3-1-007. The work of Meihui Zhang is supported by the National Natural Science Foundation of China (62072033).

## REFERENCES

- [1] Yikun Ban, Xin Liu, Yitao Duan, Xue Liu, and Wei Xu. 2019. No place to hide: Catching fraudulent entities in tensors. The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019 2 (2019), 83-93. https://doi.org/10. 1145/3308558.3313403 arXiv:1810.06230
- [2] Alex Beutel, Wanhong Xu, Venkatesan Guruswami, Christopher Palow, and Christos Faloutsos. 2013. CopyCatch: Stopping group attacks by spotting lockstep behavior in social networks. WWW2013 - Proceedings of the 22nd International Conference on World Wide Web (2013), 119-129.
- [3] Bernardo Branco, Pedro Abreu, Ana Sofia Gomes, Mariana S.C. Almeida, João Tiago Ascensão, and Pedro Bizarro. 2020. Interleaved Sequence RNNs for Fraud Detection. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2020), 3101-3109. https://doi.org/10. 1145/3394486.3403361 arXiv:2002.05988
- [4] Dawei Cheng, Sheng Xiang, Chencheng Shang, Yiyi Zhang, Fangzhou Yang, and Liqing Zhang. 2020. Spatio-Temporal Attention-Based Neural Network for Credit Card Fraud Detection. Proceedings of the AAAI Conference on Artificial Intelligence 34, 01 (2020), 362-369. https://doi.org/10.1609/aaai.v34i01.5371
- [5] Yingtong Dou, Zhiwei Liu, Li Sun, Yutong Deng, Hao Peng, and Philip S. Yu. 2020. Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsters. International Conference on Information and Knowledge Management, Proceedings (2020), 315-324. https://doi.org/10.1145/3340531.3411903 arXiv:2008.08692
- [6] Yingtong Dou, Guixiang Ma, Philip S. Yu, and Sihong Xie. 2020. Robust Spammer Detection by Nash Reinforcement Learning. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2020), 924-933. https://doi.org/10.1145/3394486.3403135 arXiv:2006.06069
- [7] Qingyu Guo, Pengrui Hui, Jiaming Huang, Zhao Li, Long Zhang, Bo An, and Mengchen Zhao. 2019. Securing the deep fraud detector in large-scale ecommerce platform via adversarial machine learning approach. The Web Conference 2019 - Proceedings of the World Wide Web Conference, WWW 2019 (2019), 616-626. https://doi.org/10.1145/3308558.3313533
- [8] William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems , Vol. 2017-Decem. 1025-1035. arXiv:1706.02216 http://arxiv.org/abs/1706.02216
- [9] Mengda Huang, Yang Liu, Xiang Ao, Kuan Li, Jianfeng Chi, Jinghua Feng, Hao Yang, and Qing He. 2022. AUC-oriented Graph Neural Network for Fraud Detection. WWW2022-Proceedings of the ACM Web Conference 2022 (2022), 1311-1321. https://doi.org/10.1145/3485447.3512178
- [10] Meng Jiang, Alex Beutel, Peng Cui, Bryan Hooi, Shiqiang Yang, and Christos Faloutsos. 2016. Spotting Suspicious Behaviors in Multimodal Data: A General Metric and Algorithms. IEEE Transactions on Knowledge and Data Engineering 28, 8 (2016), 2187-2200. https://doi.org/10.1109/TKDE.2016.2555310
- [11] Xurui Li, Wei Yu, Tianyu Luwang, Jianbin Zheng, Xuetao Qiu, Jintao Zhao, Lei Xia, and Yujiao Li. 2018. Transaction Fraud Detection Using GRU-centered Sandwich-structured Model. Proceedings of the 2018 IEEE 22nd International Conference on Computer Supported Cooperative Work in Design, CSCWD 2018 (2018), 761-766. https://doi.org/10.1109/CSCWD.2018.8465147 arXiv:1711.01434
- [12] Wangli Lin, Li Sun, Qiwei Zhong, Can Liu, Jinghua Feng, Xiang Ao, and Hao Yang. 2021. Online Credit Payment Fraud Detection via Structure-Aware Hierarchical Recurrent Neural Network. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence . International Joint Conferences on Artificial Intelligence Organization, 3670-3676. https://doi.org/10.24963/ijcai.2021/505
- [13] Can Liu, Li Sun, Xiang Ao, Jinghua Feng, Qing He, and Hao Yang. 2021. Intentionaware Heterogeneous Graph Attention Networks for Fraud Transactions Detection. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2021), 3280-3288. https://doi.org/10.1145/3447548. 3467142
- [14] Can Liu, Qiwei Zhong, Xiang Ao, Li Sun, Wangli Lin, Jinghua Feng, Qing He, and Jiayu Tang. 2020. Fraud Transactions Detection via Behavior Tree with Local Intention Calibration. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2020), 3035-3043. https://doi.org/10. 1145/3394486.3403354
- [15] Yang Liu, Xiang Ao, Zidi Qin, Jianfeng Chi, Jinghua Feng, Hao Yang, and Qing He. 2021. Pick and Choose: A GNN-based Imbalanced Learning Approach for Fraud Detection. The Web Conference (WWW) (2021), 3168-3177.
- [16] Ziqi Liu, Chaochao Chen, Longfei Li, Jun Zhou, Xiaolong Li, Le Song, and Yuan Qi. 2019. GeniePath: Graph Neural Networks with Adaptive Receptive Paths. Proceedings of the AAAI Conference on Artificial Intelligence 33, 0 (2019), 4424-4431. https://doi.org/10.1609/aaai.v33i01.33014424 arXiv:1802.00910
- [17] Ziqi Liu, Jun Zhou, Chaochao Chen, Xiaolong Li, Xinxing Yang, and Le Song. 2018. Heterogeneous graph neural networks for malicious account detection. International Conference on Information and Knowledge Management, Proceedings 1 (2018), 2077-2086. https://doi.org/10.1145/3269206.3272010 arXiv:2002.12307
- [18] Mike Schuster and Kuldip K. Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing 45, 11 (1997), 2673-2681. https://doi.org/10.1109/78.650093

Fei Xiao, Shaofeng Cai, Gang Chen, H. V. Jagadish, Beng Chin Ooi, and Meihui Zhang

- [19] Fengzhao Shi, Yanan Cao, Yanmin Shang, Yuchen Zhou, Chuan Zhou, and Jia Wu. 2022. H2-FDetector: A GNN-based Fraud Detector with Homophilic and Heterophilic Connections. WWW2022 - Proceedings of the ACM Web Conference 2022 (2022), 1486-1494. https://doi.org/10.1145/3485447.3512195
- [20] Petar Veličković, Arantxa Casanova, Pietro Liò, Guillem Cucurull, Adriana Romero, and Yoshua Bengio. 2018. Graph attention networks. 6th International Conference on Learning Representations, ICLR 2018 - Conference Track Proceedings (2018), 1-12. arXiv:1710.10903
- [21] Daixin Wang, Yuan Qi, Jianbin Lin, Peng Cui, Quanhui Jia, Zhen Wang, Yanming Fang, Quan Yu, Jun Zhou, and Shuang Yang. 2019. A semi-supervised graph attentive network for financial fraud detection. Proceedings - IEEE International Conference on Data Mining, ICDM 2019-Novem, 1 (2019), 598-607. https://doi. org/10.1109/ICDM.2019.00070 arXiv:2003.01171
- [22] Haishuai Wang, Zhao Li, Peng Zhang, Jiaming Huang, Pengrui Hui, Jian Liao, Ji Zhang, and Jiajun Bu. 2021. Live-Streaming Fraud Detection: A Heterogeneous Graph Neural Network Approach . Vol. 1. Association for Computing Machinery. 3670-3678 pages. https://doi.org/10.1145/3447548.3467065
- [23] Jianguo Wang, Xiaomeng Yi, Rentong Guo, Hai Jin, Peng Xu, Shengjun Li, Xiangyu Wang, Xiangzhou Guo, Chengming Li, Xiaohai Xu, Kun Yu, Yuxing Yuan, Yinghao Zou, Jiquan Long, Yudong Cai, Zhenxiang Li, Zhifeng Zhang, Yihua Mo, Jun Gu, Ruiyi Jiang, Yi Wei, and Charles Xie. 2021. Milvus: A Purpose-Built Vector Data Management System. Proceedings of the ACM SIGMOD International Conference on Management of Data (2021), 2614-2627. https://doi.org/10.1145/3448016.3457550
- [24] Meirui Wang, Zhumin Chen, Pengjie Ren, Jun Ma, Lei Mei, and Maarten De Rijke. 2019. A collaborative session-based recommendation approach with parallel memory modules. SIGIR 2019 - Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval July (2019), 345-354. https://doi.org/10.1145/3331184.3331210
- [25] Shuhao Wang, Cancheng Liu, Xiang Gao, Hongtao Qu, and Wei Xu. 2017. SessionBased Fraud Detection in Online E-Commerce Transactions Using Recurrent Neural Networks. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10536 LNAI (2017), 241-252. https://doi.org/10.1007/978-3-319-71273-4\_20
- [26] Ziming Wang, Qianru Wu, Baolin Zheng, Junjie Wang, Kaiyu Huang, and Yanjie Shi. 2023. Sequence As Genes: An User Behavior Modeling Framework for Fraud Transaction Detection in E-commerce. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2023), 51945203. https://doi.org/10.1145/3580305.3599905
- [27] Fei Xiao, Yuncheng Wu, Meihui Zhang, Gang Chen, and Beng Chin Ooi. 2023. MINT: Detecting Fraudulent Behaviors from Time-Series Relational Data. Proceedings of the VLDB Endowment 16, 12 (2023), 3610-3623. https://doi.org/10. 14778/3611540.3611551
- [28] Zhichao Yang, Shufan Wang, Bhanu Pratap Singh Rawat, Avijit Mitra, and Hong Yu. 2022. Knowledge Injected Prompt Based Fine-tuning for Multi-label Few-shot ICD Coding. Findings of the Association for Computational Linguistics: EMNLP 2022 (2022), 1767-1781. https://doi.org/10.18653/v1/2022.findings-emnlp.127 arXiv:2210.03304
- [29] Jianke Yu, Hanchen Wang, Xiaoyang Wang, Zhao Li, Lu Qin, Wenjie Zhang, Jian Liao, and Ying Zhang. 2023. Group-based Fraud Detection Network on e-Commerce Platforms. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 1 (2023), 5463-5475. https://doi.org/ 10.1145/3580305.3599836
- [30] Chaohe Zhang, Xin Gao, Liantao Ma, Yasha Wang, Jiangtao Wang, and Wen Tang. 2021. GRASP: Generic Framework for Health Status Representation Learning Based on Incorporating Knowledge from Similar Patients. 35th AAAI Conference on Artificial Intelligence, AAAI 2021 1 (2021), 715-723. https://doi.org/10.1609/ aaai.v35i1.16152
- [31] Dongyu Zhang, Liang Wang, Xin Dai, Shubham Jain, Junpeng Wang, Yujie Fan, Chin Chia Michael Yeh, Yan Zheng, Zhongfang Zhuang, and Wei Zhang. 2023. FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Data. International Conference on Information and Knowledge Management, Proceedings (2023), 3247-3256. https://doi.org/10.1145/3583780.3614879
- [32] Shijie Zhang, Hongzhi Yin, Tong Chen, Quoc Viet Nguyen Hung, Zi Huang, and Lizhen Cui. 2020. GCN-Based User Representation Learning for Unifying Robust Recommendation and Fraudster Detection. Dl (2020), 689-698. https: //doi.org/10.1145/3397271.3401165 arXiv:2005.10150
- [33] Panpan Zheng, Shuhan Yuan, and Xintao Wu. 2019. SAFE: A neural survival analysis model for fraud early detection. 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019 (2019), 1278-1285. https://doi.org/10.1609/aaai.v33i01.33011278 arXiv:1809.04683
- [34] Yongchun Zhu, Dongbo Xi, Bowen Song, Fuzhen Zhuang, Shuai Chen, Xi Gu, and Qing He. 2020. Modeling Users' Behavior Sequences with Hierarchical Explainable Network for Cross-domain Fraud Detection. The Web Conference 2020 - Proceedings of the World Wide Web Conference, WWW 2020 (2020), 928-938. https://doi.org/10.1145/3366423.3380172

## Algorithm 1: Vector Burn-in in VecAug

Input: Training data T train ; Auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) ; Output: Well-trained auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) ; Vector pool E 𝑝𝑜𝑜𝑙 .

- 1 for each epoch do
- 2 for each sample 𝑢 𝑖 ∈ T train do
- 3 Encode x 𝑖 to generate vectors: e 𝑖 = 𝑔 𝑎𝑢𝑥 ( x 𝑖 )
- 4 Generate prediction value: ˆ︁ y 𝑖 = 𝜙 𝑎𝑢𝑥 ( e 𝑖 )
- 5 Calculate the loss: L 𝑎𝑢𝑥 = loss ( ˆ︁ y 𝑖 , y 𝑖 )
- 6 Calculate the gradients: ∇L 𝑎𝑢𝑥 = 𝜕 L 𝑎𝑢𝑥 𝜕 w 𝑎𝑢𝑥
- 7 Update the model parameters:
- w 𝑎𝑢𝑥 = w 𝑎𝑢𝑥 -𝛼 ∇L 𝑎𝑢𝑥
- 8 for each sample 𝑢 𝑖 ∈ T train do
- 9 Perform a forward pass: e 𝑖 = 𝑔 𝑎𝑢𝑥 ( x 𝑖 )
- 10 Store the vectors and their corresponding labels in the vector database E 𝑝𝑜𝑜𝑙 : E 𝑝𝑜𝑜𝑙 .𝑎𝑑𝑑 ( e 𝑖 , y 𝑖 )
- 11 return 𝑔 𝑎𝑢𝑥 (·) , E 𝑝𝑜𝑜𝑙

## APPENDICES

## A PSEUDO-CODE OF VECAUG

Algorithm 1 provides a detailed pseudocode description of the vector burn-in technique employed by VecAug. This technique represents a fundamental aspect of VecAug's approach, effectively separating the optimization of embedding vectors from their utilization in subsequent cohort augmentation. Additionally, VecAug stores the label information of training samples, a crucial element that plays a significant role in the subsequent negative neighbor separation process, enhancing its overall effectiveness.

Onthe other hand, Algorithm 2 outlines the procedure for cohort identification and subsequent cohort-augmented training within the VecAug framework. To enhance clarity, certain steps, including contrastive loss calculation, and vector regularization, have been omitted for simplicity. During this process, it's essential to note that the parameters of auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) and the output layer used in the vector burn-in phase will remain fixed. This deliberate decision ensures the preservation of task-specific relevance between the target sample and the neighboring vectors, thereby facilitating the augmentation and separation of the representations between neighbors and target samples. Furthermore, by retaining well-trained neighborhood information, the augmented-training process becomes significantly more manageable in comparison to dynamic neighbor identification and augmentation methods. This design choice not only promotes computational efficiency but also contributes to the stability and effectiveness of VecAug in enhancing fraud detection.

## B MORE EXPERIMENTAL RESULTS

We also conducted experiments on two more methods widely compared recently, i.e., IHGAT [13] and FATA-Trans [31] to verify the effectiveness of VecAug. The results in Table 5 show that VecAug considerably improves the detection performance of these two representative methods across all three datasets, with AUC (1% increase is considered significant [13, 31]) and R@P0 9 . improvements up to

Algorithm 2: Cohort-augmented Training in VecAug

Input: Training data T train ; Vector pool E 𝑝𝑜𝑜𝑙 ; Well-trained auxiliary encoder 𝑔 𝑎𝑢𝑥 (·) ; Number of neighbors 𝐾 ; Output: Well-trained cohort augmentation model;

- 1 for each epoch do
- 2 for each sample 𝑢 𝑖 ∈ T train do
- 3 Perform a forward pass: e 𝑖 = 𝑔 𝑎𝑢𝑥 ( x 𝑖 )

4

Search top-

𝐾

similar cohort neighbors from

E

𝑝𝑜𝑜𝑙

for 𝑢 𝑖 , obtain E 𝑎 𝑖 : E 𝑎 𝑖 = search ( e 𝑖 , E 𝑝𝑜𝑜𝑙 )

Search top𝐾 similar vectors from E 𝑝𝑜𝑜𝑙 for 𝑢 𝑖 with different labels, obtain E 𝑛 𝑖 :

E 𝑛 𝑖 = search ( e 𝑖 , E 𝑝𝑜𝑜𝑙 , ye ≠ yu )

6

Encode x 𝑖 to generate representations: h 𝑖 = 𝑔 ( x 𝑖 )

- 7 Generate cohort-augmented logits:

𝑎

𝑎

𝑛

𝑖

ˆ︁

y

=

𝑓

(

h

𝑖

;

e

𝑖

;

E

𝑖

;

E

𝑖

;

W

𝑓

)

- 8 Calculate the loss: L 𝑎 𝑚𝑎𝑖𝑛 = loss ( ˆ︁ y 𝑎 𝑖 , y 𝑖 )
- 9 Compute the gradients: ∇L 𝑎 𝑚𝑎𝑖𝑛 = 𝜕 L 𝑚𝑎𝑖𝑛 𝜕 w 𝑎 𝑚𝑎𝑖𝑛

𝑎

- 10 Update the model parameters: w 𝑎 𝑚𝑎𝑖𝑛 = w 𝑎 𝑚𝑎𝑖𝑛 -𝛼 ∇L 𝑎 𝑚𝑎𝑖𝑛
- 11 return Well-trained cohort augmentation model
- 1.53% and 6.83%, respectively. These new results further validate the effectiveness of our cohort augmentation for fraud detection.

Table 5: Experimental results of IHGAT and FATA-Trans with and without VecAug.

| Datasets   | Metric    | IHGAT   | IHGAT   | IHGAT   | FATA-Trans   | FATA-Trans   | FATA-Trans   |
|------------|-----------|---------|---------|---------|--------------|--------------|--------------|
| Datasets   | Metric    | w/o     | w/      | Imprv.  | w/o          | w/           | Imprv.       |
|            | AUC       | 0.8571  | 0.8725  | 1.18%   | 0.8772       | 0.8875       | 1.17%        |
|            | R@P 0 . 9 | 0.4576  | 0.4861  | 6.23%   | 0.4893       | 0.5075       | 3.72%        |
|            | AUC       | 0.8785  | 0.8853  | 0.77%   | 0.8954       | 0.9091       | 1.53%        |
|            | R@P 0 . 9 | 0.5245  | 0.5428  | 3.49%   | 0.5517       | 0.5783       | 4.82%        |
|            | AUC       | 0.8823  | 0.8951  | 1.45%   | 0.8975       | 0.9102       | 1.42%        |
|            | R@P 0 . 9 | 0.2453  | 0.2566  | 4.61%   | 0.2767       | 0.2956       | 6.83%        |

## C VISUALIZATION OF VECAUG

We use t-SNE to visualize the user embeddings of a base model and its augmented version by VecAug, as shown in Figure 9. We apply the same t-SNE settings for both cases, with a Euclidean distance metric and a perplexity of 30. Unlike most existing methods that use contrastive loss on the encoder outputs, our proposed VecAug applies contrastive loss on the predicted logits. As a result, the cohort augmentation has a stronger effect on the first layer output of the output layer, which we use for visualization. From Figure 9, we observe that fraudulent users do not always form a single cluster, but rather are dispersed across multiple groups of varying sizes. This shows the variety and complexity of fraud schemes and user behaviors. Normal users also have different types of clusters, indicating their different preferences and habits. We also notice that the augmented model forms more distinct and compact clusters than the original base model. This is because the personalized

5

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-79700717-fe5c-498a-8a27-23208d3524ca.jpg)

Figure 9: Visualization of the first layer outputs of the output layer in the base BiLSTM model and its augmented model on the Amazon dataset. Fraudulent users are depicted in red, while normal users are depicted in green.

![image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00513v1-figure-6609d842-dd5c-4fc6-aeed-922ab35cb37a.jpg)

Table 6: VecAug performance across 𝛼 values on the Shopeesmall dataset.

| Model   |     |      0 |   0.00001 |   0.0001 |   𝛼 0.001 |   0.01 | 0.1 1         |
|---------|-----|--------|-----------|----------|-----------|--------|---------------|
| HEN     | w/o | 0.8611 |    0.8611 |   0.8611 |    0.8611 | 0.8611 | 0.8611 0.8611 |
| HEN     | w/  | 0.8671 |    0.8693 |   0.8716 |    0.873  | 0.8696 | 0.8654 0.8592 |
| MINT    | w/o | 0.8892 |    0.8892 |   0.8892 |    0.8892 | 0.8892 | 0.8892 0.8892 |
| MINT    | w/  | 0.8941 |    0.8953 |   0.8962 |    0.8971 | 0.8954 | 0.8937 0.8895 |

cohort augmentation can capture the similarities and differences among users, and create more homogeneous and isolated small clusters. Furthermore, the augmented model can better distinguish fraudulent cohorts from normal user groups, owing to both the enhanced clustering precision conferred by cohort augmentation and negative neighbor separation techniques. These techniques can push away similar but negative neighbors during the cohortaugmented training process, and make each cluster more cohesive and discriminative.

## D HYPER-PARAMETERS SETTINGS ON VECAUG

The hyperparameters 𝛼 and 𝛽 play a crucial role in VecAug's objective function. Specifically, they correspond to the weights of the supervised contrastive loss and auxiliary reconstruction loss, respectively. To provide a comprehensive understanding of how different settings of these hyperparameters affect the performance of VecAug, we conducted a detailed analysis. This analysis focused on evaluating the changes in model performance when varying the values of 𝛼 and 𝛽 . The experiments utilize base models HEN [34] and MINT [27] with Shopee-small dataset. The results are summarized in Table 6 and Table 7, and the analysis is presented as follows:

- · Study of 𝛼 : An increase in 𝛼 from its optimal value of 0.001 to 0.01 results in a marginal performance decline for both HEN with VecAug and MINT with VecAug. A further increase of 𝛼 to 1.0 leads to a more pronounced drop, due to an overemphasis on distinguishing training samples from negative neighbors, which could cause overfitting. On the other hand, a decrease in 𝛼 below 0.001 reduces the model's ability to counteract noise

Table 7: VecAug performance across 𝛽 values on the Shopeesmall dataset.

| Model   | 0          |   0.0000001 |   0.000001 |   𝛽 0.00001 | 0.0001 0.001   | 0.01          |
|---------|------------|-------------|------------|-------------|----------------|---------------|
| HEN     | w/o 0.8611 |      0.8611 |     0.8611 |      0.8611 | 0.8611         | 0.8611 0.8611 |
| HEN     | w/ 0.8713  |      0.8722 |     0.8727 |      0.873  | 0.8719         | 0.8678 0.8635 |
| MINT    | w/o 0.8892 |      0.8892 |     0.8892 |      0.8892 | 0.8892         | 0.8892 0.8892 |
| MINT    | w/ 0.8958  |      0.8964 |     0.8969 |      0.8971 | 0.8953 0.8936  | 0.8913        |

from negative neighbors, which will negatively impact VecAug's effectiveness.

- · Study of 𝛽 : Adjusting the hyperparameter 𝛽 also alters VecAug's performance. A higher 𝛽 diminishes the effectiveness of VecAug's cohort augmentation by aligning the main encoder too closely with the auxiliary encoder. This will limit the diversity and robustness that cohort augmentation is intended to introduce. Conversely, a reduction in 𝛽 leads to a slight decrease in effectiveness, which is mitigated by the use of burn-in vectors from augmentation neighbors to enhance target sample representations. These burn-in vectors help to enhance the representations of the target samples by introducing additional contextual information, which compensates to some extent for the decreased influence of the auxiliary reconstruction loss.

Overall, the performance of VecAug remains relatively stable across different hyperparameter values. An 𝛼 value of 0.001 and 𝛽 0.00001 achieve the best performance across different models. Hence, the objective function can be easily optimized without laborious hyperparameter tuning.

## E COMPUTATIONAL COMPLEXITY ANALYSIS OF VECAUG

The computational complexity of VecAug involves both time and space complexity. We denote the number of parameters 𝑃 , the number of stored sample embedding vectors as 𝑛 , the dimensionality of the embeddings as 𝑑 , and the number of neighbors as 𝑘 .

- · Time Complexity : The vector burn-in step's time complexity is determined by the base model, with a complexity of 𝑂 𝑇 ( ) . The cohort-augmented learning step's time complexity is mainly dominated by the augmented learning model and the attentive neighbor aggregation layer, with a complexity of 𝑂 𝑇 ( ) and 𝑂 𝑘 ( 2 ∗ 𝑑 ) , respectively. It also includes the search time for 𝑘 augmentation neighbors using the HNSW index, with a complexity of 𝑂 𝑘 ( ∗ 𝑙𝑜𝑔 𝑛 ( )) . So the time complexity should be 𝑂 𝑇 ( + 𝑘 2 ∗ 𝑑 + 𝑘 ∗ 𝑙𝑜𝑔 𝑛 ( )) .
- · Space Complexity : The space complexity in the vector burnin step is 𝑂 𝑃 ( ) . The cohort-augmented learning step involves storing burn-in vectors and constructing a graph-based index, leading to a complexity of 𝑂 𝑛𝑙𝑜𝑔 𝑛 ( ( ) + 𝑛𝑑 + 𝑃 ) . Therefore, the overall space complexity is 𝑂 𝑛𝑙𝑜𝑔 𝑛 ( ( ) + 𝑛𝑑 + 𝑃 ) .

Given that 𝑘 is set to 5, the embedding dimension 𝑑 is 64, and 𝑙𝑜𝑔 𝑛 ( ) is usually small, the time complexity is mainly determined by the model rather than cohort neighbor searching. The space complexity is dominated by the stored vector size and the model size, which are typically moderate in our anti-fraud system.
Fei Xiao Shaofeng Cai Gang Chen H. V. Jagadish Beng Chin Ooi Meihui Zhang
VecAug: Unveiling Camouflaged Frauds with Cohort Augmentation for Enhanced Detection
Fraud detection presents a challenging task characterized by ever-evolving
fraud patterns and scarce labeled data. Existing methods predominantly rely on
graph-based or sequence-based approaches. While graph-based approaches connect
users through shared entities to capture structural information, they remain
vulnerable to fraudsters who can disrupt or manipulate these connections. In
contrast, sequence-based approaches analyze users' behavioral patterns,
offering robustness against tampering but overlooking the interactions between
similar users. Inspired by cohort analysis in retention and healthcare, this
paper introduces VecAug, a novel cohort-augmented learning framework that
addresses these challenges by enhancing the representation learning of target
users with personalized cohort information. To this end, we first propose a
vector burn-in technique for automatic cohort identification, which retrieves a
task-specific cohort for each target user. Then, to fully exploit the cohort
information, we introduce an attentive cohort aggregation technique for
augmenting target user representations. To improve the robustness of such
cohort augmentation, we also propose a novel label-aware cohort neighbor
separation mechanism to distance negative cohort neighbors and calibrate the
aggregated cohort information. By integrating this cohort information with
target user representations, VecAug enhances the modeling capacity and
generalization capabilities of the model to be augmented. Our framework is
flexible and can be seamlessly integrated with existing fraud detection models.
We deploy our framework on e-commerce platforms and evaluate it on three fraud
detection datasets, and results show that VecAug improves the detection
performance of base models by up to 2.48\% in AUC and 22.5\% in R@P$_{0.9}$,
outperforming state-of-the-art methods significantly.