Named Entity Recognition (NER) for low-resource languages is a both practical and challenging research problem. This paper addresses zero-shot transfer for cross-lingual NER, especially when the amount of source-language training data is also limited. The paper first proposes a simple but effective labeled sequence translation method to translate source-language training data to target languages and avoids problems such as word order change and entity span determination. With the source-language data as well as the translated data, a generation-based multilingual data augmentation method is introduced to further increase diversity by generating synthetic labeled data in multiple languages. These augmented data enable the language model based NER models to generalize better with both the language-specific features from the target-language synthetic data and the language-independent features from multilingual synthetic data. An extensive set of experiments were conducted to demonstrate encouraging cross-lingual transfer performance of the new research on a wide variety of target languages. 1 1 Introduction Named entity recognition (NER) aims to identify and classify entities in a text into predefined types, which is an essential tool for information extraction. It has also been proven to be useful in various downstream natural language processing (NLP) tasks, including information retrieval (Banerjee et al., 2019), question answering (Fabbri et al., 2020) and text summarization (Nallapati et al., 2016). However, except for some resource-rich languages  Equal contribution, order decided by coin flip. Linlin Liu and Bosheng Ding are under the Joint PhD Program between Alibaba and Nanyang Technological University. (e.g., English, German), training sets for most of the other languages are still very limited. Moreover, it is usually expensive and time-consuming to annotate such data, particularly for low-resource languages (Kruengkrai et al., 2020). Therefore, zero-shot cross-lingual NER has attracted growing interest recently, especially with the influx of deep learning methods (Mayhew et al., 2017; Joty et al., 2017; Jain et al., 2019; Bari et al., 2021). Existing approaches to cross-lingual NER can be roughly grouped into two main categories: instance-based transfer via machine translation (MT) and label projection (Mayhew et al., 2017; Jain et al., 2019), and model-based transfer with aligned cross-lingual word representations or pretrained multilingual language models (Joty et al., 2017; Baumann, 2019; Wang et al., 2020; Conneau et al., 2020; Bari et al., 2021). Recently, Wu et al. (2020) unify instance-based and model-based transfer via knowledge distillation. These recent methods have demonstrated promising zero-shot cross-lingual NER performance. However, most of them assume the availability of a considerable amount of training data in the source language. When we reduce the size of the training data, we observe significant performance decrease. For instance-based transfer, decreasing training set size also amplifies the negative impact of the noise introduced by MT and label projection. For model-based transfer, although the large-scale pretrained multilingual language models (LM) (Con-neau et al., 2020; Liu et al., 2020) have achieved state-of-the-art performance on many cross-lingual transfer tasks, simply fine-tuning them on a small training set is prone to over-fitting (Wu et al., 2018; Si et al., 2020; Kou et al., 2020). To address the above problems under the setting of low-resource cross-lingual NER, we propose a multilingual data augmentation (MulDA) framework to make better use of the cross-lingual generalization ability of the pretrained multilingual LMs. Specifically, we consider a low-resource setting for cross-lingual NER, where there is very limited source-language training data and no target-language train/dev data. Such setting is practical and useful in many real scenarios. Our proposed framework seeks the initial help from the instance-based transfer (i.e., translate train) paradigm (Li et al., 2020; Fang et al., 2020). We first introduce a novel labeled sequence translation method to translate the training data to the target language as well as to other languages. This allows us to finetune the LM based NER model on multilingual data rather than on the source-language data only, which helps prevent over-fitting on the language-specific features. One commonly used tool for translation is the off-the-shelf Google translate system 2 , which supports more than 100 languages. Alternatively, there are also many pretrained MT models conveniently accessible, e.g., more than 1,000 MarianMT (Junczys-Dowmunt et al., 2018; Kim et al., 2019) models have been released on the Hugging Face model hub. 3 Note that the instance-based transfer methods add limited semantic variety to the training set, since they only translate entities and the corresponding contexts to a different language. In contrast, data augmentation has been proven to be a successful method for tackling the data scarcity problem. Inspired by a recent monolingual data augmentation method (Ding et al., 2020), we propose a generation-based multilingual data augmentation method to increase the diversity, where LMs are trained on multilingual labeled data and then used to generate more synthetic training data. We conduct extensive experiments and analysis to verify the effectiveness of our methods. Our main contributions can be summarized as follows:  We propose a simple but effective labeled sequence translation method to translate the source training data to a desired language. Compared with exiting methods, our labeled sentence translation approach leverages placeholders for label projection, which effectively avoids many issues faced during word alignment, such as word order change, entity span determination, noise-sensitive similarity metrics and so on. augmentation method for NER, which leverages the multilingual language models to add more diversity to the training data. Through empirical experiments, we observe that when fine-tuning pretrained multilingual LMs for low-resource cross-lingual NER, translations to more languages can also be used as an effective data augmentation method, which helps improve performance of both the source and the target languages. We propose a multilingual data augmentation framework that leverages the advantages of both instance-based and model-based transfer for cross-lingual NER. In our framework, a novel labeled sequence translation method is first introduced to translate the annotated training data from the source language S to a set of target languages T = { T 1 , . . . , T n } . Then language models are trained on {D S , DT 1 , ..., DT n } to generate multilingual synthetic data, where DS is the source-language training data, and DT i is the translated data in language T i . Finally, we post-process and filter the augmented data to train multilingual NER models for inference on target-language test sets. We leverage labeled sequence translation for the training data of the source language to generate multilingual NER training data, which can also be viewed a method for data augmentation. Prior methods (Jain et al., 2019; Li et al., 2020) usually perform translation and label projection in two separate steps: 1) translate source-language training sentences to the target language; 2) propagate labels from the source training data to the translated sentences via word-to-word/phrase-to-phrase mapping with alignment models or algorithms. However, these methods suffer from a few label projection problems, such as word order change, word-span determination (Li et al., 2020), and so on. An alternative to avoid the label projection problems is word-by-word translation (Xie et al., 2018), but often at the sacrifice of the translation quality. We address the problems identified above by first replacing named entities with contextual placeholders before sentence translation, and then after translation, we replace placeholders in translated Labeled sentence in the source language: [PER Jamie Valentine] was born in [LOC London]. 1. Translate sentence with placeholders: src: PER0 was born in LOC1. tgt: PER0 nacio en LOC1. LOC1 src: Jamie Valentine was born in [London]. tgt: Jamie Valentine nacio en [Londres]. 2. Translate entities with context: PER0 src: [Jamie Valentine] was born in London. tgt: [Jamie Valentine] nacio en Londres. An illustration of the method is shown in Figure 1. Assume a sentence XS = { x 1 , . . . , x M }  DS and the corresponding NER tags { y 1 , . . . , y M } are given, where x i 's are the sentence tokens and M is the sentence length. Let { E 1 , . . . , E n } denote the predefined named entity types. Our method first replaces all entities in { x 1 , . . . , x M } with placeholders ( src of step 1 in Figure 1). Placeholders Ek are reconstructed tokens with the corresponding entity type E as prefix and the index of the entity k as suffix. Assume { x i , . . . , x j } is the k th entity in the source sentence, and the corresponding type is E z , then we can replace the entity with the placeholder E z k to get { . . . , x i  1 , E z k, x j +1 , . . . } . We use XS  to denote the generated sentence after replacing all entities with placeholders. XS  is fed into an MT model to get the translation XT  in the target language T . With such design, the placeholder prefix E can provide the MT model 4 with relevant contextual information about the entities, so that the model can translate the sentence with reasonably good quality. Besides, we observe most of placeholders are unchanged after translation, 5 which can be used to help locate the position of entities. In the second step, we translate each entity 4 When the MT model use subword vocabularies. B-PER Jamie E-PER Valentine was born in S-LOC London with the corresponding context. More specifi-cally, we use brackets to mark the span of each entity and translate it to the target language successively, one at a time ( src of step 2 in Figure 1). For example, to translate entity { x i , . . . , x j } , we feed { . . . , x i  1 , [ x i , . . . , x j ] , x j +1 , . . . } into the MT model. Then we can get entity translations by extracting the square bracket marked tokens from the translated sentences. We translate the entities directly if the square brackets are not found. Finally, we can replace placeholders in XT  (ob-tained from the first step) with the corresponding entity translations (obtained from the second step) and copy placeholder prefix as entity labels to generate the synthetic training data in the target language (step 3 in Figure 1). We tested the proposed method with Google translate and the MarianMT (Junczys-Dowmunt et al., 2018; Kim et al., 2019) models, and we found that both produce high quality synthetic data as we had expected. Although labeled sequence translation generates high quality multilingual NER training data, it adds limited variety since translation does not introduce new entities or contexts. Inspired by DAGA (Ding et al., 2020), we propose a generation-based multilingual data augmentation method to add more diversity to the training data. DAGA is a monolingual data augmentation method designed for sequence labeling tasks, which has been shown to be able to add significant diversity to the training data. As the example shown in Figure 2, it first linearizes labeled sequences by adding the entity type before sentence tokens. Then an LSTM-based LM (LSTM-LM) is trained on the linearized sequences in an autoregressive way, after which the begin-of-sentence token [BOS] is fed into the LSTM-LM to generate synthetic training data autoregressively. The monolingual LSTM-LM of DAGA is trained in a similar way as the example shown in Figure 3, except that there is no language tag [en] . To extend this method for multilingual data augmentation, we add special tokens at the beginning of each sentence to indicate the language that it belongs to. The source-language data and the multilingual data obtained via translation are concatenated to train/finetune multilingual LMs with a shared vocabulary (as shown in Figure 5). Given a labeled sequence { x 1 , . . . , x M } from the multilingual training data, the LMs are trained to maximize the probability p ( x 1 , . . . , x M ) in Eq. 1: p ( x 1 , . . . , x M ) = M (cid:89) t =1 p  ( x t | x <t ) (1) where  is the parameter to optimize, and p  ( x t | x <t ) is the probability of the next token given the previous tokens in the sequence, which is usually computed with the softmax function. Figure 3 shows an example of how the multilingual LSTM-LM is trained in the autoregressive way. After training the LSTM-LM, we can feed the [BOS] token and a language token to the model to generate synthetic training data for the specified language. Besides, to leverage the cross-lingual generalization ability of large scale pretrained multilingual LMs, we also finetune a recent state-of-the-art seq2seq model mBART (Liu et al., 2020), which is pretrained with multilingual denoising tasks. Sentence permutation and word-span masking are the two noise injection methods used to add noise to original sentence X = { x 1 , . . . , x M } to output g ( X ) , where g ( . ) is used to denote the noise injection function. After encoding g ( X ) with the Transformer encoder, the Transformer decoder is trained to generate the original sequence X autore-gressively by maximizing Eq. 1. Denoising word-span masked sequences is the most relevant to our data augmentation method, since only small modifications are required to make our finetuning task as consistent to the pretraining task as possible. More specifically, we design our finetuning task with the following changes: 1) use the linearized labeled sequences (as shown in Figure 5) as input X ; 2) modify g ( . ) to mask random trailing sub-sequences such that g ( X ) = { x 1 , . . . , x z , [ mask ] } , where 1  z  | X | is a random integer. After finetuning with such task, we can conveniently feed a randomly masked sequence { x 1 , . . . , x z , [ mask ] } into mBART to generate synthetic data. Figure 4 shows a more concrete example to illustrate how mBART is finetuned with the linearized sequences in our work. Unlabeled multilingual sentences are usually easy to get, for example, data from the Wikimedia 6 . To make better use of these unlabeled multilingual data, we propose a semi-supervised method to prepare more pseudo labeled data for finetuning multilingual LMs. Inspired by self-training (Zoph et al., 2020; Xie et al., 2020), we use the NER model trained on the multilingual translated data to annotate the unlabeled sentences. After that, we use two additional NER models trained with different random seeds to filter the annotated data by removing those with different tag predictions. We also design several straightforward methods to post-process and filter the augmented data generated by the LMs: Convert the generated labeled sequences to the same format as gold data by separating sentence tokens and NER tags. Use the NER model trained on the multilingual translated data to label the generated sequences (after tag removal). Then compare the tags generated by the LM and NER model predictions, and remove the sentences with inconsistencies. We conduct experiments to evaluate the effectiveness of the proposed multilingual data augmentation framework. Firstly, we compare our labeled sequence translation method with the previous instance-based transfer (i.e., translate train) methods. Following that, we show the benefit of adding multilingual translations. Then we continue 6 https://dumps.wikimedia.org/ Figure 4: Finetune mBART with the linearized sequences. [BOS] [en] B-PER Jamie E-PER Valentine was born in S-LOC London. [BOS] [de] B-PER Jamie E-PER Valentine wurde in S-LOC London geboren. [BOS] [es] B-PER Jamie E-PER Valentine nacio en S-LOC Londres. [BOS] [nl] B-PER Jamie E-PER Valentine werd geboren in S-LOC Londen. ... to evaluate the generation-based multilingual data augmentation method by comparing cross-lingual NER performance of the models trained on monolingual, bilingual, and multilingual augmented data, respectively. Finally, we further evaluate our methods on a wider range of distant languages. We use the most typical Transformer-based NER model 7 in our experiments, which is implemented by adding a randomly initialized feed forward layer to the Transformer final layer for label classification. Specifically, to demonstrate that our framework can help achieve additional performance gain even on the top of the state-of-the-art multilingual LMs, the checkpoint of the pretrained XLM-R large (Conneau et al., 2020) model is used to initialize our NER models. We finetune the NER model on the translated target-language data to compare our labeled sequence translation method (2.1) with the existing instance-based transfer methods. Experimental settings The CoNLL02/03 NER dataset (Tjong Kim Sang, 2002; Tjong Kim Sang and De Meulder, 2003) is used for evaluation, which contains data in four different languages: English, German, Dutch and Spanish. All of the data are annotated with the same set of NER tags. We follow the steps described in 2.1 to translate En-7 Similar to the token classification model in https://github.com/huggingface/transformers. glish train data to the other three languages. Following Jain et al. (2019) and Li et al. (2020), Google translation system is used in the experiments. Since our NER model is more powerful than those used by Jain et al. (2019) and Li et al. (2020), we reproduce their results with XLM-R large for a fair comparison. All of the NER models are finetuned on the translated target-language sentences only for 10 epochs with the best model selected using English dev data, and then evaluated on the target-language original test data. Results We present the results in Table 1. As we can see, our method outperforms the best baseline method by 2.90 and 2.97 on German and Dutch respectively, and by 2.23 on average. Since our models are only finetuned with the data generated by the labeled sequence translation method, the results directly demonstrate the effectiveness of our method. Moreover, compared with the two recent baseline methods (Jain et al., 2019; Li et al., 2020), our method does not rely on complex label projection algorithms and is much easier to implement. After showing that our labeled sequence translation method can generate high quality labeled data in the target language, in this section, we run experiments experiments to verify the hypothesis that multilingual multilingual translation may help improve the cross-lingual transfer performance of multilingual LMs in low resource scenarios. Experimental settings We use the same NER dataset as above. In order to simulate low resource scenarios, we randomly sample 500, 1k and 2k sentences from the gold English train set. Our labeled sequence translation method is used to translate the sampled data to pseudo labeled data in the three target languages, German, Spanish and Dutch. To better demonstrate how the training data affects cross-lingual NER performance, we train the NER model on four different conditions: 1) En : train the models on English data only; 2) Tgt-Tran : train the models on the pseudo labeled data in a certain target language only; 3) En + Tgt-Tran : train the models on the combination of English data and pseudo labeled target-language data; 4) En + Multi-Tran : train one single model on the combination of English data and pseudo labeled data in all three target languages. We find filter-ing the translated sentences can further improve cross-lingual transfer performance, so we use an NER model trained on the sampled English data to label the translated sentences, count the number of entities in each sentence different from NER model predictions, and then remove the top 20% sentences with the most inconsistent entities. This is similar to the third step described in 2.4, except that we remove all the inconsistent sentences from the augmented data, since the LMs can be used to generate a large number of candidate sentences. We set max number of epochs to 10 and use 500 sentences randomly sampled from the English dev data to select the best models for each setting. Then the best models are evaluated on the original target language test sets. Results Table 2 compares the cross-lingual NER performance of the models trained on the different training sets. Although the performances of En and Tgt-Tran are relatively bad in most of the cases, combining them can always boost the performance significantly, especially when the dataset size is small. Adding multilingual translated data further improves cross-lingual performance by more than 1% on average when English data size is 1k or less. Therefore, multilingual translation can be used as an effective data augmentation approach in the low resource scenarios of cross-lingual NER. Moreover, En Size Method de es nl avg 500 En 60.18 55.68 66.09 60.65 Tgt-Tran 59.97 53.53 60.39 57.96 En + Tgt-Tran 69.16 64.57 71.40 68.38 En + Multi-Tran 70.40 65.70 72.20 69.43 1k En 68.95 67.3 73.43 69.89 Tgt-Tran 70.3 67.22 73.98 70.50 En + Tgt-Tran 73.63 69.81 75.83 73.09 En + Multi-Tran 73.42 72.71 76.74 74.29 2k En 69.47 75.2 77.64 74.10 Tgt-Tran 71.93 72.94 77.95 74.27 En + Tgt-Tran 74.45 75.88 78.40 76.24 En + Multi-Tran 75.91 76.04 77.85 76.60 Table 2: Cross-lingual NER performance of the models trained on different combinations of training sets. the trained single model with En + Multi-Tran can be applied to all target languages. Besides, we also observe that multilingual translated data can even help improve NER performance of the source language. Table 3 summarizes English test data results for the above settings. Tgt-Tran (avg) is the average English results of the models trained on three different Tgt-Tran of German, Spanish and Dutch respectively. En + Tgt-Tran (avg) is the average for combining En with each of the three different Tgt-Tran. As we can see, adding additional translated data consistently improves English NER performance. Particularly, En + Multi-Tran achieves the best performance. Therefore, we can also use multilingual translated data to improve low-resource monolingual NER performance. In this section, we run experiments to verify whether applying generation-based data augmentation methods to the multilingual translated data can further improve cross-lingual performance in the low resource scenarios. Experimental settings We follow the steps described in 2.2 to implement the proposed data augmentation framework on top of LSTM-LM (Kru-engkrai, 2019) and mBART (Liu et al., 2020) sep-500 1k 2k Method de es nl avg de es nl avg de es nl avg En + Multi-Tran 70.40 65.70 72.20 69.43 73.42 72.71 76.74 74.29 75.91 76.04 77.85 76.60 MulDA-LSTM 70.04 67.38 72.81 70.08 74.80 74.27 77.21 75.42 76.05 76.05 78.46 76.85 MulDA-mBART 72.37 68.19 74.59 71.72 75.04 74.56 77.78 75.79 77.54 76.32 78.21 77.36 En + Tgt-Tran 69.16 64.57 71.40 68.38 73.63 69.81 75.83 73.09 74.45 75.88 78.40 76.24 BiDA-LSTM 72.51 68.77 72.65 71.31 74.97 73.69 77.51 75.39 76.59 76.47 78.97 77.34 Table 4: Cross-lingual NER results of models trained on multilingual augmented data. arately, and then use them to augment the data processed in 3.2. We concatenate English gold data and the filtered multilingual translated data to train/finetune the modified LMs, where LSTM-LM is trained from scratch and mBART is intialized with the mBART CC25 checkpoint 8 for finetuning. mBART CC25 is a model with 12 encoder and decoder layers trained on 25 languages. We follow the steps described in 2.4 to post-process the augmented data, and concatenate them with the corresponding English gold and translated multilingual data to train the NER models. The size of the augmented data used in each setting is the same as the size of the corresponding English gold data. MulDA-LSTM and MulDA-mBART are used to denote the methods that use LSTM-LM and mBART augmented data respectively. In addition, we also report a bilingual version of our method, denoted with BiDA-LSTM, which performs data augmentation on English and the translated target-language data only. We follow the same settings as above to evaluate cross-lingual performance of the NER models trained on different data. Results Average results of 5 runs are reported in Table 4. Note that MulDA-LSTM and MulDA-mBART train a single model for all the target languages in each setting, while BiDA-LSTM trains one model for each target language in each setting. Therefore, we compare BiDA-LSTM with 8 https://github.com/pytorch/fairseq/blob/master/ examples/mbart/README.md En + Tgt-Tran only. As we can see, the proposed multilingual data augmentation methods further improve cross-lingual NER performance consistently. For the 1k and 2k setting, MulDA-LSTM achieves comparable average performance as BiDA-LSTM. Experimental settings The Wikiann NER data (Pan et al., 2017) processed by Hu et al. (2020) is used in these experiments. 1k English sentences ( DS 1 k ) are sampled from the gold train data to simulate the low resource scenarios. We also assume MT models are not available for all of the target languages, so we only translate the sampled English sentences to 6 target languages: ar, fr, it, ja, tr and zh. DT trans is used to denote the translated target-language sentences by following steps described in 2.1. The low quality translated sentences are filtered out in the same way as 3.2. To evaluate our method in the semi-supervised setting, we also sample 5,000 sentences from the training data of the 6 target languages and then remove the NER tags to create unlabeled data D Tunlabeled . We follow the steps described in 2.3 to annotate D Tunlabeled with one NER model trained on {D S 1 k , D Ttrans } , and then filter the pseudo labeled data with two other NER models trained on the same data but with different random seeds. We use D Tsemi to denote the data generated with this semi-supervised approach. Finally, we concatenate {D S 1 k , D Ttrans , D Tsemi } to generate augmented data D Taug following the steps in 2.2 and 2.4. With the augmented data above, we train NER models on the concatenated data of {D S 1 k , D Ttrans , D Taug } for cross-lingual NER evaluation. We also train an NER model on {D S 1 k , D Ttrans , D Tsemi } for comparison, denoted as Weak Tagger . The other settings are same as the above experiments. Results We summarize the results in Table 6. Tran-Train is the average performance of the 6 languages that have corresponding training data translated from English. Zero Shot is the average performance of the other target languages. MulDA-LSTM demonstrates promising performance improvements on both the Tran-Train and Zero Shot languages. The performance of MulDA-mBART is slightly lower, one possible reason is the noise introduced by the sentences labeled at character level. We follow the gold data format to label translated zh and ja sequences at character level, which is inconsistent with how mBART is pretrained. Please refer to Table 5 for the detailed cross-lingual NER results of each language. The label projection step of the previous methods needs to locate the entities and determine their boundaries, which is vulnerable to many problems, such as word order change, long entities, etc. Our method effectively avoids these problems with placeholders. In the two examples shown in Figure 6, Jain et al. (2019) either labeled only part of the whole entity or incorrectly split the entity into two, Li et al. (2020) incorrectly split the entities into two in both examples, while our method can correctly map the labels. ...(ORG Association for Relations Across the Taiwan Straits) ... Jain et al. (2019): ...(ORG Vereinigung fur Beziehungen) uber die Taiwanstrae ... Li et al. (2020): ...(ORG Vereinigung fur Beziehungen) uber (ORG die Taiwanstrae) ... Ours: ...(ORG Vereinigung fur Beziehungen uber die Taiwanstrae) ... Ours: ...(LOC Mittlerer Westen der USA) ... the NER tags can be viewed as a shared vocabulary between different languages. As a result, we find that some generated sentences contain tokens from multiple languages, which are useful to help improve cross-lingual transfer (Tan and Joty, 2021). Two examples are shown in Figure 7. 4 Related Work Cross-lingual NER There has been growing interest in cross-lingual NER. Prior approaches can be grouped into two main categories, instance-based transfer and model-based transfer. Instance-based transfer translates source-language training data to target language, and then apply label projection to annotate the translated data (Tiedemann et al., 2014; Jain et al., 2019). Instead of MT, some earlier approaches also use parallel corpora to construct pseudo training data in the target language (Yarowsky et al., 2001; Fu et al., 2014). To minimize resource requirement, Mayhew et al. (2017) and Xie et al. (2018) design frameworks that only rely on word-to-word/phrase-to-phrase translation with bilingual dictionaries. Besides, there are also many studies on improving label projection quality with additional feature or better mapping methods (Tsai et al., 2016; Li et al., 2020). Different from these methods, our labeled sentence translation approach leverages placeholders to determine the position of entities after translation, which effectively avoids many issues during label projection, such as word order change, entity span determination, noise-sensitive similarity metrics and so on. Model-based transfer directly applies the model trained on the source language to the target-language test data (Tackstrom et al., 2012; Ni et al., 2017; Joty et al., 2017; Chaudhary et al., 2018), which heavily relies on the quality of cross-lingual representations. Recent methods have achieved significant performance improvement by fine-tuning large scale pretrained multilingual LMs (Devlin et al., 2019; Keung et al., 2019; Conneau et al., 2020). Besides, there are also some approaches that combine instance-based and model-based transfer (Xu et al., 2020; Wu et al., 2020). Compared with these methods, our approach leverages MT models and LMs to add more diversity to the training data, and prevents over-fitting on language-specific features by fine-tuning NER models on multilingual data. Data augmentation Data augmentation (Simard et al., 1998) adds more diversity to training data to help improve model generalization, which has been widely used in many fields, such as computer vision (Zhang et al., 2018), speech (Cui et al., 2015; Park et al., 2019), NLP (Wang and Eisner, 2016; Sun et al., 2020) and so on. For NLP, back translation (Sennrich et al., 2016) is one of the most successful data augmentation approaches, which translates target-language monolingual data to the source language to generate more parallel data for MT model training. Other popular approaches include synonym replacement (Kobayashi, 2018), random deletion/swap/insertion (Sun et al., 2020; Kumar et al., 2020), generation (Ding et al., 2020), etc. Data augmentation has also been proven to be useful in the cross-lingual settings (Zhang et al., 2019; Singh et al., 2020; Riabi et al., 2020; Qin et al., 2020; Bari et al., 2021; Mohiuddin et al., 2021), but most of the exiting methods overlook the better utilization of multilingual training data when such resources are available. NER. Our labeled sequence translation method effectively avoids many label projection related problems by leveraging placeholders during MT. Our generation-based multilingual data augmentation method generates high quality synthetic training data to add more diversity. The proposed framework has demonstrated encouraging performance improvement in various low-resource settings and across a wide range of target languages. This research is partly supported by the Alibaba-NTU Singapore Joint Research Institute, Nanyang Technological University. Linlin Liu would like to thank the support from Interdisciplinary Graduate School, Nanyang Technological University. We would like to thank the help from our Alibaba colleagues, Ruidan He and Qingyu Tan in this work as well.
abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain other abstain abstain abstain result abstain other objective method abstain abstain objective method abstain abstain abstain abstain abstain result objective method objective result objective objective abstain objective method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method method abstain abstain abstain abstain abstain abstain method abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method method abstain abstain method other method abstain abstain method method method abstain abstain abstain abstain abstain abstain result other abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain other abstain abstain result abstain result result abstain abstain result abstain abstain abstain abstain abstain other result abstain abstain abstain abstain abstain abstain abstain other abstain result abstain abstain abstain result abstain result result other abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain other abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain result abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method other abstain abstain abstain abstain method abstain other other other