The performance of multilingual pretrained models is highly dependent on the availability of monolingual or parallel text present in a target language. Thus, the majority of the world's languages cannot benefit from recent progress in NLP as they have no or limited textual data. To expand possibilities of using NLP technology in these under-represented languages, we systematically study strategies that relax the reliance on conventional language resources through the use of bilingual lexicons, an alternative resource with much better language coverage. We analyze different strategies to synthesize textual or labeled data using lexicons, and how this data can be combined with monolingual or parallel text when available. For 19 under-represented languages across 3 tasks, our methods lead to consistent improvements of up to 5 and 15 points with and without extra monolingual text respectively. Overall, our study highlights how NLP methods can be adapted to thousands more languages that are under-served by current technology. 1 1 Introduction Multilingual pretrained models (Devlin et al., 2019; Conneau and Lample, 2019; Conneau et al., 2020) have become an essential method for cross-lingual transfer on a variety of NLP tasks (Pires et al., 2019; Wu and Dredze, 2019). These models can be finetuned on annotated data of a down-stream task in a high-resource language, often English, and then the resulting model is applied to other languages. This paradigm is supposed to benefit under-represented languages that do not have annotated data. However, recent studies have found that the cross-lingual transfer performance of a language is highly contingent on the availability of monolingual data in the language during pretraining (Hu et al., 2020). Languages with more 1 Code and data are available at: https: //github.com/cindyxinyiwang/expand-via-lexicon-based-adaptation . Several works propose methods to adapt the pretrained multilingual models to low-resource languages, but these generally involve continued training using monolingual text from these languages (Wang et al., 2020; Chau et al., 2020; Pfeiffer et al., 2020, 2021). Therefore, the performance of these methods is still constrained by the amount of monolingual or parallel text available, making it difficult for languages with little or no textual data to benefit from the progress in pretrained models. Joshi et al. (2020) indeed argue that unsupervised pretraining makes the resource-poor poorer'. Fig. 1 plots the language coverage of multilingual BERT (mBERT; Devlin et al., 2019), a widely used pre-trained model, and several commonly used textual data sources. 2 Among the 7,000 languages in the world, mBERT only covers about 1% of the languages while Wikipedia and CommonCrawl, the two most common resources used for pretraining and adaptation, only contain textual data from 4% of the languages (often in quite small quantities, partially because language IDs are difficult to obtain for low-resource languages (Caswell et al., 2020)). Ebrahimi and Kann (2021) show that continued pretraining of multilingual models on a small amount of Bible data can significantly improve the performance of uncovered languages. Although the Bible has much better language coverage of 23% , its relatively small data size and 2 Statistics taken from Ebrahimi and Kann (2021) and panlex.org . constrained domain limits its utility (see  6)and 70% of the world's languages do not even have this resource. The failure of technology to adapt to these situations raises grave concerns regarding the fairness of allocation of any benefit that may be conferred by NLP to speakers of these languages (Joshi et al., 2020; Blasi et al., 2021). On the other hand, linguists have been studying and documenting under-represented languages for years in a variety of formats (Gippert et al., 2006). Among these, bilingual lexicons or word lists are usually one of the first products of language documentation, and thus have much better coverage of the worlds' languages than easily accessible monolingual text, as shown in Fig. 1. There are also ongoing efforts to create these word lists for even more languages through methodologies such as rapid word col-lection (Boerger, 2017), which can create an extensive lexicon for a new language in a number of days. As Bird (2020) notes: After centuries of colonisation, missionary endeavours, and linguistic fieldwork, all languages have been identified and classified. There is always a wordlist. . . . In short, we do not need to discover the language ex nihilo (L1 acquisition) but to leverage the available resources (L2 acquisition). However, there are few efforts on understanding the best strategy to utilize this valuable resource for adapting pretrained language models. Bilingual lexicons have been used to synthesize bilingual data for learning cross-lingual word embeddings (Gouws and Sgaard, 2015; Ruder et al., 2019) and task data for NER via word-to-word translation (Mayhew et al., 2017), but both approaches precede the adoption of pre-trained multilingual LMs. Khemchandani et al. (2021) use lexicons to synthesize monolingual data for adapting LMs, but their experimentation is limited to several Indian languages and no attempt was made to synthesize downstream task data while Hu et al. (2021) argue that bilingual lexicons may hurt performance. In this paper, we conduct a systematic study of strategies to leverage this relatively under-studied resource of bilingual lexicons to adapt pretrained multilingual models to languages with little or no monolingual data. Utilizing lexicons from an open-source database, we create synthetic data for both continued pretraining and downstream Figure 2: Results for baselines and adaptation using synthetic data for both resource settings across three NLP tasks. task fine-tuning via word-to-word translation. Empirical results on 19 under-represented languages on 3 different tasks demonstrate that using synthetic data leads to significant improvements on all tasks (Fig. 2), and that the best strategy depends on the availability of monolingual data ( 5,  6). We further investigate methods that improve the quality of the synthetic data through a small amount of parallel data or by model distillation. We focus on the cross-lingual transfer setting where the goal is to maximize performance on a downstream task in a target language T . Due to the frequent unavailability of labeled data in the target language, a pretrained multilingual model M is typically fine-tuned on labeled data in the downstream task D Slabel = { ( x Si , y Si ) } Ni =1 in a source language S where x Si is a textual input, y Si is the label, and N is the number of labeled examples. The fine-tuned model is then directly applied to task data D Ttest = { x Ti , y Ti } i in language T at test time. 3 The performance on the target language T can often be improved by further adaptation of the pretrained model. There are two widely adopted paradigms for adapting pretrained models to a target language using monolingual or parallel text. MLM Continued pretraining on monolingual text D Tmono = { x Ti } i in the target language (Howard and Ruder, 2018; Gururangan et al., 2020) using a masked language model (MLM) objective has proven effective for adapting models to the target language (Pfeiffer et al., 2020). Notably, Ebrahimi and Kann (2021) show that using as little as several thousand sentences can significantly improve the model's performance on target languages not covered during pretraining. Trans-Train For target languages with sufficient parallel text with the source language D STpar = { ( x Si , x Ti ) } i , one can train a machine translation (MT) system that translates data from the source language into the target language. Using such an MT system, we can translate the labeled data in the source language D Slabel into target language data (cid:98) D Tlabel = { ( (cid:98) x Ti , y Si ) } Ni =1 , and fine-tune the pretrained multilingual model on both the source and translated labeled data D Slabel  (cid:98) D Tlabel . This method often brings significant gains to the target language, especially for languages with high-quality MT systems (Hu et al., 2020; Ruder et al., 2021). Both methods above require D Tmono or D STpar in target language T , so they cannot be directly extended to languages without this variety of data. Joshi et al. (2020) classified the around 7,000 languages of the world into six groups based on the availability of data in each language. The two groups posing the biggest challenges for NLP are: The Left-Behinds, languages with virtually no unlabeled data. The Scraping-Bys, languages with a small amount of monolingual data. We refer to this as the Few-Text setting. These languages make up 85% of languages in the world, yet they do not benefit from the development of pretrained models and adaptation methods due to the lack of monolingual and parallel text. In this paper, we conduct a systematic study of strategies directly targeted at these languages. Since the main bottleneck of adapting to underrepresented languages is the lack of text, we adopt a data augmentation framework (illustrated in Fig. 3) that leverages bilingual lexicons, which are available for a much larger number of languages. Given a bilingual lexicon DST lex between the source language S and a target language T , we create synthetic sentences (cid:101) x Ti in T using sentences x Si in S via word-to-word translation, and use this synthetic data in the following adaptation methods. Pseudo MLM Using monolingual text D Smono = { x Si } i , we generate pseudo monolingual text (cid:101) D Tmono = { (cid:101) x Ti } i for T by replacing the words in x Si with their translation in T based on the lexicon DST lex . We keep the words that do not exist in the lexicon unchanged, so the pseudo text (cid:101) x Ti can include words in both S and T . We then adapt the pretrained multilingual model on (cid:101) D Tmono using the MLM objective. For the Few-Text setting where some gold monolingual data D Tmono is available, we can train the model jointly on the pseudo and the gold monolingual data (cid:101) D Tmono  D Tmono . Pseudo Trans-train Given the source labeled data D Slabel = { ( x Si , y Si ) } Ni =1 , for each text example x Si we use DST lex to replace the words in x Si with its corresponding translation in T , resulting in pseudo labeled data (cid:101) D Tlabel = { ( (cid:101) x Ti , y Si ) } Ni =1 . We keep the original word if it does not have an entry in the lexicon. We then fine-tune the model jointly on both pseudo and gold labeled data (cid:101) D Tlabel  D Slabel . Since these methods only require bilingual lexicons, we can apply them to both No-Text and Few-Text settings. We can use either of the two methods or the combination of both to adapt the model. Challenges with Pseudo Data Our synthetic data (cid:101) DT could be very different from the true data DT because the lexicons do not cover all words in S or T , and we do not consider morphological or word order differences between T and S . 4 Nonetheless, we find that this approach yields significant improvements in practice (see Tab. 3). We also outline two strategies that aim to improve the quality of the synthetic data in the next section. Label Distillation The pseudo labeled data (cid:101) DT label = { ( (cid:101) x T i , y Si ) } N i =1 is noisy because the syn-4 thetic examples (cid:101) x Ti could have a different label from the original label y Si (see Tab. 1). To alleviate this issue, we propose to automatically correct the labels of pseudo data using a teacher model. Specifically, we fine-tune the pretrained multilingual model as a teacher model using only D Slabel . We use this model to generate the new pseudo labeled data (cid:101) D Tdistill = { ( (cid:101) x Ti , (cid:101) y Ti ) } Ni =1 by predicting labels (cid:101) y Ti for the pseudo task examples (cid:101) x Ti . We then fine-tune the pretrained model on both the new pseudo labeled data and the source labeled data (cid:101) D Tdistill  D Slabel . Induced Lexicons with Parallel Data For the Few-Text setting, we can leverage the available parallel data D STpar to further improve the quality of the augmented data. Specifically, we use unsupervised word alignment to extract additional word pairs (cid:101) D STlex from the parallel data, and use the combined lexicon (cid:101) D STlex D STlex to synthesize the pseudo data. In this section, we outline the tasks and data setting used by all experiments. We will then introduce the adaptation methods and results for the No-Text setting in  5 and the Few-Text setting in 6. 4.1 Tasks, Languages and Model We evaluate on the gold test sets of three different tasks with relatively good coverage of underrepresented languages: named entity recognition (NER), part-of-speech (POS) tagging, and dependency parsing (DEP). We use two NER datasets: WikiAnn NER (Pan et al., 2017; Rahimi et al., 2019) and MasakhaNER (Adelani et al., 2021). We use the Universal Dependency 2.5 (Nivre et al., 2018) dataset for both the POS and DEP tasks. We use English as the source language for all experiments. For each dataset, we use the English training data and select the checkpoint with the best performance on the English development set. For MasakhaNER, which does not have English training data, we follow Adelani et al. (2021) and Language iso Family Task Lex Count Acehnese ace Austronesian NER 0.5k Bashkir bak Turkic NER 3.4k Crimean Turkish crh Turkic NER 4.4k Hakka Chinese hak Sino-Tibetan NER 8.5k Igbo ibo Niger-Congo NER 3.6k Ilokano ilo Austronesian NER 4.0k Kinyarwanda kin Niger-Congo NER 4.7k Eastern Mari mhr Uralic NER 21.7k Maltese mlt Afro-Asiatic All 1.0k Maori mri Austronesian NER 13.8k Hausa hau Niger-Congo NER 5.6k Wolof wol Niger-Congo All 1.9k Luganda lug Niger-Congo NER 3.5k Luo luo NER 0.7k Bambara bam Mande POS,Parsing 4.4k Manx glv Indo-European POS,Parsing 37.6k Ancient Greek grc Indo-European POS,Parsing 8.0k Swiss German gsw Indo-European POS,Parsing 2.5k Erzya myv Uralic POS,Parsing 7.4k Table 2: Languages used for evaluation. use the CoNLL-2003 English NER training data. We run each fine-tuning experiment with 3 random seeds and report the average performance. For NER and POS tagging, we follow the data processing and fine-tuning hyper-parameters in Hu et al. (2020). We use the Udify (Kondratyuk and Straka, 2019) codebase and configuration for parsing. Languages For each task, we select languages that have task data but are not covered by the mBERT pretraining data. The languages we use can be found in Tab. 2. Most fall under the Few-Text setting (Joshi et al., 2020). We employ the same languages to simulate the No-Text setting as well. Model We use the multilingual BERT model (mBERT) because it has competitive performance on under-represented languages (Pfeiffer et al., 2020). We find that our mBERT performance on WikiNER and POS is generally comparable or exceeds the XLM-R large results in Ebrahimi and Kann (2021). We additionally verify our results also hold for XLM-R in  7. Lexicon We extract lexicons between English and each target language from the PanLex database. 5 The number of lexicon entries varies from about 0.5k to 30k, and most of the lexicons have around 5k entries. The lexicon statistics for each language can be found in Tab. 2. Pseudo Monolingual Data English Wikipedia articles are used to synthesize monolingual data. We first tokenize the English articles using Stanza (Qi et al., 2020) and keep the first 200k sentences. To create pseudo monolingual data for a given target language, we replace each English word with its translation if the word exists in the bilingual lexicon. We randomly sample a target word if the English word has multiple possible translations because it is difficult to estimate translation probabilities due to lack of target text. Pseudo Labeled Data Using the English training data for each task, we simply replace each English word in the labeled training data with its corresponding translation and retain its original label. For the sake of simplicity, we only use lexicon entries with a single word. We analyze the results of the following adaptation methods for the setting where we do not have any monolingual data. Pseudo MLM The mBERT model is trained on the pseudo monolingual data using the MLM objective. We train the model for 5k steps for the NER tasks and 10k steps for the POS tagging and Parsing tasks. Pseudo Trans-train We fine-tune mBERT or the model adapted with Pseudo MLM for a downstream task on the concatenation of both the English labeled data and the pseudo labeled data. Label Distillation We use the model adapted with Pseudo MLM as the teacher model to generate new labels for the pseudo labeled data, which we use jointly with the English labeled data to finetune the final model. The average performance of different adaptation methods averaged across all languages in each task Pseudo Trans-train is the best method for No-Text. Pseudo MLM and Pseudo Trans-train can both bring significant improvements over the mBERT baseline for all tasks. Pseudo Trans-train leads to the best aggregated result across all tasks, and it is also the best method or very close to the best method for each task. Adding Pseudo Trans-train on top of Pseudo MLM does not add much improvement. Label Distillation generally leads to better performance, but overall it is comparable to only using Pseudo Trans-train. We test same adaptation methods introduced in  5 for the Few-Text setting where we have a small amount of gold data. First we introduce the additional data and adaptation methods for this setting. Gold Monolingual Data We use the JHU Bible Corpus (McCarthy et al., 2020) as the monolingual data. Following the setup in Ebrahimi and Kann (2021), we use the verses from the New Testament, which contain 5000 to 8000 sentences for each target language. Gold Parallel Data We can use the parallel data between English and the target languages from the Bible to extract additional word pairs. We use an existing unsupervised word alignment tool, eflo-mal (stling and Tiedemann, 2016), to generate word alignments for each sentence in the parallel Bible data. To create high quality lexicon entries, we only keep the word pairs that are aligned more than once, resulting in about 2k extra word pairs for each language. We then augment the PanLex lexicons with the induced lexicon entries. Gold MLM The mBERT model is trained on the gold monolingual Bible data in the target language using the MLM objective. Following the setting in Ebrahimi and Kann (2021), we train for 40 epochs for the NER task, and 80 epochs for the POS and Parsing tasks. Pseudo MLM We conduct MLM training on both the Bible monolingual data and the pseudo monolingual data in the target language. The Bible data is up-sampled to match the size of the pseudo monolingual data. We train the model for 5k steps 867 Method Lexicon WikiNER  MasakhaNER  POS  Parsing  Avg. Pseudo MLM is the competitive strategy for Few-Text. Unlike the No-Text setting, Pseudo Trans-train only marginally improves or even decreases the performance for three out of the four datasets we consider. On the other hand, Pseudo MLM, which uses both gold and pseudo monolingual data for MLM adaptation, consistently and significantly improves over Gold MLM for all tasks. Again, using Pseudo Trans-train on top of Pseudo MLM does not help and actually leads to relatively large performance loss for the syntactic tasks, such as POS tagging and Parsing. improvements for the two syntactic tasks. Notably, it is the best performing method for POS tagging, but it still lags behind Pseudo MLM for Parsing. This is likely because Parsing is a much harder task than POS tagging to generate correct labels. The effect of Label Distillation on the NER task is less consistentit improves over Pseudo Trans-train for WikiNER but not for MasakhaNER. This is because the named entity tags of the same words in different languages likely remain the same so that the pseudo task data probably has less noise for Label Distillation to have consistent benefits. Adding Induced Lexicons We examine the effect of using the lexicons augmented by word pairs induced from the Bible parallel data. The results can be found in Tab. 3. Adding the induced lexicon significantly improves the NER performance, while it hurts the two syntactic tasks. To understand what might have prevented the syntactic tasks from benefiting from the extra lexicon entries, we plot the distribution of the part-of-speech tags of the words in PanLex lexicons and the lexicons induced from the Bible in Fig. 4. PanLex lexicons have more nouns than the Bible lexicons while the Bible lexicons cover more verbs than PanLex. However, the higher verb coverage in induced lexicons actually leads to a larger prediction accuracy drop for verbs in the POS tagging task. We hypothesize that the pseudo monolingual data created using the induced lexicons would contain more target language verbs with the wrong word order, which could be more harmful for syntactic tasks than tasks that are less sensitive to word order such as NER. Discrepancies between the two NER datasets While WikiNER, along with POS tagging and Parsing, benefit the most from Pseudo MLM for Few-Text, MasakhaNER achieves the best result with Pseudo Trans-train. One possible explanation is that MasakhaNER contains data from the news domain, while WikiNER is created from Wikipedia. The pseudo monolingual data used for MLM is created from English Wikipedia articles, which could benefit WikiNER much more than MasakhaNER. On the other hand, the English NER training data for MasakhaNER is from the news domain, which potentially makes Pseudo Trans-train a stronger method for adapting the model simultaneously to the target language and to the news domain. One advantage of Pseudo MLM is that the English monolingual data is much cheaper to acquire, while Pseudo Trans-train is constrained by the amount of labeled data for a task. We show in  A.4 that Pseudo MLM has more benefit for MasakhaNER when we use a subset of the NER training data. Performance with XLM-R We mainly use mBERT because it has competitive performance for under-represented languages and it is more computationally efficient due to the smaller size. Here we verify our methods have the same trend when used on a different model XLM-R (Conneau et al., 2020). We focus on a subset of languages in the POS tagging task for the Few-Text setting and the results are in Tab. 4. We use the smaller XLM-R base for efficiency, and compare to the best result in prior work, which uses XLM-R large (Ebrahimi and Kann, 2021). Tab. 4 shows that our baseline is comparable or better than prior work. Similar to the conclusion in  6, Pseudo MLM is the competitive strategy that brings significant improvements over prior work. While adding Pseudo Trans-train to Pseudo MLM does not help, using Label Distillation further improves the performance. Effect of Baseline Performance Using pseudo data might be especially effective for languages with lower performance. We plot the improvement of different languages over the baseline in Fig. 5, where languages are arranged with increasing baseline performance from left to right. We mainly plot Pseudo MLM and Pseudo Trans-train for simplicity. Fig. 5 shows that for both resource settings, lower performing languages on the left tend to have more performance improvement by using pseudo data. Using NMT Model to Synthesize Data One problem with the pseudo data synthesized using word-to-word translation is that it cannot capture the correct word order or syntactic structure in the target language. If we have a good NMT system that translates English into the target language, we might be able to get more natural pseudo monolingual data by translating the English sentences to the target language. Since the target languages we consider are usually not supported by popular translation services, we train our own NMT system by fine-tuning an open sourced many-to-many NMT model on the Bible parallel data from English to the target language (details in  A.2). Instead of creating pseudo monolingual data using the lexicon, we can simply use the fine-tuned NMT model to translate English monolingual data into the target language. The results of using NMT as opposed to lexicon for Pseudo MLM on all four tasks can be found in Tab. 5. Unfortunately, NMT is consistently worse than word-to-word translation using lexicons. We find that the translated monolingual data tend to have repeated words and phrases that are common in the Bible data, although the source sentence is from Wikipedia. This is because the NMT model overfits to the Bible data, and it fails to generate good translation for monolingual data from a different domain such as Wikipedia. examples in the target language can significantly outperform the zero-shot transfer baseline for languages included in mBERT. We focus on the zero-shot setting in this paper because the languages we consider have very limited data and it could be expensive or unrealistic to annotate data in every task for thousands of languages. Nonetheless, we experiment with k -shot learning to examine its performance on low-resource languages in the MasakhaNER task. Tab. 6 shows that using 10 labeled examples brings improvements over the mBERT baseline for a subset of the languages, and it is mostly worse than our best adapted model without using any labeled data. When we have access to 100 examples, few-shot learning begins to reach or exceed our zero-shot model. In general, few-shot learning seems to require more data to consistently perform well for under-represented languages while our adaptation methods bring consistent gains without any labeled data. Combining the best adapted model with few-shot learning leads to mixed results. More research is needed to understand the annotation cost and benefit of few-shot learning for low-resource languages. Several methods have been proposed to adapt pretrained language models to a target language. Most of them rely on MLM training using monolingual data in the target languages (Wang et al., 2020; Chau et al., 2020; Muller et al., 2021; Pfeiffer et al., 2020; Ebrahimi and Kann, 2021), competitive NMT systems trained on parallel data (Hu et al., 2020; Ponti et al., 2021), or some amount of labeled data in the target languages (Lauscher et al., 2020). These methods cannot be easily extended to low-resource languages with no or limited amount of monolingual data, which account for more than 80% of the World's languages (Joshi et al., 2020). Bilingual lexicons have been commonly used for learning cross-lingual word embeddings (Mikolov et al., 2013; Ruder et al., 2019). Among these, some work uses lexicons to synthesize pseudo bilingual (Gouws and Sgaard, 2015; Duong et al., 2016) or pseudo multilingual corpora (Ammar et al., 2016). Mayhew et al. (2017) propose to synthesize task data for NER using bilingual lexicons. More recently, Khemchandani et al. (2021) synthesize monolingual data in Indian languages for adapting pretrained language models via MLM. Hu et al. (2021) argue that using bilingual lexicons for alignment hurts performance compared to word-level alignment based on parallel corpora. Such parallel corpora, however, are not available for truly under-represented languages. Reid and Artetxe (2021) employ a dictionary denoising objective where a word is replaced with its translation into a random language with a certain probability. This can be seen as text-to-text variant of our approach applied to multilingual pre-training. None of the above works provide a systematic study of methods that utilize lexicons and limited data resources for adapting pretrained language models to languages with no or limited text. We propose a pipeline that leverages bilingual lexicons, an under-studied resource with much better language coverage than conventional data, to adapt pretrained multilingual models to underrepresented languages. Through comprehensive studies, we find that using synthetic data can significantly boost the performance of these languages while the best method depends on the data availability. Our results show that we can make concrete progress towards including under-represented languages into the development of NLP systems by utilizing alternative data sources. Our work also has some limitations. Since we focus on different methods of using lexicons, we restrict experiments to languages in Latin script and only use English as the source language for simplicity. Future work could explore the effect of using different source languages and combining transliteration (Muller et al., 2021) or vocabulary extension (Pfeiffer et al., 2021) with lexicon-based data augmentation for languages in other scripts. We also did not test the data augmentation methods on higher-resourced languages as MLM fine-tuning 870 and translate-train are already effective in that setting and our main goal is to support the languages with little textual data. Nonetheless, it would be interesting to examine whether our methods can deliver gains for high-resource languages, especially for test data in specialized domains. We point to the following future directions: First, phrases instead of single word entries could be used to create pseudo data. Second, additional lexicons beyond PanLex could be leveraged. 6 Third, more effort could be spent on digitizing both existing monolingual data such as books (Gref, 2016) and lexicons into a format easily accessible by NLP practitioners. Although PanLex already covers over 5000 languages, some language varieties have only as little as 10 words in the database, while there exist many paper dictionaries that could be digitized through technologies such as OCR (Rijhwani et al., 2020). 7 Lexicon collection is also relatively fast, which could be a more cost effective strategy to significantly boost the performance of many languages without lexicons. Finally, the quality of synthetic data could be improved by incorporating morphology. However, we find that there is virtually no existing morphological analysis data or toolkits for the languages we consider. Future work could aim to improve the morphological analysis of these low-resource languages. This work was supported in part by the National Science Foundation under Grant Numbers 1761548 and 2040926. XW was supported in part by an Apple Graduate Fellowship. The authors would like to thank Aditi Chaudhary, Arya McCarthy, Shruti Rijhwani for discussions about the project, and Daan van Esch for the general feedback and pointing out additional linguistic resources.
abstain abstain method method abstain result abstain abstain abstain abstain other abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method result abstain abstain objective objective other other other other other other other method other other other other other abstain other method method method method abstain abstain method abstain abstain abstain method method method abstain abstain abstain abstain abstain method abstain abstain abstain method abstain result abstain abstain abstain abstain abstain other abstain abstain abstain abstain abstain result abstain abstain abstain result result abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method method method method abstain abstain abstain method method abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain abstain method method abstain abstain abstain abstain abstain method method abstain abstain abstain method abstain abstain other other other other other other other other other other abstain other objective result result abstain method abstain objective abstain objective abstain abstain abstain abstain abstain result abstain other other other