 Pre-training corpora  The pre-training corpora of LEGAL-BERT include:  * 116,062 documents of EU legislation, publicly available from EURLEX (http://eur-lex.europa.eu), the repository of EU Law running under the EU Publication Office.      * 61,826 documents of UK legislation, publicly available from the UK legislation portal (http://www.legislation.gov.uk).      * 19,867 cases from the European Court of Justice (ECJ), also available from EURLEX.      * 12,554 cases from HUDOC, the repository of the European Court of Human Rights (ECHR) (http://hudoc.echr.coe.int/eng).      * 164,141 cases from various courts across the USA, hosted in the Case Law Access Project portal (https://case.law).      * 76,366 US contracts from EDGAR, the database of US Securities and Exchange Commission (SECOM) (https://www.sec.gov/edgar.shtml).  