AI Dataset
[Text Corpus](https://texonom.com/text-corpus-1befe731759849c48134768343a90703) 


We typically say that a dataset is high-dimensional if the number of data points N issmaller than the dimensionality D

> - not cheatable
> - large degree of intra-class variability
> 

> ![](https://www.notion.so/image/https%3A%2F%2Fs3-us-west-2.amazonaws.com%2Fsecure.notion-static.com%2F895def36-e573-4dd1-8322-2a360807feb7%2FUntitled.png?table=block&id=fcecf613-dddd-441d-bf75-31e18d3ec61a&cache=v2)

### Vision AI Datasets
|Title|
|:-:|
|[ImageNet](https://texonom.com/imagenet-d5542cdb730f4e218bacb583b5e2576b)|
|[WebLI](https://texonom.com/webli-5b0455624497488ba55432160ad812c6)|


### NLP Datasets
|Title|
|:-:|
|[CommonCrawl](https://texonom.com/commoncrawl-e34ff04c04e14260a1ef19e3baa035c8)|
|[C4 Data](https://texonom.com/c4-data-5e19c38f6e034c92857f71cb820dae89)|
|[Code Data](https://texonom.com/code-data-071b31dcf1ee4073ad458f1ac781cd5f)|
|[RedPajama Data](https://texonom.com/redpajama-data-ab8489ee6448474899c4b8e49b6faaac)|



> [20 Open Datasets for Natural Language Processing](https://odsc.medium.com/20-open-datasets-for-natural-language-processing-538fbfaf8e38)





