arxiv:2409.05816 license:mit region:us
---
license: mit
---
This is the fastText pretraining data filter targeting
the SciQ task, discussed in the main text of the Perplexity
Correlations paper: https://arxiv.org/abs/2409.05816