Thanks Quentin for the reply!
I have one question:
when I tried to download the “full” version of compressed index, it’s still download 79GB of wikipedia document. Currently, I use only Colab with dummy index, but I plan to rent some cloud machine to test the full scale index too. Could you please suggest me how much RAM I would need for the full compressed index ?? (and maybe some extra RAM in finetuning ?) @lhoestq