If you are using Faiss, I believe you can do PCA to reduce the number of dimensions of your vectors. Also, this line from Faiss’ GitHub page makes me think you can get around the large dataset size.

Faiss contains algorithms that search in sets of vectors of any size, up to ones that possibly do not fit in RAM.