Hi,
Yes to avoid hard-to-debug issues on the user side, we only support Long Tensors that can always represent the indices that you will need.
Is your index Tensor too large? You can try to convert it to long just before the embedding forward so that you only ever have a single batch in full precision at a time. That should fit in memory just fine no?