In NLP tasks you are usually using a mapping between word indices to dense feature tensors using nn.Embedding. An RNN should be able to take your (floating point) features, however I’m not sure which architecture would work best for your use case.