Diego999:

For efficiency, a first module could compute the representation of the documents (RNN) and then a second one could repeat the embedding and use the query with.


I’m not sure I understand your use case completely, but this description sounds more like model parallel / sharding, where the model itself is split to multiple devices, not like data parallel.