Hi,
I am working on the problem of multiclass classification on a large imbalanced dataset. Next few weeks, I will have the opportunity to use 4 Cuda devices. The structure of the dataset is simple: TEXT, LABEL.
What is the best strategy in using torchtext for such a situation? Unfortunately, I could not find an example for processing on multiple cuda devices and with such a dataset (large imbalanced dataset - 20 Gb).
Thanks to everyone for the help and links to some working examples