Hi Ivan
Thank you, my question is when we have multiple workers, then based on example given in pytorch tutorial, each worker specify the start and end part of the data, and the data got split between multiple workers. Please have a look at __iter__ function, where iter_start and iter_end are specified for the workers. then the worker needs to iterate in this range, in the pytorch example given they wrote iter(range(iter_start, iter_end)) because they have a simple list as input, I am not sure how to do it with iterable datasets, thank you.
Here is the link to the tutorial also  https://pytorch.org/docs/stable/data.html#multi-process-data-loading 47, where they explain that each worker needs to access different chunk of data.
Also, in case of pytorch lightening, does the user still need to specify worker_info ? thanks