Hi @benj, Sylvain has a nice tutorial (link 338) on question answering that provides a lot of detail on how the sliding window approach is implemented.
The short answer is that all chunks are used to train the model, which is why there is a fairly complex amount of post-processing required to combine everything back together.