Solved by lhoestq in post #5 
              
              
                This style of batched fetching is only used by streaming datasets, right? I’d need to roll my own wrapper to do the same on-the-fly chunking on a local dataset loaded from disk? 

Yes indeed, though you can stream the data from your disk as well if you want. 
A dataset in non streaming mode needs t…