how to load minibatches one by one

[jengelman]

Following up on #2, how would I load batches one at a time for soVB or moVB?

[michaelchughes]

Sorry this hasn't been resolved yet! I've been out of the office but should have a more detailed answer by the end of the week.

The quick answer is that just you use bnpy's "DataIterator" object to break up an in-memory dataset into batches, you can use DataIteratorFromDisk to loop through pre-defined batches on disk (saved as .npy or .mat files).

https://github.com/bnpy/bnpy/blob/master/bnpy/data/DataIteratorFromDisk.py#L85