Hi everyone,
I am a first year phd student working on medical images.
I had issue working with these kind of data (long running times, etc.)
We finally came up with a code specially designed for these datasets.
Here is the link to the public code:
https://github.com/amirakbarnejad/PyDmed 42
Here is the link to a quick tutorial:
https://amirakbarnejad.github.io/Tutorial/tutorial_section1.html 37
The general idea is as follows: we keep some "big chunk"s from data preloaded to memory.
We then collect some "small chunk"s from those "big chunk"s. "big chunk"s are reloaded/replaced from memory time to time.