Got it ,Thanks, I tried Pandas it is much faster but also get same segmental fault error after a while, so I wonder is there some way I can use to calculate how much shared memory do I need? with number of workers and training data size, can we roughly estimate how much shared memory needed?