For issue about docker session you can check https://docs.docker.com/engine/reference/run/#ipc-settings-ipc 19 . And I managed to hold a branch of numpy.ndarray when loading data and preprocessing. Cuda Tensors are just converted to before sending to network.