Try using self.register_buffer('graph', None) inside __init__ of the model. This way DataParallel knows that this is a tensor that must be copied too. DataParallel only replicates parameters and buffers.