('__Python VERSION:', '2.7.13 |Continuum Analytics, Inc.| (default, Dec 20 2016, 23:09:15) \n[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)]')
('__pyTorch VERSION:', '0.2.0_2')
__CUDA VERSION
('__CUDNN VERSION:', 6021)
('__Number CUDA Devices:', 2L)
__Devices
index, name, driver_version, memory.total [MiB], memory.used [MiB], memory.free [MiB]
0, GeForce GTX TITAN X, 375.66, 12204 MiB, 8355 MiB, 3849 MiB
1, GeForce GTX TITAN X, 375.66, 12207 MiB, 9174 MiB, 3033 MiB
('Active CUDA Device: GPU', 0L)
('Available devices ', 2L)
('Current cuda device ', 0L)
2 device(s) found.
(0, 'GeForce GTX TITAN X')
(1, 'GeForce GTX TITAN X')

I commented this line:
! nvcc --version
The memory seems to be consistent with nvidia-smi, I have 2 process working with them