OK, it might be more worthwhile to go after the segmentation fault first. Is it possible to get a stack trace with something like
$ gdb --args python my_script.py
...
Reading symbols from python...done.
(gdb) run
...
(gdb) backtrace
...

?
Additionally, what is the output of nvidia-smi?