OK found the answer.
Torch (quite amazingly) can auto-detect the instruction set and execute around this. Meaning my lack of AVX is not an issue. If only Tensorflow did the same. It was a joy to get cifar10 running on multiple GPU within minutes.
Thanks!