multi gpu acceleration
#10
by
JonathanWeissenberger
- opened
Maybe im not the only one wondering how to use multiple gpu's. I run 2 (old) Tesla P4 on a Ubuntu installation. I tested the smaller 1B model and it runs without any issues other than it just uses one Tesla P4. I'm fairly new to this and i assume you have to modify the app_januspro.py script to aks for both gpu's righ? I have no experience in python and from what i found out the gpu's dont have to be in sli mode (connected via a hardware bridge) to enable both for cuda tasks. Any experiences you can share?