Thanks for the link, it answers my initial question. The pytorch pages I found earlier didn’t give me a definitive answer and here it clearly states that It can solve memory issues.
Although I’m still wondering about the 2nd part of my question regarding using SSD or RAM as a solution.