gunnxx:

I think we stumbled upon very similar issue regarding MAML implementation. I haven’t tested it yet but I think yes we can do the updates after each task without storing computational graphs for all tasks.



Hi, yes I think we did.
Could you elaborate a little on your equations + the solution?
In particular the second equation is not something I would not expect to see in original MAML, unless it were maybe part of the inner loop. Also do you know if you’re code will work with data parallel training setup (across GPUs)?
Thanks, I really appreciate your help with this.