I don’t think we can really do much about the 550MB, but I can’t reproduce the original issue of taking memory on all GPUs on master (I think someone fixed it at some point, but I can’t find the PR for some reason).