Depending on the use case your memory usage might be higher, but you might increase the perf. by using a single backward pass. As long as your proposed workflow works for your use case and doesn’t trigger any other errors, it should be fine.