This works exponentially faster

You mean just faster right? I don’t see how that could be exponential…
And yes this will work fine as mentioned above. The only downside is that you now do many more forward passes. So depending on your application this will be better or not.