Thanks for updating the code. It was a indeed a split to use just one layer.
It seems, it’s using W2. However, I would use this approach carefully, since I’m not sure how the intermediate values are stored using other layers etc.
Could you tell a bit more about your use case?