Hello. Yes, here it is 3. The code of the model is under src/models/entities_as_experts.py. The implementation is also mentioned in PapersWithCode 1.
Note: the latest PyTorch should have introduced vmap but I still have not played with it, and the project is “done” on my end.