Hi,
Are there any plans to add RoutingTransformer to HF? Phil Wang has public RT implementation at GitHub - lucidrains/routing-transformer: Fully featured implementation of Routing Transformer 34
Cheers,
Vladimir