I implemented a tiny library for Decoupled Neural Interfaces using Synthetic Gradients 26 in PyTorch as part of one of my projects. Maybe someone will find it useful as well. It’s available here: https://github.com/koz4k/dni-pytorch 54.