I implemented a tiny library for Decoupled Neural Interfaces using Synthetic Gradients in PyTorch as part of one of my projects. Maybe someone will find it useful as well. It’s available here: https://github.com/koz4k/dni-pytorch.
I implemented a tiny library for Decoupled Neural Interfaces using Synthetic Gradients in PyTorch as part of one of my projects. Maybe someone will find it useful as well. It’s available here: https://github.com/koz4k/dni-pytorch.