Hi,
I have developed a very efficient implementation of Maxout activation and also have provided the gradient of it for backward pass. The results and efficiency has been compared to Theano version and is on par. Here is the link. Feel free to use and give suggestion if something is wrong. Maxout-PyTorch
3 Likes