Implementing hashing (2016 paper) to improve computational performance by 95%

1

I’ve been looking into this technique: Scalable and Sustainable Deep Learning via Randomized Hashing that allegedly “uses only 5% of the total multiplications, while
keeping on average within 1% of the accuracy of the original model.” It looks pretty straightforward and appears to be suitable for PyTorch, so I’d like some guidance on how we might go about implementing this functionality unless it would have undesirable consequences that are not immediately apparent to me.

2

Has anyone tried implementing this technique?

3

Or does anyone have any suggestions?