Gated Recurrent Unit Biases General Question

performance impact here is negligible - same as replacing mm with addmm, because blas gemm routine fuses this bias summation.

1 Like