How to stop weight-decay from affectnig PReLU?

[apaszke (Adam Paszke)]

See per-parameter optimizer options.