How to access input/output activations of a layer given its parameters names?

You could use forward hooks and use the parameter name to register them.
Let me know, if that would work for you.