How to add activation histogram in tensorboard?

You can use forward hooks to get the internal activation as described here.