Nonlinearity choice based on target

I have a network that has 2 output vectors, where, MSE loss is computed for each output. One of my targets outputs a value between -1,1 and the other one computes a value between 0 and 9. Based on this, would it be possible to suggest non-linear activations for each branch? Also, is there an activation that encourages close to integer outputs?