What does negative nn.parameter value signify?

Hi,
What does negative self.gamma = nn.Parameter(torch.tensor([0.0])) value means as training progresses ? if i used it in Self-Attention(SA) module as follow:
Y = self.gamma*SA features + Input

Do I have to take only the magnitude ?

Thanks