Is there pytorch got function like clip_by_value by tensorflow?

Given a tensor t , this operation returns a tensor of the same type and shape as t with its values clipped to clip_value_min and clip_value_max . Any values less than clip_value_min are set to clip_value_min . Any values greater than clip_value_max are set to clip_value_max .

torch.clamp()
https://pytorch.org/docs/stable/torch.html#torch.clamp

3 Likes

thanks. 请问pytorch中类似tensorflow的tf.gather_nd和tf.map_fn是哪个?

To add clarity to this as this appears in google searches: For clipping specifically gradients in PyTorch there are 2 useful functions:

        torch.nn.utils.clip_grad_value_(model.parameters(), clip)
        torch.nn.utils.clip_grad_norm_(model.parameters(), clip)

The first clamps all gradients within the range [-clip, +clip]
The second normalizes the gradients with value clip and reweights them

1 Like