some operator like, a < b
, does it has autograd?
Hi,
All operators that have a meaningful gradient should work. Operators that would return a gradient being 0 almost everywhere are not differentiable and you can see it by checking the .requires_grad
field on the result. You will see that it is False
for operators that are not differentiable and True
for the ones that are.