Can I multiply two tensors of different dimensions?
For example (64, 209, 50) and (50, 209, 50)?
No you cant multiply those tensors
Tensors don’t necessarily have to be the same size for you to be able to multiply them, but the shapes of the two tensors has to be broadcastable.
So your example tensors would not work.