How to use Transformer.DecoderLayer?

nlp
1

Hi,

The transformer decoder layer takes in input and the encoder embeddings. What is the shape of the output?

Unlike LSTM how do we do the beam search using the transformer decoder layer? Since transformer decoder gives the entire prediction at once i.e. output shape is the same as the target shape.

Any pointers?

2

@Rafael_R Were you able to figure out how to do it?

3

The shape of transformer decoder is same as that of transformer encoder.