Lstm question with title at least 15 characters

Hello,
Lets say I build a standard CNN.
I would have a couple FC linear layers and maybe some convolutional layers and maybe some maxpool.
If I want this network to have memory, can I just add a LSTM onto it.

Because from the documentation, it looks like the LSTM simply replaces the CNN.

Thanks Matt