Symbolically trace LSTM layers

Is there any practical way to symbolically trace LSTM layers?
Should I create my custom LSTM with static sequence size?

Yes that sounds about right

Thank you for your reply @marksaroufim
And then is it exportable to ONNX ?