The docs explain the shapes of the output as well as hidden states. Additionally, check this post which visualizes the model and explains the shapes of the tensors with it.