get layer like CTC or attention?
You could look at https://github.com/pytorch/examples/tree/master/OpenNMT
Also see https://github.com/pytorch/pytorch/issues/570
Now DeepSpeech (with CTC loss) is implemented in PyTorch here:
thks, guys!