Only when batch_size = 1, the loss will drop, otherwise, the loss will oscillate. Use lstm network, is this normal?
