Unsure of output dimension and Loss type (Newbie)

You might want to look a this post, it seems very related. The link Udacity tutorial is also exactly about a character RNN.