Minimum number of training examples to properly finetune a seq2seq network

I have trained a seq2seq model on some synthetic data, but am having trouble finetuning a very smallset of data in another domain. I have trained my seq2seq model on around 15k datapoints and my small dataset has around 50 datapoints.