How to train a generative chatbot with new data without making it inaccurate for the previous data

Hi, I followed the PyTorch tutorial on creating a chatbot. I trained it on Cornell Movie-Dialogs Corpus. But what I need to do now is to append new data to the chatbot without losing previous weights. how can I do that?

here is the notebook for training the model (from a checkpoint): https://colab.research.google.com/drive/1oy0UjFpQdIjh2T5dLA3x4o3euVCV3ZaE?usp=sharing

And here is the notebook where I am loading the previous model and trying to add new data:
https://colab.research.google.com/drive/1U1JLbjye1d9jqMAw0R4UzCkqy1pbl30Y?usp=sharing