Change detection of two images CNN

I want to present the changes of the two images which are taken at two different times using CNN. But our database is characterized by patches and each patch we will classify the central pixel. how to get to the final image yet is not chosen all the pixels from the ground truth??