Is it possible to use a VAE to reconstruct and image starting from an initial image instead of using 'torch.randn_like(std) as show in the “reparametrize” function of [this example]?(https://github.com/pytorch/examples/blob/master/vae/main.py)
I have used a sample image with the VAE encoder to get mu and std.
I have been given 1000 pixels in an otherwise blank image (with nothing in it)
Now I want to reconstruct the sample image using the decoder with a given constraint that the 1000 pixels in the otherwise blank image remain the same. The remaining pixels can be reconstructed so they are as close to the initial sample image as possible.
In other words, my starting point for decoder is a blank image with some pixels that don’t change.
How can I modify the decoder to generate an image based on this constraint?
Is it possible? Are there variations of VAE that might make this possible?