Prior distribution in Variational Auto Encoder

I am working with Convolution Variational Auto Encoder and from all the blogs that i see the latent representation is a vector of the image and prior distribution is from the Gaussian distribution with the shape from the vector. My question is can the latent space be a feature map (16x16x2048) as well ? and can we take prior distribution from the shape of feature map ?