Trying to Implement Fixed Filters after each Layer

Assuming Iy and Ix should be used as filters in a conv layer you could assign them as the weight attribute as seen here.