𝐱 (1) = 𝐱 max (𝐱)
For Block 𝑚 = 1 …𝑀 ∶
𝐡 (𝑚) = MLP(𝐱 (𝑚) )
𝐱̂ (𝑚) = Linear(𝐡 (𝑚) ) ⋅ Std(𝐱 (𝑚) ) + Mean(𝐱 (𝑚) )
𝐲̂ (𝑚) = Linear(𝐡 (𝑚) ) ⋅ Std(𝐱 (𝑚) ) + Mean(𝐱 (𝑚) )
𝐱 (𝑚+1) = ReLU(𝐱 (𝑚) − 𝐱̂ (𝑚) )
Output: 𝐲̂ = max (𝐱) ⋅ ∑𝑀 𝑚=1 𝐲̂ (𝑚)
𝐱 (1) = 𝐱 max (𝐱)
For Block 𝑚 = 1 …𝑀 ∶
𝐡 (𝑚) = MLP(𝐱 (𝑚) )
𝐱̂ (𝑚) = Linear(𝐡 (𝑚) ) ⋅ Std(𝐱 (𝑚) ) + Mean(𝐱 (𝑚) )
𝐲̂ (𝑚) = Linear(𝐡 (𝑚) ) ⋅ Std(𝐱 (𝑚) ) + Mean(𝐱 (𝑚) )
𝐱 (𝑚+1) = ReLU(𝐱 (𝑚) − 𝐱̂ (𝑚) )
Output: 𝐲̂ = max (𝐱) ⋅ ∑𝑀 𝑚=1 𝐲̂ (𝑚)