Intermediate Fusion

[ptrblck]

It depends on the model and might not be possible as explained in your cross-post.