Correct branch-CNN implementation?

Double post from here with potential answer.