I am wondering whether to set .eval() for those frozen layers since it may still update its running mean and running var.