Forward pass computation for GDAS NAS coding

For GDAS : Searching for A Robust Neural Architecture in Four GPU Hours · GitHub , how to do forward pass training computation for architecture weights of each and every edges ?