You can always try using my implementation of inference Eval model in C++ code 
It implements only a few modules (ReLU, Sigmoid, Linear, Conv2D, BatchNorm2D) but that should be easy to extend or you can just simply use it to implement your own inference from scratch.