Convert from PyTorch to ONNX using torch.onnx.export. Compile from ONNX format to your machine code. This is the approach taken by Intel OpenVINO and a few other hardware vendors, and it will let you easily add support for TensorFlow as well, since there is also a TensorFlow->ONNX converter.
I think the Glow compiler can load TorchScript, so you could look into that.