Serving Model Trained with PyTorch

21

@Eugenio_Culurciello Could you post a link to your pytorch exporter? Thanks!

1 Like
22

ping @Eugenio_Culurciello. I would also love to see the exporter you are building.

23

see https://github.com/mvitez/thnets/, it is included there

1 Like
24


but looks like things have changed in the pytorch format and this may not work now.
I am not sure what is the best way to convert from pytorch to other framworks

25

hi,all
I try to get all the parameter’s value to reconstruct the graph in C++ and serve.
I used to get the Parameter Instance by Variable.creator’s previous_functions, so I can export it’s shape and value.and other attributes in special layer(dropout’s P for example).
now I update my pytorch from master branch, and use grad_fn’s next_functions instead, but get some XXBackwards stuffs, how could I get the parameter again (eg. the Linear Layers’ weight and bias value)
tks

26

Hello can I doing something like this?

  1. I am creating CNN network and model which is trained in Pytorch (this is static with the fixed size and fixed number of layer)
  2. Then in deploying process, I am using C/C++ language to load the model and code the network so it can be run in C
    So just the deploying part is in C/C++, the train is in Pytorch, and can I also do it in windows?, If it possibly done, may I know the starting point to learn it, because I really new in this kind of stuff.
    -Thank you-
1 Like
27

This might be useful:

6 Likes
28

I think this link would be helpful:
[Feature Request] Deployment in c++ project

1 Like
29

I think this link also would be helpful:
Deep-Learning-in-Production

1 Like