I recently test MLPerf , and use pytorch as runtime. I found there’s only 1 core could be used the mutlthread scenario.
It’s said that py::gil_scoped_release release is needed to enable python multithread.
Does anybody know how to enable multi thread in pytorch.
Could you explain what “MLPerf multi threads” are and where you are using multi-threading in your code?