Hi,
I wonder…
-
What are the extra workers for in Caffe2’s data parallel model?
-
Why is extra_workers set to 8 for rendezvous?
Here is the link to the Python code that I am talking about : https://github.com/caffe2/caffe2/blob/master/caffe2/python/data_parallel_model.py#L137
Thanks!