# Model takes twice the memory footprint with distributed data parallel

**URL:** <https://discuss.pytorch.org/t/model-takes-twice-the-memory-footprint-with-distributed-data-parallel/130879>\
**Category:** Uncategorized\
**Created:** [September 1, 2021, 6:20pm UTC](https://discuss.pytorch.org/t/model-takes-twice-the-memory-footprint-with-distributed-data-parallel/130879 "2021-09-01T18:20:16Z")\
**Posts on this page:** 1\
**Showing post:** 6

<div class="post-metadata">

**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\
**Post date:** [September 3, 2021, 3:59am UTC](https://discuss.pytorch.org/t/model-takes-twice-the-memory-footprint-with-distributed-data-parallel/130879/6 "2021-09-03T03:59:04Z")

</div>

You are most likely seeing the same effect described [here](https://discuss.pytorch.org/t/memory-consumption-for-the-model-get-doubled-after-wrapped-with-ddp/130837/5).

---

_[View the full topic](https://discuss.pytorch.org/t/model-takes-twice-the-memory-footprint-with-distributed-data-parallel/130879)._