# Bert bug? please have a look

**URL:** <https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169>\
**Category:** Uncategorized\
**Created:** [December 4, 2020, 8:22pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169 "2020-12-04T20:22:36Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![XiMing\_Dong](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ximing_dong/32/31953_2.png) [@XiMing\_Dong](https://discuss.pytorch.org/u/XiMing_Dong)\
**Post date:** [December 4, 2020, 8:22pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/1 "2020-12-04T20:22:36Z")

</div>

![Screen Shot 2020-12-04 at 2.18.07 PM](https://discuss.pytorch.org/uploads/default/original/3X/1/9/19f31b21fab3860739bdd053b5affd5f6ab71b98.png)

the first epoch is running and the second is a break, I have no ideas about it since I am a fish. plz have a look and help me thanks

---

<div class="post-metadata">

**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\
**Post date:** [December 7, 2020, 9:00am UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/2 "2020-12-07T09:00:21Z")

</div>

Assuming you are using the Huggingface Transformer library with Tensorflow, I would recommend to create an issue in their repository or discussion board to get the best and fastest help. 😉

---

<div class="post-metadata">

**Author:** ![XiMing\_Dong](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ximing_dong/32/31953_2.png) [@XiMing\_Dong](https://discuss.pytorch.org/u/XiMing_Dong)\
**Post date:** [December 21, 2020, 6:37pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/3 "2020-12-21T18:37:43Z")

</div>

How can I do that? I do not see a discussion board about BERT  
thanks

---

<div class="post-metadata">

**Author:** ![XiMing\_Dong](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ximing_dong/32/31953_2.png) [@XiMing\_Dong](https://discuss.pytorch.org/u/XiMing_Dong)\
**Post date:** [December 21, 2020, 6:38pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/4 "2020-12-21T18:38:17Z")

</div>

How can I do that? I do not see a discussion board about BERT  
thanks

> [@XiMing\_Dong](#):
>
> unless

---

<div class="post-metadata">

**Author:** ![ptrblck](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ptrblck/32/1823_2.png) [@ptrblck](https://discuss.pytorch.org/u/ptrblck)\
**Post date:** [December 23, 2020, 6:50pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/5 "2020-12-23T18:50:36Z")

</div>

You could try the [Huggingface forum](https://discuss.huggingface.co/) or their [GitHub repository](https://github.com/huggingface).

---

<div class="post-metadata">

**Author:** ![XiMing\_Dong](https://discuss.pytorch.org/user_avatar/discuss.pytorch.org/ximing_dong/32/31953_2.png) [@XiMing\_Dong](https://discuss.pytorch.org/u/XiMing_Dong)\
**Post date:** [December 23, 2020, 10:03pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/6 "2020-12-23T22:03:02Z")

</div>

thanks and have a good one

---

<div class="post-metadata">

**Author:** ![Aditya\_Sihag](https://discuss.pytorch.org/letter_avatar_proxy/v4/letter/a/8e8cbc/32.png) [@Aditya\_Sihag](https://discuss.pytorch.org/u/Aditya_Sihag)\
**Post date:** [December 23, 2020, 10:23pm UTC](https://discuss.pytorch.org/t/bert-bug-please-have-a-look/105169/7 "2020-12-23T22:23:21Z")

</div>

Hi @ptrblck. I’ve posted a query, and haven’t received any reply, and I really need help with this. Your advice would really help me. Could you please have a look?

[https://discuss.pytorch.org/t/portraitnet-model-training-loss-not-decreasing-beyond-initial-point/106988](https://discuss.pytorch.org/t/portraitnet-model-training-loss-not-decreasing-beyond-initial-point/106988)