My model works on small random subsets(12k) of the dataset but not the whole dataset(200k)

vision
1

Hi,
I have a dataset of 200k extracted patches from medical images. My model works satisfying on a random subset of the dataset(e.g. 12k patches).
However, it looks like it does not work on my whole dataset, and overfitting happens. I have tried different learning rates and augmentations, but it still does not work.
Please see attached diagrams of training and validation accuracy and losses after 50 epochs of training applying the whole dataset(including 200k patches).
I cannot understand why the accuracy for validation started too high from the beginning?

picmesal1
picmesal13301×1781 337 KB

Also, as seen in another diagram, by applying a very low learning rate 10e-6, it looks like overfitting happens the model does not learn at all.

picmesal
picmesal3274×1725 261 KB

I would appreciate it if anybody could help me.

2

@ptrblck Could you please help me If you have any idea about this?

3

Can you post your code, where you think the problem might be? This will help him to figure out what might be wrong.

4

My model is based on the ResNet50 backbone. I am not sure where the problem might be. I think the model faces overfitting after applying more data. I was wondering if someone has experienced a similar problem or has any suggestions.