Discussions>Why network overfits too early?>

Why network overfits too early?

I want to train a neural network model, which basically does binary classification. I can't understand why my network overfits too early. I thought my network is too big and it memorizes the dataset, but when I make it smaller, it does not learn at all.
How avoid this situation? Dropout didn't work, augmentation techniques helped a bit, obviously, regularizations didn't change anything. Can you guys explain the reasons, and how I can avoid it?

4 votesLP262.00
1 Answers
sK3.00
1

Have you tried early stopping ?

Reply
LP262.00
1

I have not tried it, because it takes 3-4 epoches and the networks starts to overfit. I thought learning rate is too big or small. changed them, it didn't work as well.

Couldn't find what you were looking for?and we will find an expert to answer.
How helpful was this page?