Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model not learning #10

Open
tumis1946 opened this issue Sep 2, 2021 · 7 comments
Open

Model not learning #10

tumis1946 opened this issue Sep 2, 2021 · 7 comments

Comments

@tumis1946
Copy link

Thanks very much for sharing your work with us.

I wish to ask for your help. I have trained the model from scratch for more than 4000 epochs, but, it is not learning. I did not change anything in your code except the directory for IAM. The pre-trained model that you shared was trained for 2000 epochs and it is a thousand times better than the model I trained for 4000 epochs.

Please, let me know if I have to make any changes in your code for learning to take place.

Thanks

@tumis1946
Copy link
Author

image

@tumis1946
Copy link
Author

tumis1946 commented Sep 2, 2021

As shown above, it looks like the classifier (l_cla) is suffering from overfitting. That is, comparing EVAL to tr-gen values

@Bird9000
Copy link

hi ,I got that same problem even I trained for 10000 epochs after 4000 epochs nothing much change . Can i have some tricks
and you say you have pre-trained model that trained for 2000 epochs where will i find it.

@hendraet
Copy link
Contributor

The pretrained model is referenced in this issue: #5
I'm currently not working on this project anymore, so I can't provide you with better pre-trained models.

@tumis1946
Copy link
Author

hi ,I got that same problem even I trained for 10000 epochs after 4000 epochs nothing much change . Can i have some tricks and you say you have pre-trained model that trained for 2000 epochs where will i find it.

hello Bird9000: Sorry for the late reply. My problem was that I was new to GAN training, and so, I focused on metrics. As training progresses, what you have to do is observe the intermediate results in imgs/ folder. Even though the training and validation metrics may appear poor, the intermediate results in imgs/ folder indicate that the model is learning. If you do not change any parameters in the model, then, between epoch 400 and 1000, you should start to see that the errors in the intermediate images in folder imgs/ are significantly less. You do not need to train for more than 2000 epochs, assuming you do not change parameters in the current model.

@tumis1946
Copy link
Author

tumis1946 commented Mar 28, 2022 via email

@Bird9000
Copy link

thank you for the information @tumis1946 @hendraet

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants