Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loss does not converge #76

Open
LANMNG opened this issue Jun 28, 2018 · 4 comments
Open

Loss does not converge #76

LANMNG opened this issue Jun 28, 2018 · 4 comments

Comments

@LANMNG
Copy link

LANMNG commented Jun 28, 2018

I train mobilenet_v1 for many times, but the loss doesn`t down to 1.xxx, but aways be 2.xxx, and the accuracy is just about 54%,what is wrong?

@jiachen0212
Copy link

when i run bash ./scripts/train_mobilenet_on_imagenet.sh, i met the bug:WARNING:tensorflow:From train_image_classifier.py:415: create_global_step (from tensorflow.contrib.framework.python.ops.variables) is deprecated and will be removed in a future version.
Instructions for updating:
Please switch to tf.train.create_global_step
did you got this bug? hope you can give some help ....thanks!!!

@LANMNG
Copy link
Author

LANMNG commented Jul 11, 2018

you may update your version of tensorflow and it would not have any influence on your experiment. @jiachen0212 and you can change the optimizer to rmsprop.

@jiesonshan
Copy link

Is this the problem solved?

@JiaShengLiu111
Copy link

JiaShengLiu111 commented Mar 30, 2019

I also encountered a similar problem.
But I already know where I am wrong. In this code, "slim.batch_norm" have been used, we should define the optimizer as follows:

  update_ops = tf.get_collection(tf.GraphKeys.UPDATE_OPS)
  train_op = optimizer.minimize(loss)
  train_op = tf.group([train_op, update_ops])

Please refer to my summary:https://github.com/JiaShengLiu111/Deeplearning/blob/master/Tensorflow%E4%B8%ADbatch_normalization%E4%BD%BF%E7%94%A8%E6%B3%A8%E6%84%8F%E4%BA%8B%E9%A1%B9.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants