Resume will override learning rate on command line.

[manishbcd]

If you resume from a checkpoint and want to run with a new learning rate, the saved learning rate will overwrite what you specify on the command line. The fix is simple.

[msaroufim]

Would you like to make the fix?