/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

0 vote121 views1 answer
Installing intel python
Python
0 vote106 views1 answer
Taggablemanager serializer django
Python
0 vote146 views1 answer
Django python base 64 encode
Python Django
0 vote130 views1 answer
Python oops
Python
1 vote124 views2 answers
Python socket check if still connected
Python
0 vote117 views1 answer
Box Plot, Python
Python
0 vote114 views1 answer
Using -h on python file
Python
57 votes130 views6 answers
Python sum of list
Python
0 vote126 views1 answer
NameError: name 'after_this_request' is not defined
Python
7 votes144 views1 answer
Change value in pandas dataframe cell
Python