/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

4 votes140 views2 answers
Python mkdir
Python
1 vote149 views1 answer
Pygame how to make a transparent surface
Python
3 votes125 views1 answer
Module 'datetime' has no attribute 'strptime'
Python
0 vote115 views1 answer
How to loop through every character in a string
Python
0 vote128 views1 answer
Ms access python dataframe
Python
1 vote131 views1 answer
How to capture a single photo with webcam opencv
Python
0 vote127 views1 answer
Get flask version
Python
0 vote143 views1 answer
Python logging comma to dot
Python
1 vote137 views1 answer
Def speak("audio"):
Python
2 votes150 views1 answer
Database default code in settings django
Python Django