/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

-1 vote194 views1 answer
Converting multipage tiff to pdf python
Python
0 vote169 views1 answer
Jinja flask
Python Flask
0 vote198 views1 answer
Set path for another directory
Python
25 votes171 views3 answers
Startapp django
Python
0 vote283 views1 answer
Flask app with spark
Python
0 vote172 views1 answer
How to increment date by one in python
Python
0 vote174 views1 answer
How to round off values in columns in pandas in excel
Python
0 vote178 views1 answer
Python add month datetime
Python
0 vote221 views2 answers
Flask abort
Python Flask
1 vote228 views1 answer
Django return only part of string
Python Django