/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

4 votes132 views2 answers
Django queryset group by
Python
3 votes219 views10 answers
Date parser python pandas
Python
0 vote168 views1 answer
Which env im running jupyter notebook
Python
0 vote149 views1 answer
Python set timezone windows
Python
3 votes191 views5 answers
Python sha256 crypt decrypt
Python
0 vote167 views1 answer
How to get a rectangular grid out of two given one-dimensional arrays
Python
1 vote163 views1 answer
Django model query add annotation field to show duplicate count
Python Django
20 votes147 views1 answer
ParserError: Error tokenizing data. C error: Expected 1 fields in line 87, saw 2
Python
0 vote140 views4 answers
Ip address regex
Python
0 vote142 views1 answer
Run sql query on pandas dataframe
Python