/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

0 vote137 views1 answer
Finetune vision model huggingface pytorch github
Python
0 vote195 views3 answers
Github/hacksofteare
Python
0 vote231 views1 answer
Python pip past
Python
0 vote171 views1 answer
Fix certain parameters during curve fit python lambda
Python
19 votes173 views2 answers
Pyinstaller single file
Python
0 vote169 views1 answer
Longueur liste python
Python
0 vote250 views1 answer
Nltk hide download messages
Python
4 votes168 views2 answers
Pandas to_csv delimiter
Python
2 votes187 views3 answers
0 1 1 2 3 5 in python
Python
6 votes170 views2 answers
Remove string punctuation python 3
Python