/Python/Learningrate scheduler tensorflow

Learningrate scheduler tensorflow

tf.keras.callbacks.LearningRateScheduler(
    schedule, verbose=0)

# This function keeps the initial learning rate for the first ten epochs
# and decreases it exponentially after that.

def scheduler(epoch, lr):
  if epoch < 10:
    return lr
  else:
    return lr * tf.math.exp(-0.1)

model = tf.keras.models.Sequential([tf.keras.layers.Dense(10)])
model.compile(tf.keras.optimizers.SGD(), loss='mse')

callback = tf.keras.callbacks.LearningRateScheduler(scheduler)
history = model.fit(np.arange(100).reshape(5, 20), np.zeros(5),
                    epochs=15, callbacks=[callback], verbose=0)

Similar codes

29 votes150 views3 answers
Print no new line python
Python
0 vote159 views1 answer
Python capitalize first letter of string without changing the rest
Python
0 vote138 views1 answer
How to print class attributes in python
Python
0 vote174 views1 answer
Cite pandas python
Python
0 vote147 views1 answer
File = Root() path = file.fileDialog() print("PATH = ", path)
Python
15 votes102 views2 answers
Is_integer() python
Python
6 votes146 views2 answers
Slice dataframe pandas based on condition
Python
5 votes155 views3 answers
How to convert array value to integer in python
Python
0 vote144 views1 answer
Pd calculations between columns
Python
23 votes287 views2 answers
Flask or django
Python Django