Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

3 votes173 views1 answer
Discord.py how to use permissions
Python
0 vote129 views2 answers
How to take list of integer as input in python
Python
0 vote178 views1 answer
How to insert value in admin panel in django
Python Django
4 votes106 views1 answer
Pandas concat reset index
Python
0 vote143 views1 answer
Python is instance numpy arrya
Python
0 vote130 views1 answer
Python How To Convert Text to Speech
Python
10 votes137 views4 answers
Django q objects
Python
1 vote132 views1 answer
Remove all roles discord py
Python
0 vote150 views1 answer
Is file a keywoard in python
Python
1 vote139 views1 answer
Python program to keep your computer awake
Python