Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote108 views1 answer
Python program for swapping position of two numbers
Python
6 votes131 views3 answers
Cosine Similarity numpy
Python
0 vote105 views1 answer
Tkinter datatypes
Python
0 vote100 views1 answer
Get raster corners python
Python
0 vote102 views1 answer
Genshin impact checker python
Python
0 vote129 views1 answer
Django.db.utils.ProgrammingError: can't adapt type 'dict_keys'
Python
6 votes113 views3 answers
No matching distribution found for tensorflow==2.2.0
Python
0 vote136 views2 answers
Django swagger
Python Django
0 vote102 views1 answer
How to access rows and columns indexing numpy
Python
0 vote126 views1 answer
How to get column names having numeric value in pandas
Python