Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

5 votes126 views2 answers
Import get_object_or_404
Python
0 vote137 views1 answer
Regex emaple py
Python
0 vote141 views1 answer
Django today date in template
Python
0 vote122 views1 answer
Python enable pyqt errors
Python
47 votes138 views6 answers
Random float python
Python
1 vote170 views1 answer
Django clear db
Python Django
92 votes134 views6 answers
Python choose random element from list
Python
2 votes143 views1 answer
Python check if character is letter
Python
0 vote130 views1 answer
Java sript
Python
1 vote132 views1 answer
Python webdriver element not interactable
Python