Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote160 views1 answer
How to count in a loop python
Python
2 votes156 views2 answers
Can you edit string.punctuation
Python
5 votes164 views2 answers
Django admin password reset
Python
0 vote154 views1 answer
Mudopy
Python
0 vote144 views1 answer
Discord py server.channels
Python
8 votes156 views3 answers
Python datetime to unix timestamp
Python
0 vote149 views1 answer
String with comma to int python
Python
24 votes252 views5 answers
Get time python
Python
0 vote158 views1 answer
Taking a list of strings as input, our matching function returns the count of the number of strings whose first and last chars of the string are the same. Also, only consider strings with length of 2 or more. python
Python
23 votes148 views2 answers
Django rest
Python