Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

1 vote138 views2 answers
Making a basic network scanner using python
Python
11 votes124 views3 answers
How to do pandas profiling
Python
8 votes157 views6 answers
Django filters
Python Django
0 vote168 views1 answer
'numpy.float64' object has no attribute 'isnull'
Python
0 vote135 views3 answers
Django add user to group
Python
5 votes126 views3 answers
Debugging python
Python
1 vote134 views3 answers
Program to draw rectangle in python
Python
0 vote131 views1 answer
Python data structures 9.4
Python
1 vote119 views1 answer
How to change the rate of speech in pyttsx3
Python
0 vote129 views1 answer
TypeError: Object of type DictProxy is not JSON serializable
Python