Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote167 views1 answer
Random forest classifier classification report
Python
1 vote214 views1 answer
Sort a dict by values
Python
3 votes157 views3 answers
Python pip not working
Python
0 vote183 views1 answer
Entry point to programming Spark with the Dataset and DataFrame API
Python
2 votes177 views1 answer
Generate a list of random non repeated numbers python
Python
1 vote164 views1 answer
Python define an array of dictonary
Python
0 vote169 views1 answer
Multivariate classification python
Python
0 vote173 views3 answers
System.Windows.Forms.DataGridView.CurrentRow.get returned null. c#
Python
7 votes169 views4 answers
Pytorch save model
Python
0 vote160 views1 answer
Bash: line 1: templates/addtask.html: No such file or directory in flask app
Python