Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

16 votes199 views6 answers
Python convert timestamp to datetime
Python
0 vote187 views2 answers
Python write column csv
Python
0 vote191 views1 answer
Region error when use service account json file dataproc
Python
0 vote195 views1 answer
Sum with conditional python
Python
0 vote171 views1 answer
Time df.apply() python
Python
102 votes183 views6 answers
Python contains
Python
0 vote179 views1 answer
File "<ipython-input-12-48c6c043344b>", line 29 coin = random.randint(0,1) ^ IndentationError: expected an indented block
Python
0 vote219 views1 answer
Matplotlib get and chan values of tick labels
Python
3 votes261 views1 answer
Pandas fill na with value from another column
Python
73 votes225 views1 answer
How to install pip in anaconda
Python