Pytorch l2 regularization

# add l2 regularization to optimzer by just adding in a weight_decay 
optimizer = torch.optim.Adam(model.parameters(),lr=1e-4,weight_decay=1e-5)

Regularization pytorch

 loss = mse(pred, target)
 l1 = 0
 for p in net.parameters():
  l1 = l1 + p.abs().sum()
 loss = loss + lambda_l1 * l1
 loss.backward()
 optimizer.step()

Source: discuss.pytorch.org

Similar codes

0 vote142 views1 answer
Python split paragraph
Python
7 votes156 views1 answer
Python marker size
Python
1 vote147 views1 answer
Microbit python documentation
Python
0 vote173 views1 answer
Django pointfield value format for fixtures
Python Django
0 vote141 views1 answer
Argumrnt with reverse django
Python
1 vote149 views1 answer
Download from radio javan python
Python
25 votes145 views3 answers
Python warnings as error
Python
0 vote159 views1 answer
How to kill somene
Python
17 votes106 views1 answer
Merge 4 dataframes pandas
Python
0 vote155 views1 answer
Python monitor directory for files count
Python