Heavy Tailed Self Regularization in Deep Neural Nets: 1 year of research

My talk at ICSI-the International Computer Science Institute at UC Berkeley. ICSI is a leading independent, nonprofit center for research in computer science.

Why Deep Learning Works: Self Regularization in Neural Networks

Presented Thursday, December 13, 2018

The slides are available on my slideshare.

The supporting tool, WeightWatcher, can be installed using:

     pip install weightwatcher

https://github.com/CalculatedContent/WeightWatcher

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s